There are specific hardware requirements for RapidSense to function successfully. Special attention should be given to the following to achieve optimal performance.
| Table of Contents |
|---|
PC/controller and OS requirements
Minimum required PC specifications
Intel i7 or equivalent or better
128GB RAM minimum
I/O ports for sensors (either USB or Ethernet)
SSD hard drive preferred
nVidia or AMD GPU required (mandatory)
OS Requirements
Ubuntu Linux 22.04+
Native sensor support
| Info |
|---|
Realtime Robotics does not provide customers with sensors, customers are expected to procure sensors themselves. |
RapidSense provides native support for a set of sensors.
Supported Sensors
Standard applications: Intel RealSense D455
High-resolution applications (requiring tight tolerances ~2-10mm): Photoneo Motioncam 3D depth + IR cameras (any size, both color and non-color)
Calibration
Aruco Tagsrequirements
Aruco tags will be necessary to acquire in order to perform calibration of the sensors to the RTR system. At least (2) different Aruco tag patterns are required per application:are required to calibrate the sensors. RapidSense supports the April 36H11 tag format. See section "Calibration Tag Information" for further information.
A minimum of one Aruco tag is required, if you are using RapidSense’s built-in sensor functionality. A tag, mounted on a robot, must be visible to all sensors.
One mounted on the robot end effector (TCP location of tag will need to be provided)
One mounted static in the scene that is visible to the sensors
Additional Aruco tags may be required depending on the system configuration. See section "Calibration Tag Information" for further information.
Calibration Tag Mounting
When you mount the calibration tags on the robot end-effector, note the orientation of the tag. In the photo below, the one with the text is down.
Mounting calibration tags
| Info |
|---|
The RapidSense customer must procure and mount calibration tags to meet specifications detailed below |
Users must design and install a mount for the calibration tag. It is recommended that the mount be attached to the end-effector.
In order to the calibration repeatable with accuracy, the tag must ensure a robust and repeatable calibration process, it is required that the calibration tag be fixed to the robot. Below The following are some examples of fixed robot-mounted tags.
Here are some examples of tags attached to robots.
Sensor Mounting and Occlusions
Occlusions are the parts of the environment that a camera cannot see due an obstruction. It is recommended that sensor placement is made so as to minimize occlusions (e.g., it is not optimal to place a sensor directly behind a robot).
Sensor placement also depends on the robot application. For example, for a pick and place application, ask yourself, where will the robot move? Where will the occlusions be, and for which sensors?
This process tends to be somewhat trial-and-error.
To achieve optimal performance out of RapidSense, keep the following guidelines in mind when mounting your sensors:
Make sure to position the sensors in your workspace to maximize coverage of the environment. Most sensor providers provide CAD models of the sensors and include the field-of-view (FOV) in the model, which this can be used to visualize and verify the sensor ability to see the Volume of interest.
The Intel Realsense specifications are for +/- 2% depth accuracy when they’re within 2 meters of an obstacle, so we recommend placing cameras across the workspace so that obstacles are within this distance.
Space the sensors apart from one another and at different angles to provide different perspectives of the scene.
Mount the sensors securely and rigidly. If a sensor vibrates relative to robot motion, it will return noisy data resulting in false positives for obstacles. It can also cause sensors to shift and invalidate the calibration data.
Connect the sensor cables with strain relievers.
Lighting Conditions
| Info |
|---|
RapidSense customer owns providing lighting conditions to meet the specifications detailed below |
It is recommended to control lighting conditions as best as possible for applications through adding covers to deflect direct overhead lighting, sunlight, or other direct ambient light sources. Ambient lighting directly cast onto the sensors and the environment or that is reflected off of highly reflective surfaces can introduce noise and wash out images needed by the sensors and should be avoided and/or controlled (i.e., minimized). Changes in lighting conditions during operation, such as the effects of sunlight, should be prevented. Depending on sensor selection, the effects of lighting to the system may vary.