Documentation

  • 2021.2
  • 06/30/2021
  • Public Content

Launch Wandering Application with Intel® RealSense™ Camera

The application consists of two ROS nodes, developed by Intel. In order to function properly, those two nodes depend on other ROS nodes/packages: RealSense ROS wrapper, Nav2 ROS package, RTABMAP and its ROS Wrapper, and robot drivers.
Wandering ROS nodes are:
  • Wandering: gets updates from nav2 via costmap and issues navigation goals back to nav2 node
  • Object Detection: gets color and depth images from RealSense camera ROS wrapper, performs object detection and publishes coordinates of detected objects
The following diagram shows the internal architecture of the Wandering application and its ROS node dependencies.

Run the Sample Application

  1. Connect the Intel® RealSense™ camera (for example, D435i) to the host.
  2. Go to the
    AMR_containers
    folder:
    cd <edge_insights_for_amr_path>/Edge_Insights_for_Autonomous_Mobile_Robots_<version>/AMR_containers
  3. Run the command below to start the Docker container:
    ./run_interactive_docker.sh amr-ubuntu2004-full-flavour-sdk:<TAG>
  4. Within the Docker container, run the commands:
    source /opt/ros/foxy/setup.bash source /opt/ros2_ws/install/setup.bash source /opt/intel/openvino_2021.2.200/bin/setupvars.sh source /workspace/Wandering/src/prebuilt_wandering/setup.bash
  5. Run the Wandering application:
    ros2 launch wandering_app standalone_wander.launch.py
    Expected output:
    [INFO ] [launch]: All log files can be found below /root/.ros/log/2021-05-17-12-11-29-103678-glaic3n125-4218 [INFO] [launch]: Default logging verbosity is set to INFO /opt/ros2_ws/install/rtabmap_ros/share/rtabmap_ros/launch/realsense_d400.launch.py:29: UserWarning: The parameter 'node_executable' is deprecated, use 'executable' instead Node( /opt/ros2_ws/install/rtabmap_ros/share/rtabmap_ros/launch/realsense_d400.launch.py:34: UserWarning: The parameter 'node_executable' is deprecated, use 'executable' instead Node( [INFO] [realsense2_camera_node-2]: process started with pid [4222] [INFO] [static_transform_publisher-1]: process started with pid [4220] [INFO] [object_detection_ssd-3]: process started with pid [4224] [INFO] [rgbd_odometry-4]: process started with pid [4226] [INFO] [rtabmap-5]: process started with pid [4228] [INFO] [main-6]: process started with pid [4230] [...] [object_detection_ssd-3] detection_out EXECUTED layerType: DetectionOutput realTime: 94 cpu: 94 execType: unknown_FP32 [object_detection_ssd-3] out_detection_out NOT_RUN layerType: Output realTime: 0 cpu: 0 execType: unknown_FP32 [object_detection_ssd-3] Total time: 9119 microseconds [object_detection_ssd-3] [object_detection_ssd-3] Full device name: Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz [object_detection_ssd-3]
  6. Open a new foxy container instance:
    docker ps docker exec -it <container_id> /bin/bash
  7. Within the Docker container, run:
    source /opt/ros/foxy/setup.bash
  8. Start rviz2:
    rviz2
  9. The occupancy grid map is displayed in rviz2, generated by RTAB_MAP while running the Wandering application.
    Be sure to add in rviz2 the
    Map
    (from Map) and
    Image
    (from color/image_raw) using the
    Add
    button and
    By Topic
    tab.

Summary and Next Steps

In this tutorial, you learned how to launch the Wandering application with Intel® RealSense™ camera.
As a next step, see the Launch Cartographer with 2D LIDAR tutorial.

Product and Performance Information

1

Performance varies by use, configuration and other factors. Learn more at www.Intel.com/PerformanceIndex.