Skip to content

Feature/object detector with scene objects mamager#115

Open
AntoniRL wants to merge 21 commits intohumble-develfrom
feature/object-detector
Open

Feature/object detector with scene objects mamager#115
AntoniRL wants to merge 21 commits intohumble-develfrom
feature/object-detector

Conversation

@AntoniRL
Copy link
Copy Markdown
Contributor

@AntoniRL AntoniRL commented Mar 24, 2026

Description

Made changes to enable object detection using ArUco markers in the scene_objects_manager package.

Motivation and context

The PR includes changes to the scene camera position and the startup of the scene object manager node.

How has this been tested?

Tested on the real robot.

Realted PR

Checklist

  • All TODOs in the code have been resolved or linked to a proper issue.
  • Code has been (auto)formatted.
  • Documentation (e.g., README, CHANGELOG, Wiki) has been updated.
  • All automated checks have passed.

Clickup task: 869cbbrjb

Copy link
Copy Markdown
Contributor

@macmacal macmacal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For the starters, please update the CHANGELOG

Comment on lines +17 to +18
cam_pos_y="-0.016"
cam_pos_z="1.160"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to the camera position change?

Comment on lines +224 to +244
pos_str = None
quat_str = None

if pose is not None:
p = pose.pose if hasattr(pose, "pose") else pose
pos_str = (p.position.x, p.position.y, p.position.z)
quat_str = (
p.orientation.x,
p.orientation.y,
p.orientation.z,
p.orientation.w,
)
else:
pos_str = position
quat_str = quat_xyzw

self.node.get_logger().info(
f"Moving to {{position: {position}, quat: {quat_xyzw}}}, max_vel: {max_vel:.2f}, max_accel: {max_accel:.2f}}}"
f"Moving to {{pos: {pos_str}, quat: {quat_str}}}, "
f"max_vel: {max_vel:.2f}, max_accel: {max_accel:.2f}"
)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suggest to move this logic to an auxiliary utility method or function - its very useful.

return
rvec, tvec = self.last_object_tf
tf_camera_name = "cam_scene_rgb_camera_optical_frame"
tf_camera_name = "cam_scene_rgb_camera_optical_frame_cal"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why we needed to change this tf?

@AntoniRL
Copy link
Copy Markdown
Contributor Author

Has to be tested on the robot before merging.

@AntoniRL
Copy link
Copy Markdown
Contributor Author

AntoniRL commented Apr 1, 2026

Has to be tested on the robot before merging.

DONE.

camera:
i_mx_id: 184430108157970F00
i_pipeline_type: RGB # RGB, RGBD
i_pipeline_type: CamArray # RGB, RGBD, CamArray
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does this pipeline change? Does it decrease camera's FPS relative to RGB pipeline?

cam_pos_x="0.33"
cam_pos_y="0.014"
cam_pos_z="1.166"
cam_pos_y="-0.016"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is the reason for camera's position change?

Comment on lines +26 to +35
right:
i_publish_topic: true
i_height: 720
i_width: 1280
left:
i_publish_topic: true
i_height: 720
i_width: 1280
depth:
i_publish_topic: true
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These lines were for debugging purposes. It would be great to save them for later (i vote for commenting them and creating an issue for incorporating them into a proper launch file later).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please update the aegis_director changelog

self.description_cfg_pkg_name = "aegis_description"
self.description_cfg_pkg = FindPackageShare(self.description_cfg_pkg_name)

# TODO if working then remove lines
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Address this TODO

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants