Skip to content

Allow to perform registration while keeping the depth buffer #649

Open

Description

@SirLynix

Hi, author of obs-kinect here.

First of all, thank you for your amazing job on libfreenect, I've been using it for my plugin but there's one issue that remains, I need to be able to get registered depth (color-mapped depth as I call it) and regular depth at the same time, however libfreenect seems to be the only kinect backend which doesn't provide a function to map depth to rgb space (libfreenect2 has Registration::apply, Kinect SDKs have MapColorFrameToDepthFrame, Azure SDK has k4a_transformation_depth_image_to_color_camera).

I see there's the internal freenect_apply_depth_to_mm which seems to do what I want, is there a way it could be exposed?

Thank you.

Activity

  1. added this to the next milestone on Jan 3, 2022
  2. piedar commented on Jan 3, 2022

    @piedar
    Contributor

    I think you might want freenect_apply_registration because it aligns the result to the RGB image, while freenect_apply_depth_to_mm converts to mm but does not align.

  3. SirLynix commented on Jan 4, 2022

    @SirLynix
    Author

    Yes indeed. I made a fork of libfreeenect to expose such features which allowed me to have both depth and color-mapped depth images.

  4. added 3 commits that reference this issue on Jan 4, 2022
    f93a3d0
    c8c6716
    5c54a0b
  5. piedar commented on Jan 4, 2022

    @piedar
    Contributor

    Nice! I had a quick go at it the other day. It's a bit more complicated, but I kept convert_packed_to_16bit internal and my registration function handles all the depth modes rather than just FREENECT_DEPTH_11BIT. Let me know what you think.

  6. SirLynix commented on Jan 4, 2022

    @SirLynix
    Author

    Looks good! I will give it a try to check if it works as expected soon, thank you!

  7. edugimeno commented on Apr 18, 2022

    @edugimeno

    Please please forgive me for hijacking this thread for this question, but there's absolutely no place / forum I can find to place a couple questions about this project. The wiki links to google groups which were closed 4 years ago. There's no other trace of forum for OpenKinect, can you please help me with directions for any currently working forum for OpenKinect / Libfreenect?

    Thanks in advance and sorry

  8. piedar commented on Sep 19, 2022

    @piedar
    Contributor

    @edugimeno Alas, there isn't really a forum that I know of. I check in here on GitHub occasionally to fix bugs and give suggestions, but most contributors have moved on to other projects.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions