Open3D | Open3D : A Modern Library for 3D Data Processing | Graphics library

I am trying to create a Shiny app that displays an RGL visualisation (which is nothing else than a set of polished sticks and spheres). Please have a look at the code for the visualisation below

I want to identify 3d cylinders in an rgl plot to obtain one attribute of the nearest / selected cylinder. I tried using labels to simply spell out the attribute, but I work on data with more than 10.000 cylinders. Therefore, it gets so crowded that the labels are unreadable and it takes ages to render.

I tried to understand the documentation of rgl and I guess the solution to my issue is selecting the cylinder in the plot manually. I believe the function selectpoints3d() is probably the way to go. I believe it returns all vertices within the drawn rectangle, but I don't know how to go back to the cylinder data? I could calculate which cylinder is closest to the mean of the selected vertices, but this seems like a "quick & dirty" way to do the job.

Is there a better way to go? I noticed the argument value=FALSE to get the indices only, but I don't know how to go back to the cylinders.

Here is some dummy data and my code:

I'm currently trying to play a sequence of ply models through open3d, but I'm having some issues with updating the geometry. Currently only the first image is shown, and the vis isn't being updated. I've been trying to find some info on this, but most guides or other sections show that this should work? I'm not entirely sure what I'm doing wrong but any advice would be greatly appreciated.

I'm currently using python==3.9 and open3d==14.1.

I am trying to plot cylinder models of trees in R, which consist of several thousand cylinders. Currently, I am trying to use the rgl package for this task. Until now, I looped through all cylinders and added them separately to the 3D Plot.

Here an example with dummy data:

I have a sequences of pngs and corresponding depth files (aligned to the corresponding images) from an external camera.

RGB: 1.png 2.png 3.png etc 150.png

Depth: 1.txt 2.txt 3.txt etc 150.txt

I also have the intrinsics and corresponding camera information in another file called camera.txt.

My goal is to convert these images and depth files to an mkv file in order to utilize the pykinect's body tracker (https://github.com/ibaiGorordo/pyKinectAzure)

So far, I've been able to convert the images and and depth files into an open3D RGBD object. See: http://www.open3d.org/docs/release/python_api/open3d.geometry.RGBDImage.html

I would think we need to run it through the azure kinect reader (https://github.com/isl-org/Open3D/blob/0ec3e5b24551eaffa3c7708aae8630fde9b00e6c/examples/python/reconstruction_system/sensors/azure_kinect_recorder.py#L34), but this seems to open up the camera for additional input.

How can I save this rgbd images to an mkv file format to read in to the pykinect reader? I

I've been trying to use the HOnnotate dataset to extract perspective correct hand and object masks as shown in the images of Task-3 of the Hands-2019 challenge.

The data set comes with the following annotations:

I have two .ply files that contain mesh of objects that are similar in shape. They are initially unaligned. I would like to achieve global registration for the two mesh objects. Is there a way that I can do this without having to initially import the point cloud data, do global registration, and then reconstruct the mesh?

I have tried the steps listed in the open3d documentation (http://www.open3d.org/docs/0.12.0/tutorial/pipelines/global_registration.html) and it works well for the point clouds. However, reconstructing a mesh from the point clouds is challenging, as they are a relatively complex shape, so I would like to avoid that.

Thank you in advance!

I am using CMake to define the compilation of a C++ executable. The goal is to use 2 third-party libraries, Open3D and OpenCV. I am able to include one of the two with target_link_libraries, but including both results in OpenCV functions not being found.

This is my current CMakeLists.txt

I have a colmap export of the camera pose file which named "images.txt".