Real-time surface reconstruction from point cloud with RGB image stream fusion

[SamuXD2]

Hey guys,

I am using a Ouster OS0 LiDAR for point cloud generation and a RGB camera providing a steady video stream.
My goal ist to create/reconstruct a surface model and fuse that with the RGB images so that the colourless point cloud data will be overlayed with the RGB information for better visualisation.
Another big thing: it needs to be (near) real-time, i.e. the visualisation should not take more than 5 seconds. Quality and high resolution is not that much of a requirement.
Background: The sensors will be on a drone while the processing can be done on a ground station with higher performance computing.

Is this possible with Open3D and if so, how would you do it?

I really appreciate your help for this project and Bachelor's Thesis