Items with no label
3335 Discussions

Intel Realsense Solution for real-time Augmented Reality Application

NKara1
Beginner
1,660 Views

Hi all,

I have started exploring Intel Real Sense not for a long time. I just received it and start to develop an AR application. I use Intel Real Sense R200 because I need the long range view. My question is regarding following scenario, What is the best way to utilize the camera R200?

Scenario:

I have an object, let say a Box. I want to measure this Box using R200. I got the width x height x depth size and store the information.

Render the size into AR objects. I want to pack the box virtually so that everyone can see the packing process through AR.

Question:

How should I implement this kind of scenario?

Current Solution:

I thought of something like, integrating the R200 with Unity, and coding inside the Unity. And port the unity model to smartphone using Vuforia as AR Tools. But If I implement it like this, it would not be real time right? I have to port the packing box simulation whenever I received new boxes.

My second assumption is, implementing another R200 camera, and when the camera detect designated marker, I can see the packing box simulation through this camera. But I only have one camera. How to create the prototype is also something that I need to think of.

Btw, I haven't decided what language to use. Honestly I am more familiar with C# , but when I read the documentation, for measurement is only supporting C++, right?

So, to wrap up my question, which solution is the best approach regarding my scenario case.

Thank You.

I am stuck and thinking so many times about the AR approaches for so long. I need an advice from experts

0 Kudos
1 Solution
idata
Employee
541 Views

Hello chronos14,

Thank you for interest in the Intel® RealSense™ Technology.

Sorry for the late response, I did some research and find your project quite interesting.

Regarding your questions, you are right, porting the Unity model to a smartphone using Vuforia can't be done in real time, since you need to program the simulation of the packing process for each different type of box.

Keep in mind that since you are using a R200 camera, you should use Intel RealSense SDK R2 (http://registrationcenter-download.intel.com/akdlm/irc_nas/vcp/9078/intel_rs_sdk_offline_package_10.0.26.0396.exe http://registrationcenter-download.intel.com/akdlm/irc_nas/vcp/9078/intel_rs_sdk_offline_package_10.0.26.0396.exe)

Also, if you are interested in using C# for the measurement process, check this article https://software.intel.com/en-us/articles/intel-realsense-camera-r200-enhanced-photography-code-sample%23_Toc450062036 https://software.intel.com/en-us/articles/intel-realsense-camera-r200-enhanced-photography-code-sample# _Toc450062036.

The two camera approach is quite interesting, but since you only have access to one R200 camera you should consider porting the simulations and triggering them with a marker, instead of doing a real time simulation out of a series of measurements.

If you need further assistance, don't hesitate to contact us.

Regards,

 

Andres

View solution in original post

0 Kudos
7 Replies
idata
Employee
542 Views

Hello chronos14,

Thank you for interest in the Intel® RealSense™ Technology.

Sorry for the late response, I did some research and find your project quite interesting.

Regarding your questions, you are right, porting the Unity model to a smartphone using Vuforia can't be done in real time, since you need to program the simulation of the packing process for each different type of box.

Keep in mind that since you are using a R200 camera, you should use Intel RealSense SDK R2 (http://registrationcenter-download.intel.com/akdlm/irc_nas/vcp/9078/intel_rs_sdk_offline_package_10.0.26.0396.exe http://registrationcenter-download.intel.com/akdlm/irc_nas/vcp/9078/intel_rs_sdk_offline_package_10.0.26.0396.exe)

Also, if you are interested in using C# for the measurement process, check this article https://software.intel.com/en-us/articles/intel-realsense-camera-r200-enhanced-photography-code-sample%23_Toc450062036 https://software.intel.com/en-us/articles/intel-realsense-camera-r200-enhanced-photography-code-sample# _Toc450062036.

The two camera approach is quite interesting, but since you only have access to one R200 camera you should consider porting the simulations and triggering them with a marker, instead of doing a real time simulation out of a series of measurements.

If you need further assistance, don't hesitate to contact us.

Regards,

 

Andres
0 Kudos
NKara1
Beginner
541 Views

Hi Andres,

Thank you so much for your opinion, I'll try to think again about the solution architecture for the case

and for the measurement process using C# , I will try to refer to it.

May I ask, what does it mean with porting the simulation and triggering them with a marker?

So, it is like I created my own "Vuforia"? I did measure and have the size data, then whenever my camera see some marker, it will portray the AR object?

Regards,

chronos14

0 Kudos
idata
Employee
541 Views

Hello chronos14,

 

 

You are welcome.

 

 

Yes, that is exactly what "triggering a simulation with a marker" means, once you have the measurements (and the animation), when the camera sees a marker, it portrays the augmented reality object.

 

 

If you need further assistance, don't hesitate to contact us.

 

 

Regards,

 

Andres
0 Kudos
NKara1
Beginner
541 Views

Hi Andres,

By the way, do you have any idea of how recognizing or detecting certain object or market in easy way?

And how to render the simulation also?

I have no background idea of how doing this in programmable way. I hope it doesn't include external library such as OpenGL, because it will be more difficult.

Thank You!

Regards,

chronos14

0 Kudos
idata
Employee
541 Views

Hello chronos14,

 

 

I'll suggest you to read these three-part article:

 

https://software.intel.com/en-us/articles/using-the-intel-realsense-camera-with-touchdesigner-part-1

 

https://software.intel.com/en-us/articles/using-the-intel-realsense-camera-with-touchdesigner-part-2

 

https://software.intel.com/en-us/articles/using-the-intel-realsense-camera-with-touchdesigner-part-3

 

 

It is a very well written article that will guide you through the creation of content, both rendered and in real-time, with a RealSense camera and TouchDesigner software (a free noncommercial copy is available).

 

 

Also, since you mentioned that you are more familiar with C# , you should check this site http://www.i-programmer.info/programming/hardware/8343-getting-started-with-realsense-in-c.html.

 

 

Regards,

 

Andres
0 Kudos
NKara1
Beginner
541 Views

Hi Andres,

Wow! what a very nice information you gave. It seems interesting and a lot to catch.

I'll study it first. I hope it match with my requirement. Thanks!

Best Regards,

chronos14

0 Kudos
idata
Employee
541 Views

Hello chronos14,

 

 

You are welcome. I'm glad that you think the information provided is relevant to your project.

 

 

If you need further assistance, don't hesitate to contact us.

 

 

Regards,

 

Andres
0 Kudos
Reply