Skip navigation
1 2 Previous Next

Intel® RealSense

17 Posts authored by: Jesus Garcia

We have created this unofficial pointcloud example to demonstrate how to view live pointcloud stream in Matlab. It is very basic and does not map color. Mapping of color is still a work in progress. This is provided only to get you started. Matlab and Intel RealSense SDK 2.0 knowledge is required.

 

function pointcloud_example()
    % Make Pipeline object to manage streaming
    pipe = realsense.pipeline();
    
    pointcloud = realsense.pointcloud();


    % Start streaming on an arbitrary camera with default settings
    profile = pipe.start();


    % Get streaming device's name
    dev = profile.get_device();
    name = dev.get_info(realsense.camera_info.name);


    % Get frames. We discard the first couple to allow
    % the camera time to settle
    for i = 1:5
        fs = pipe.wait_for_frames();
    end
        
    figure('visible','on'); 
    %hold on
    for i = 1:1000
        
        fs = pipe.wait_for_frames();
        
        % Select depth frame
        depth = fs.get_depth_frame();
        color = fs.get_color_frame();


        % Produce pointcloud
        if (depth.logical() && color.logical())


            pointcloud.map_to(color);
            points = pointcloud.calculate(depth);
            
            % Adjust frame CS to matlab CS
            vertices = points.get_vertices();
            X = vertices(:,1,1);
            Y = vertices(:,2,1);
            Z = vertices(:,3,1);


            plot3(X,Z,-Y,'.'); %hold on;            


            xlim([-1 1])
            ylim([0.3 2])
            zlim([-1 1])
            xlabel('X axis');
            ylabel('Y axis');
            zlabel('Z');
            pause(0.01);
        end
        % pcshow(vertices); Toolbox required       
    end


            
     % Stop streaming
    pipe.stop();
    
end

Symptoms:

  • RealSense software tools do not recognize the camera at all.
  • Cannot see streams--Depth, IR, RGB--or streams are not available in RealSense Viewer or other application.

 

Possible Causes

  • Camera is not connected to a USB 3 port
  • Faulty installation of librealsense
  • Unsupported Linux kernel

 

Workarounds

  • Connect the camera to a USB 3 port.
  • Upgrade the camera's firmware.
  • USB 2.0 is supported but fewer streams are available. See the datasheet for RealSense D400 Depth cameras for more information on supported streams when connecting the camera to a USB 2 port.
  • Patch the kernel as needed following these instructions.
  • See this page for more Troubleshooting information.

 

Collect logs

  • Plug in the RealSense Camera D4xx into a USB port, open a terminal, and type:

               i.   "lsusb -v | tee lsusb_4xx.log"

             ii.   "dmesg | tee dmesg_4xx.log"

  • Contact Intel Customer Support and attach log files to case.

We have seen many questions from customers who want to customize their Intel® RealSense™ D400 Series Modules with extra RGB sensors, fisheye cameras, tracking modules, etc, by connecting them to the 50-pin receptacle on the module. These customizations are not supported by Intel since they require camera firmware changes and Intel does not open-source the firmware.

 

The 50-pin receptacle was meant for integration with the T150 tracking module. However, the T150 tracking module has been discontinued (see the latest datasheet) so it is not available for purchase anywhere.

The multi-camera hardware sync feature of the Intel® RealSense™ D415 cameras is now available via the following firmware, v5.9.14.

 

https://downloadcenter.intel.com/download/27954/Latest-Firmware-for-Intel-RealSense-D400-Product-Family

 

This feature does not yet work on the Intel RealSense D435 camera. Support for the D435 is coming in the future but we do not have a timeline yet.

 

Note that this is development firmware so some features have not been fully validated by Intel. Do not use this FW in production builds.

Issue:  RealSense Viewer or other Windows camera apps do not recognize the Intel RealSense D415 or D435 Depth Cameras.

 

Possible Symptoms:

  • Only one node, RGB or Depth, is shown under Imaging Devices.
  • Only one node, RGB or Depth, is shown in RealSense Viewer from RealSense SDK 2.0.

 

Cause: Windows driver for the Intel® RealSense™ D415 and D435 Depth Cameras does not install correctly.

 

Possible Solutions:

  • Reboot the PC.
  • Plug-in camera into different USB3.0 port on same PC.
  • Plug-in camera into a USB3.0 port on different PC.
  • Uninstall and reinstall camera drivers and Windows UVC drivers.

 

To uninstall camera drivers

  1. Find camera nodes in Device Manager -> Imaging Devices.
  2. Right click on desired node.
  3. Select Uninstall Device.

Uninstall 1.PNG

   4. Select box for "Delete the driver software for this device."

Uninstall 2.PNG

   5.  Uninstall device under "Universal Serial Bus devices."

Uninstall 3.PNG

   6.  Uninstall device under "Cameras."

Uninstall 4.PNG

   7.  Reboot the PC and/or disconnect and reconnect the camera to the same or different USB 3 port.

 

If these workarounds don't work you may have a faulty camera that needs to be replaced.

You can find more information on the new Intel® RealSense™ SDK 2.0 here: https://github.com/IntelRealSense/librealsense

 

In this page, you will see that it will be supported on both Ubuntu and Windows 10.

There have been several reports that a library, libpxcface_idc.dll, used in the C++ Face module in RealSense SDK R3 is crashing when detecting multiple faces. We have been able to reproduce this problem when detecting multiple faces, and tracking at least one, in the C++ Face sample. The C# Face sample seems to work fine for some users, but not for others. We have not been able to reproduce this using either the C# or C++ Face samples in RealSense SDK R2.

 

Unfortunately, there will not be further development on the Face module for RealSense SDK for Windows so we cannot find the root cause of this issue.

 

As a workaround, we recommend to use RealSense SDK R2 for your Face projects that require multiple face tracking. The C# Face module in RealSense SDK R3 might work. Do not rely on libpxcface_idc.dll.

 

We apologize for the inconvenience this has caused.

 

Regards,

Jesus

Intel Customer Support

https://registrationcenter.intel.com/en/forms/?productid=2809

 

The page that hosted the previous SDK runtimes has been removed due to the security issues mentioned in this blog.

 

Note that only Intel® RealSense™ SDK 2016 R3 (for SR300, F200 cameras only) and Intel® RealSense™ SDK 2016 R2 (for R200, SR300, F200 cameras) are currently supported.

If you own an Intel Realsense SR300 camera and it stops functioning after a Windows upgrade, please refer to the troubleshooting sections below. Please see the first section if the camera stopped working on August 14, 2018 or later, and the second section if the camera stopped working before August 14, 2018.

 

Troubleshooting steps for Windows upgrades during or after August 14, 2018

 

Microsoft has implemented a migration block as of 8/14/2018, which prevents the Realsense drivers from installing during the Windows upgrade setup process. The drivers will instead be automatically installed after the upgrade process has completed. The purpose of this block is to avoid an interaction issue between the OS upgrade process and the RealSense installer that may result in a corrupt installation. The migration block applies to any upgrade starting from Windows 10 version 1803 or later.

 

Impact on users: You may experience a delay after OS upgrade while the Realsense drivers are downloading from Windows Update. The Realsense camera and Windows Hello will not work until this driver install has completed. If the camera is not functional within 20 minutes of reaching the login screen after Windows upgrade, please try the following:

 

  1. Verify that you are connected to the Internet and the Realsense camera is connected.
  2. Open Device Manager.
  3. Expand the "Imaging Devices" and "Cameras" categories.
  4. Find a device labeled either "Intel Realsense Camera SR300 Depth" or "USB Video Device" under one of these categories (see screenshot below).
  5. Right click -> update driver. Note: If this option is not available, then it most likely means that a driver is already in the process of installing. Skip to step 7.
    usb video device.png
  6. Choose the "Search automatically for updated driver software" option.
  7. Device manager may refresh several times. The install is complete when an "Intel Realsense Camera SR300 Virtual Driver" device appears under Imaging Devices or Cameras.
  8. Reboot. The camera should be operational at this point. If the camera is still not working, you may be able to recover it using the steps described below in "Troubleshooting steps for Windows upgrades before August 2018".

 

Troubleshooting steps for Windows upgrades before August 14, 2018

Please follow the below steps to attempt to recover a Realsense SR300 camera that is not functional after windows upgrade. Note that the reboots in step 4 and 6 are required, and the recovery may not be successful if these steps are skipped.

 

1.       Disconnect from any networks you are connected to (Wifi, Ethernet, or mobile broadband). For Wifi, uncheck the box to connect automatically.

2.       Open an admin command prompt and run: pnputil /enum-drivers
Find an entry in this list with an Original Name of "realsensesr300depth.inf". It will look something like this:

Published Name:     oem7.inf

Original Name:      realsensesr300depth.inf

Provider Name:      Intel(R) Corporation

Class Name:         Imaging devices

Class GUID:         {6bdd1fc6-810f-11d0-bec7-08002be2092f}

Driver Version:     09/22/2016 3.3.27.5718

Signer Name:        Microsoft Windows Hardware Compatibility Publisher

Note the Published Name field. It will most likely be different on your system than the oem7.inf value shown above.

3.       From the admin command prompt, run the following command. Replace <oemX.inf> with the actual Published Name field found in step 2.
pnputil /delete-driver <oemX.inf> /force

4.       Reboot.

5.       Open Device Manager. Locate the "Intel Realsense Camera SR300 Depth" device under Imaging Devices (it may be under Cameras instead). Right click on this device and click "Uninstall":

SR300 DM Uninstall.png

6.       Reboot again.

7.       Reconnect to the network, making sure you have internet access. Wait for about 10 minutes.
Note: This is to allow Windows Update to download and re-install the Realsense drivers. In some cases, you might have to wait longer than 10 minutes for the install to complete.

8.       Open Device Manager. When the drivers have finished installing from Windows Update, you should see a device labeled "Intel Realsense Camera SR300 Virtual Driver" appear under Imaging Devices, as shown here:

SR300 DM  VD.png

The camera should be operational at this point. If Windows Hello was previously setup, you should be able to lock the computer and log in using Windows Hello.

 

Troubleshooting

 

Step 5: If Intel Realsense Camera SR300 Depth is not present under Imaging Devices or Cameras, the camera may be in a special Firmware Update mode. When the camera is in Firmware Update mode, Device Manager will only display a device labeled "Intel Realsense Camera SR300", and you will not see the "Intel Realsense Camera SR300 Depth" or "Intel Realsense Camera SR300 RGB" devices. See the screenshot below:

SR300 DM None.png

If the camera is in Firmware Update mode, you can try one of the following to return it to its normal operating mode:

For external cameras: Unplug and replug the camera.

For integrated cameras: Reboot the system.

 

When the "Intel Realsense Camera SR300 Depth" device reappears in device manager, you can continue with step above.

 

Step 8: If "Intel Realsense Camera SR300 Virtual Driver" does not appear in Device Manager after waiting 10-20 minutes, you can try the following instead:

1.       Browse to https://downloadcenter.intel.com/download/25044/Intel-RealSense-Depth-Camera-Manager and download intel_rs_dcm_sr300_3.3.27.5718.exe. When prompted to run or save the file, choose the save option.

2.       Double-click on intel_rs_dcm_sr300_3.3.27.5718.exe to run the installer.

3.       If the Welcome page only gives the option to remove the software, click Next and continue with the uninstall. Otherwise, exit the installer and continue immediately to step 4 below.

4.       Open an admin command prompt to the location where the installer was downloaded.

5.       Run this command and then follow the prompts in the installer:
.\intel_rs_dcm_sr300_3.3.27.5718.exe --ignore-fw-update --update-fw=yes --finstall=all

6.       When the install is finished, open Device Manager. You should see a device labeled "Intel Realsense Camera SR300 Virtual Driver" under Imaging Devices if the install was successful.

Announcement

All SDK versions prior to 2016 R2 (v10.0.26.0396) have been discontinued and are no longer available for download from Intel websites.

 

Why

Security issue in web component in SDK versions prior to 2016 R2 (v10.0.26.0396). See this notice for further details and uninstallation instructions.

 

SDK 2016 R2 (v10.0.26.0396) minus the web component is still downloadable from here. The current version of the SDK, 2016 R3 (v.11.0.27.1384) is available for download here.

Whether you are having problems installing the RealSense drivers or running RealSense applications, providing RealSense logs to Intel Customer Support will speed up the troubleshooting process. If you are not sure which logs are relevant to your situation, collect all logs as instructed in this article.

 

Provide System Info File

First, provide a system info file.

  1. Press the keyboard WinLogo key + r
  2. Type msinfo32
  3. In the System Information console, click on File>>Export, and attach the .txt file to the service ticket or RealSense Community post.

 

Provide Driver Installation Logs

If the camera driver, Intel® RealSense™ Depth Camera Manager (DCM), does not install correctly:

  1. Capture and send a screenshot of the DCM installation error.
  2. Zip the full contents of all of the following log directories.
    • %temp%\micl_tmp_%username%
    • %windir%\Temp\micl_tmp_SYSTEM
    • %windir%\INF\setupapi.*

NOTE: "%TEMP%" is typically, "C:\Users\<username>\AppData\Local\Temp." "%windir%" is typically "C:\Windows".

    3. Attach the zip file and screen shot to the service ticket or RealSense Community post.

 

Provide Application Execution Logs

If you are having problems running RealSense applications or RealSense SDK samples, collect and provide execution logs. You will need to download and install the Intel® RealSense™ SDK.  Click here for detailed instructions with screen shots on collecting SDK logs.

  1. If you are using the SR300 or F200 cameras download and install the RealSense SDK Essentials package from here. If you are using the R200 camera, download the RealSense SDK R2 from here.
  2. Run the SDK debug tool by executing "C:\Program Files (x86)\Intel\RSSDK\bin\x64\SDK_Info.exe" as an Administrator.
  3. In the SDK_Info tool, navigate to the Logging Tab.
  4. Click “Enable All Logs” button
  5. Reproduce the issue by running whatever app is causing the failure  (make sure not to close sdk_info, it can be minimized, closing sdk_info will stop the logging).
  6. After the failure has occurred return to SDK_Info and click “Save” button (in sdk_info logging tab).
  7. Zip the created directory and attach to your service ticket or RealSense Community post.

Due to a security issue with one of the dependencies of the Intel® RealSense™ SDK Web Component, Intel has decided to discontinue marketing and development of the component and all related software.  This applies to all versions of the Intel® RealSense™ SDK.

 

Please see this notice for further details and uninstallation instructions.

Problem

The Intel® RealSense™ Cameras may sometimes experience power delivery problems from the target platform. This may result in connectivity issues where the camera is not fully recognized by the system.

 

Symptoms

  • Not able to install the camera driver - Intel® RealSense™ Depth Camera Manager. Error says, "The installer failed to detect an Intel® RealSense™ 3D camera on this system."
  • Windows Hello does not work. Only applicable to SR300 and F200 cameras.
  • You hear USB disconnect/connect sound
  • Camera disconnects after you press "Stop" on a stream from a RealSense SDK sample
  • The Virtual Driver disappears from Device Manager -> Imaging Devices. RGB and Depth nodes may still be visible.

 

Possible Workarounds

The following workarounds have helped some users resolve connectivity issues but are not guaranteed to work in every case.

  1. First, ensure the target system meets minimum system requirements for your RealSense camera.
    1. SR300 system requirements
    2. R200 system requirements
  2. Ensure the camera is connected to a powered USB 3.0 port on the target system. Try all the powered USB 3.0 ports.
  3. Update chipset drivers. See this article for more details.
  4. Connect the camera to an external powered USB 3.0 hub.
  5. Set USB 3.0 Host Controller to not turn off power to the device
    1. Go into Device Manager
    2. Right click the Intel(R) USB 3.0 eXtensible Host Controller - 1.0 (Microsoft) (or similar for your device)
    3. Click Properties
    4. Click the Power Management tab
    5. Deselect Allow the computer to turn off this device to save power

 

If none of these workarounds solve the connectivity problems then please contact Intel Customer Support for further assistance. You can open a web ticket or post in the RealSense Community forum. When first contacting support, please specify that you have gone through the steps outlined in this article and provide the article's URL.

Intel® RealSense™ cameras work best when the system's USB drivers are up to date. Use the Intel® Driver Update Utility to detect which driver updates are relevant to your computer. This may not always fix your RealSense connectivity issues but it may help.

 

Please note:

Intel provides generic versions of drivers for general purposes. Your computer manufacturer may have altered the features, incorporated customizations, or made other changes to your driver. Intel recommends you contact your computer manufacturer for the latest system specific updates and technical support information.