RGB-IR Images Display support

The RGB-IR Display in DevWareX is implemented to support sensor that has RGB-IR Color Filter Array pixel array option, the RGB and IR(Infrared) images are displayed separately.

In DevWareX, when streaming with an RGB-IR CFA sensor, there are RGB and Infrared image display in different tabs, user can select the “Windows->Tile Sub-Windows” to view both images side by side as shown in following,

DevSuite > RGB-IR Still Capture and Video Recording > att_1_for_2390491137.png

DevSuite > RGB-IR Still Capture and Video Recording > att_4_for_2390491137.png

The RGB and IR images are interpolated separately from the original raw data that has a combination of R, G, B, and IR pixels.

Note: For RGB-IR sensor preview, without the RGB-IR plugin processing enabled, the IR window display in DevWareX is the IR linear interpretation. The IR image shows full resolution is DevWareX doing “4x multiply” from the IR Pixels.

Non-raw saved still and video files (e.g., BMP and AVI) are saved in 24-bit RGB format. There is no special case for IR-only, so the files are the same size.

1. Still Image Capture

To capture still images when sensor is streaming, user can select “Grab:” button from the DevWareX toolbar. Images for both RGB and IR will be captured in separated files, the image for IR image will have “ _ir” in the file name, shown as following.

Note: Only 1 file (no separate file for RGB and IR) will be saved for RAW file format which can display both images when opened with DevWareX.

DevSuite > RGB-IR Still Capture and Video Recording > att_2_for_2390491137.png

2. Video Recording

Video recording for RGB-IR images is very similar to still capture. User can select the “Record” button or from “Command->Start Recording” to record a video for the streaming images.

DevWareX will save the video file of RGB and IR in separate files for AVI, WMV and MPEG4 file format, with “_ir” in the file name of the file for IR image

RAW video file saved can be opened with DevWareX to play both RGB and IR image streaming in the same video as below.

DevSuite > RGB-IR Still Capture and Video Recording > att_3_for_2390491137.png

There is C++ example code, “RecordRGBIR”. This example creates a video file from an RGB-IR sensor.
The video will have RGB images and IR images alternating.
This is an example of how to use the ApBase and RgbIR4x4Pipe libraries. The RgbIR4x4Pipe integrates with ApBase to do IR processing on images sent through the software color pipe.

The code is located at samples\RecordRGBIR.