Skip to main content
Associate
November 18, 2024
Solved

VD56G3 optical flow

  • November 18, 2024
  • 2 replies
  • 1703 views

Hi 
we are looking for optical flow sensor and try to configure VD56G3 camera for this purpose which is connected to rasberry pi 4.
I came across research artice which states that it does support optical flow using  MIPI CSI-2 interface.

https://arxiv.org/pdf/2305.13087

ketchyn_0-1731960372161.png

However just looking at the user manual its not so clear how I can configure camera to output optical flow or displacement of  consecutive frames.
Are there any additional materials I can look at or maybe software tools, SDKs that will give any examples of how to do it?

Best answer by CyrilTechPro

Hi ketchyn,

 

This something we want to enable in 2025 but today the feature is not fully functional in the device.

Regards 

Cyril 

2 replies

ST Employee
November 20, 2024

Hi Ketchyn,

 

The optical Flow feature is currently not supported on our sensor we are working to make it available.

 

Regards, 

 

 

ketchynAuthor
Associate
November 26, 2024

Thanks @CyrilTechPro  for your response 
I see in documentation that there is a possibility to add max BRIEF descriptios that are used in feature tracking and is a part of optical flow calculations. Is it something that will be enabled in future? 
Are there any suggestions for camera configuration if we write optical flow algorithm on our end?

ketchyn_0-1732657707786.png

Regards, 
Olex

CyrilTechProBest answer
ST Employee
December 16, 2024

Hi ketchyn,

 

This something we want to enable in 2025 but today the feature is not fully functional in the device.

Regards 

Cyril 

Visitor II
September 3, 2025

Is there any progress on this topic and when the feature will be available 

Regards

PanterSoft