STM32 for live streaming

[Ricko]

Hi,

we would like to add live video playing/streaming to an STM32-based board we are designing that uses MIPI-DSI to drive a touch display, and we are at the stage of choosing the micro.

Ideally it would stream from HDMI signal but we can use another interface if more suitable and/or lower cost.

(Ethernet streaming I think is just a matter of having the Ethernet connection so that I assume is straight forward).

The live video would be played on the touch display but in a window slightly smaller than the graphic area (to allow controls for other electronics to be places on the graphical area next to the video).

Are there any STM32 that have perhaps some special dedicated hardware to allow video streaming (again from HDMI or other similar inputs) while preventing major core bottleneck/slow-down?

If so, which micro can do that?

Or which peripherals/HW of the STM32 is used to do that so we can select the right micro?

Thank you. :)

[Tesla DeLorean]

Probably the wrong platform, lacking capture and codec's, etc.

Video ingress, typically via DCMI camera interface, perhaps compressed at camera.

Some parts support JPEG ENC/DEC, so perhaps MJPEG type streams. Look at OpenMV CAM boards?

https://www.st.com/en/partner-products-and-services/openmv-cam.html

 

Perhaps look at more dedicated hardware, with deeper memories, higher bandwidth, and codec support. Video is a mire of patents and licensing. Resolution and frame-rates, scale bandwidth unhelpfully/quickly.

[Ricko]

@Tesla DeLoreanthank you.

You might run into performance limits trying to process live HDMI on an STM32, since there’s no dedicated video pipeline in most variants.

A more practical setup is using network-based streaming (RTSP/HTTP) and offloading decoding where possible kind of like how streaming apps listed on Xuper APK and MagisAPK handle playback efficiently. It usually results in a much smoother and scalable solution.