how to use gst_video_overlay_set_window_handle in macOs? - gstreamer

I need to use gst_video_overlay_set_window_handle in macOs(Big Sur 11.6)
but the video not played at all. if I comment the gst_video_overlay_set_window_handle out, the video window can popped out.but I need to play the camera on UI's window, so anyone knows which kind of sink can be used for this case? I tried "autovideosink" and "osxvideosink" but seems none of them works.
Thank you!

Related

Recording desktop using Qt multimedia

I'm trying to record microphones, cameras and monitors using Qt's multimedia module. But I couldn't find anything about screen recording in documentation. So it seemed I'd to do it by myself.
I've searched about that, found that answer:
How to display desktop in windows form using Qt?
Seems I've to use FFMPEG to merge these taken screenshots into mp4 file, also it doesn't seem an efficient way. I want to show real time recording output with QVideoWidget. I was going to use QMediaCaptureSession, QMediaRecorder. But they only work with camera. Is there any way to record desktop screen with Qt's multimedia module?
P.S: Please correct me, if my question is wrong

GStreamer add video overlay when recording screen to filesink

Hello i am recording screen to video file with GStreamer ximagesrc element using QT.
I want to draw circles on mouse clicks locations.
Can someone give a hint how to achieve this, looking at GstVideoOverlay I understand that it is used only on playing video in some window and draw in that window not directly in video stream that could be saved to file. Guessing that GstVideoOverlayRectangle can help here, but i`m not sure...
Thanks :)
I would recommend to look at cairooverlay:
https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-good/html/gst-plugins-good-plugins-cairooverlay.html

Qt video playback with libmpv makes QtWebEngine jquery content unsmooth - Ubuntu

I have a project that uses libmpv with the opengl widget (as per the examples that come with libmpv) along with a QtWebEngine widget that displays information, graphics and animations (a scrolling ticker for example).
I found that of the video playback options in Qt, mpv was the smoothest and most reliable. It will play back perfectly smoothly any video up to 1080p.
However while video is playing, any animations in QtWebEngine are unsmooth and jittery. Video is also slightly less smooth when something is moving in the webpage.
The system I'm testing with is not struggling for resources (cpu use is around 45%). There is also not any video decoding, as it's playing back raw video (but while it plays back encoded video, the effect is the same, regardless if hardware acceleration is enabled or not).
I figure that the mpv widget is interrupting the MainWindow thread while it processes frames and causing it to freeze every few milliseconds.
As far as I know there is no way to separate the mpv thread from the MainWindow thread though.
I don't know if it'll be possible to make mpv and webengine work together smoothly. I feel like there must be some way to run two widgets at once in one window and not have them mess with each other.
I'm testing with Ubuntu 18.04, QT 5.11 and the latest mpv from git.
Does anyone have any advice or pointers for what to try first? I realise this is somewhat of a broad question but my knowledge of graphics is limited. If anyone has advice on a conceptual level (I don't need someone to code me a fix) I can investigate myself.
Thank you.

Qt 5, QCamera, video streaming by network

Can you guys help me, what the best way for streaming video and sound from webcam over network? I have a problem, because i'm need to use Qt for that. Now i'm using QCamera and QVideoWidget just for show videostream to screen, but i need to send this stream to server, which will show this stream to QVideoWidget too. May be need to use QMediaRecorder for that, but i'm not see some methods, where i can get audio/video raw-data frame, or may be other, anyway, how do you see for this, what the best way for streaming. Thanks a lot!

QT Phonon Audio jumping bars

Im only here to ask one question. Well im working in an application, but I would like to create that jumping bars, that jumps with the music. I dont know if you understand me, here is an image of what i want to do:
I dont know how to create that bars, so I dont know if you can help me.
Thank you very much.
With Phonon, how can I handle the frequencies?