gstreamer | GStreamer open-source multimedia framework | Plugin library

I'm not sure what causes the errors you're getting, but I can suggest a workaround, and maybe a better way of doing this.

You could build two shared libraries: one that contains your C++ code you need to test, and a Pybind11 extension that dynamically links to the first one and only provides the binding definitions.

Then you could link with the first one for the tests, without Python getting in the way.

I've managed to solve it by using a premade find script I found online.

https://chromium.googlesource.com/external/Webkit/+/master/Source/cmake/FindGStreamer.cmake

It creates all necessary defines which I then include and link.

These are the defaults as specified in the FindGStreamer.cmake file

The solution for this problem is to uninstall kivy and reinstall the cutting-edge version from master:

Gstreamer is centered around pipelines that are lists of elements. Elements have pads to exchange data on. In your example, decodebin has an output pad and audioconvert has an input pad. At the start of the pipeline, the pads need to be linked.

This is when pads agree on the format of data, as well as some other information, such as who's in charge of timing and maybe some more format specifics.

Your problem arises from the fact that decodebin is not actually a real element. At runtime, when filesrc starts up, it tells decodebin what pad it has, and decodebin internally creates elements to handle that file.

For example: filesrc location=test.mp4 ! decodebin would run in this order:

• delay linking because types are unknown
• start filesrc
• filesrc says "trying to link, I have a pad of format MP4(h264)
• decodebin sees this request, and in turn, creates on the fly a h264 parse element that can handle the mp4 file
• decodebin now has enough information to describe it's pads, and it links the rest of the pipeline
• video starts playing

Because you are using c to do this, you link the pipeline before filesrc loads the file. This means that decodebin doesn't know the format of it's pads at startup, and therefore fails to link.

To fix this, you have two options:

1.) Swap out decodebin for something that supports only one type. If you know your videos will always be mp4s with h264, for example, you can use h264parse instead of decodebin. Because h264parse only works with one type of format, it knows it's pad formats at the start, and will be able to link without issue.

2.) Reimplement the smart delaying linking. You can read the docs for more info, but you can delay linking of the pipeline, and install callbacks to complete the linking when there's enough information. This is what gst-launch-1.0 is doing under the hood. This has the benefit of being more flexible: anything support by decodebin will work. The downside is that it's much more complex, involves a nontrivial amount of work on your end, and is more fragile. If you can get away with it, try fix 1

Finally I resolved issue by upgrading gstreamer plugin in GTK and use configure event Use d3d11videosink for video streaming which allow "gst_video_overlay_set_render_rectangle" api in the latest release(1.20.0). d3dvideosink has transparency issue so do not use that. Add a configure event for video window(Gtk::DrawingArea). video_window->signal_configure_event().connect(sigc::mem_fun(this, &example::example_function),false); In configure event do the following

Just minor changes were needed. I had to send a vector of SendValue to gst::Array::from_owned

Try adding the arguments '-bsf:v', 'dump_extra'.

According to FFmpeg Bitstream Filters Documentation:

dump_extra
Add extradata to the beginning of the filtered packets except when said packets already exactly begin with the extradata that is intended to be added.

The filter supposed to add SPS and PPS NAL units with every key frame.

Here is a complete code sample:

I fixed that by avenc_aac instead of fdkaacenc. Not to mention that you should use audioconvert before avenc_aac.

The part of command I was trying to convert to aac:

rtpopusdepay ! opusdec ! audioconvert ! avenc_aac.

More: avenc_aac is part of gstreamer ffmpeg plugins which exists in linux, mac and windows. fdkaacenc is part of gstreamer bad plugins that may not be the same in all systems. That's is why using avenc_aac is more approperiate. So it can be executed in both mac and linux.

After reading the document about kivy https://kivy.org/doc/stable-1.10.1/installation/installation-windows.html

Kivy can be installed with one of the following python versions:

• Python 2.7, 32-bit
• Python 3.4, 32-bit
• Python 3.5, 32-bit
• Python 3.6, 32-bit
• Python 2.7, 64-bit
• Python 3.4, 64-bit
• Python 3.5, 64-bit
• Python 3.6, 64-bit