y-webrtc | WebRTC Connector for Yjs
kandi X-RAY | y-webrtc Summary
kandi X-RAY | y-webrtc Summary
WebRTC Connector for Yjs
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of y-webrtc
y-webrtc Key Features
y-webrtc Examples and Code Snippets
Community Discussions
Trending Discussions on y-webrtc
QUESTION
I am trying to run the example code of webRTC VAD
found here.
But when I feed it a mono-16bit wave file of just me speaking with very long pauses, it just detects the entire file to be voiced, and the voiced output chunk-00.wav
is the entire audio file.
Any help is greatly appreciated. Below I have given the console output that I receive.
...ANSWER
Answered 2022-Jan-31 at 11:45I think I have found an alternative method of how to get VAD data. Instead of trying to get VAD from the pre-defined method shown in the link above, I create my own function.
The function basically measures the amplitude of the wave and any sharp spike observed above the base noise level (1.6x the base value
) is taken to mean a voiced activity. This function assumes that only 1 human is speaking and that the noise level remains relatively constant.
QUESTION
Since a while I am working with HoloLens2. My last OS-Versions were 10.0.18362.1005 and 10.0.19041.1109. I am developing with Unity 2019.4.7. My whole code was and still is running great on those old OS-Versions. Now I updated to OS-Version 21H1 and I have huge problems with everything including networking.
For example, my Mixed-Reality-WebRTC Pluging (from Microsoft), which only supports ARM-Architecture, does not work anymore on my new Device. The app crashes after it was successfully starting.
Another thing is, that the DevicePortal does not transmit virtual inputs. Again, on my older HoloLens2´s Virtual Input works great.
Also, even if I disable WebRTC parts of my Project, I still get an Exceptions in my Networking-System which I can´t assign to any cause. In term it is useful for you, I work with windows.Networking Library and in special with DatagramSocket.
I would be really glad if anybody could help me with this. Is OS-Version 21H1 restricted to any specific Unity- or VisualStudio Version (here currently I use 16.4.5)? Or is it Restricted to specific Networking Libraries? Thanks in advance!
...ANSWER
Answered 2021-Nov-19 at 14:56Now I was able to fix the Networking Exception. The reason for that is located within my UDP-Communicator which uses DatagramSocket. Since earlier .Net.Sockets was not available at HoloLens2, now it is and I coincidentally came across this information. So I switched my implementation to .Net.Sockets which already exists in my project for editor-usage and now basic networking works fine.
Also, I was able to make WebRTC work again. With one of my Provisioning-Packages I disabled the usage of microphone for mixedReality and it seems like access to those audio-informations is mandatory for MR-WebRTC.
Unfortunately, I still have the same issues with Device Portal.This really looks like a bug.
QUESTION
Setup
Hey,
I'm trying to capture my screen and send/communicate the stream via MR-WebRTC. Communication between two PCs or PC with HoloLens worked with webcams for me, so I thought the next step could be streaming my screen. So I took the uwp application that I already had, which worked with my webcam and tried to make things work:
- UWP App is based on the example uwp app from MR-WebRTC.
- For Capturing I'm using the instruction from MS about screen capturing via GraphicsCapturePicker.
So now I'm stuck in the following situation:
- I get a frame from the screen capturing, but its type is Direct3D11CaptureFrame. You can see it below in the code snipped.
- MR-WebRTC takes a frame type
I420AVideoFrame
(also in a code snipped).
How can I "connect" them?
I420AVideoFrame
wants a frame in the I420A format (YUV 4:2:0).- Configuring the framePool I can set the DirectXPixelFormat, but it has no YUV420.
- I found this post on so, saying that it its possible.
Code Snipped Frame from Direct3D:
...ANSWER
Answered 2021-Apr-01 at 07:36I found a solution for my problem by creating an issue on the github repo. Answer was provided by KarthikRichie:
- You have to use the
ExternalVideoTrackSource
- You can convert from the
Direct3D11CaptureFrame
toArgb32VideoFrame
QUESTION
I'm making a UWP app using MixedReality-WebRTC.
Is there a way to get the current screen real-time, not a webcam?
...ANSWER
Answered 2020-Dec-21 at 11:54Is there a way to get the current screen real-time
Sure, you could use GraphicsCapturePicker
to pick window that you want to capture, and use screen capture api the get real time frame with FrameArrived
event.
QUESTION
I'm using the Microsoft.MixedReality.WebRTC
library and I am planing on using it for my next project - a Real-Time video chatting app.
I have been able to establish a connection and pass video frames around.
How would I properly render those Frames and display them as Video?
Using WPF's MediaElement
seems pretty easy, but I can only input an Uri
object as source, I cannot feed it single frames, AFAIK.
I have read that drawing Bitmaps is a possible solution, but I am sure this would mean many hours reinventing the wheel and testing, which I am not a fan of doing, unless there is no other way.
The library works as follows:
Each time a new frame is received by the client the Argb32VideoFrameReady
event is raised. A Argb32VideoFrame
struct object is then passed to the callback, which contains an IntPtr
to the raw data. Height
, Width
and Stride
are also provided.
More Information on the specific struct here
What would be some ways I could achieve this?
I am planning on using WPF. The solution should target Windows 7+ and .Net Framework 4.6.2.
Thanks in advance.
...ANSWER
Answered 2020-Jul-30 at 12:46With an Image element in XAML
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install y-webrtc
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page