MixedReality-WebRTC | help mixed reality app developers integrate audio and video | Augmented Reality library
kandi X-RAY | MixedReality-WebRTC Summary
kandi X-RAY | MixedReality-WebRTC Summary
MixedReality-WebRTC is a collection of libraries to help mixed reality app developers to integrate peer-to-peer real-time audio and video communication into their application and improve their collaborative experience. MixedReality-WebRTC is part of the collection of repositories developed and maintained by the Mixed Reality Sharing team.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of MixedReality-WebRTC
MixedReality-WebRTC Key Features
MixedReality-WebRTC Examples and Code Snippets
Community Discussions
Trending Discussions on MixedReality-WebRTC
QUESTION
Setup
Hey,
I'm trying to capture my screen and send/communicate the stream via MR-WebRTC. Communication between two PCs or PC with HoloLens worked with webcams for me, so I thought the next step could be streaming my screen. So I took the uwp application that I already had, which worked with my webcam and tried to make things work:
- UWP App is based on the example uwp app from MR-WebRTC.
- For Capturing I'm using the instruction from MS about screen capturing via GraphicsCapturePicker.
So now I'm stuck in the following situation:
- I get a frame from the screen capturing, but its type is Direct3D11CaptureFrame. You can see it below in the code snipped.
- MR-WebRTC takes a frame type
I420AVideoFrame
(also in a code snipped).
How can I "connect" them?
I420AVideoFrame
wants a frame in the I420A format (YUV 4:2:0).- Configuring the framePool I can set the DirectXPixelFormat, but it has no YUV420.
- I found this post on so, saying that it its possible.
Code Snipped Frame from Direct3D:
...ANSWER
Answered 2021-Apr-01 at 07:36I found a solution for my problem by creating an issue on the github repo. Answer was provided by KarthikRichie:
- You have to use the
ExternalVideoTrackSource
- You can convert from the
Direct3D11CaptureFrame
toArgb32VideoFrame
QUESTION
I'm making a UWP app using MixedReality-WebRTC.
Is there a way to get the current screen real-time, not a webcam?
...ANSWER
Answered 2020-Dec-21 at 11:54Is there a way to get the current screen real-time
Sure, you could use GraphicsCapturePicker
to pick window that you want to capture, and use screen capture api the get real time frame with FrameArrived
event.
QUESTION
I'm using the Microsoft.MixedReality.WebRTC
library and I am planing on using it for my next project - a Real-Time video chatting app.
I have been able to establish a connection and pass video frames around.
How would I properly render those Frames and display them as Video?
Using WPF's MediaElement
seems pretty easy, but I can only input an Uri
object as source, I cannot feed it single frames, AFAIK.
I have read that drawing Bitmaps is a possible solution, but I am sure this would mean many hours reinventing the wheel and testing, which I am not a fan of doing, unless there is no other way.
The library works as follows:
Each time a new frame is received by the client the Argb32VideoFrameReady
event is raised. A Argb32VideoFrame
struct object is then passed to the callback, which contains an IntPtr
to the raw data. Height
, Width
and Stride
are also provided.
More Information on the specific struct here
What would be some ways I could achieve this?
I am planning on using WPF. The solution should target Windows 7+ and .Net Framework 4.6.2.
Thanks in advance.
...ANSWER
Answered 2020-Jul-30 at 12:46With an Image element in XAML
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install MixedReality-WebRTC
The release/2.0 branch contains the latest stable version of the API, from which the NuGet and UPM packages are published. The master branch contains the current up-to-date code with latest developments. Care is generally taken to keep this branch in a fairly clean state (branch can build, tests pass). However the master branch contains API breaking changes compared to the latest release, and therefore is not compatible with NuGet/UPM packages and should be built from sources instead (see Building from sources documentation).
MixedReality-WebRTC is a set of individual building blocks in the form of C and C# libraries building upon each other to deliver a consistent API to C/C++ and C# developers across its supported platforms, and a set of handful drop-in Unity3D components for easy integration. The pure C library allows easy integration as a shared module (DLL) into C/C++ projects while avoiding issues with compiler and CRT variants.
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page