NALU

I struggle with adding my custom jar to gwt compiler.

I've check tons of internet and can not find answer. I found solution to add module.gwt.xml file to this custom jar library and import it in my gwt app app.gwt.xml as follow: But this will make my custom java library gwt aware and this is anti pattern for me. As I will spoil backend common library with gwt (which is just UI detail).

I would like to follow approach with entry but I can configure it only for local java classes. I do not know how to do this for external jar.

Please help

Here are steps I've done already:

I've added source plugin to pom.xml of my custom jar as follow:

Here is my code. Basically I am trying to stream android screen to vlc media player using rtsp somehow I have managed to stream video perfectly but audio is not playing. I am using AMRNB encoding method to send stream on Local Socket. I can see that there is audio track by using log also it is being send but don't know why it is not getting played.

I have a mp4 muxer that works fine when the H264 NALU has the 4-byte start code (0x00000001). I am adapting it to support 3-byte start code (0x000001) but I am stuck with a bug that I am not able to identify. The MP4 generated open in VLC and MediaPlayer but no video is displayed. In VLC statistics shows that it is decoding blocks but stays with 0 frames displayed.

I then ran a error analyzer using ffmpeg (ffmpeg -v error -i myvideo.mp4 -f null - 2>error.log that shows me the following output:

my goal is to encode the main framebuffer of my Windows machine using nvenc and stream its content to my iPad using the VideoToolbox API

The code I use to encode the h264 stream is basically a copy/paste of https://github.com/NVIDIA/video-sdk-samples/tree/master/nvEncDXGIOutputDuplicationSample the only change is that instead of writing to a file, I do send the data

For the decoding I do use https://github.com/zerdzhong/SwfitH264Demo/blob/master/SwiftH264/ViewController.swift#L71

The encoding work perfectly when I write all the contents to a file, I am able to use a h264->mp4 online converter without issue, the problem is that the decoder gives me the error kVTVideoDecoderBadDataErr in the function decompressionSessionDecodeFrameCallback

So for what I tried:

• Firsly using an h264 analyzer I found that the frame order are: 7/8/5/5/5/5/1...
• I found that nvenc does encode the frames 7/8/5/5/5/5 in only one packet
• I did try to separate this packet into multiple ones using the sequence (0x00 0x00 0x00 0x01), it gave me the frames 7/8/5 separately
• As you can see I only got one 5 frame which is around 100KB, the H264 analyzer said that there are four 5 frames (which are something like 40KB, 20KB, 30KB, 10KB)
• Using a hex file viewer I saw that the sequence separating those 5 frames were (0x00 0x00 0x01) instead, tried to also separate them but I got the exact same VideoToolbox error while decompressing

here is the code I use to separate and send the frames: The protocol is simply PACKET_SIZE->PACKET_DATA The swift code is able to read the NALU types so I am confident that this is not the issue

I'm attempting to extract raw image data for each I-frame from an MPEG-2 Transport Stream with a H.264 annex B codec. This video contains I-frames on every 2 second interval. I've read that an I-frame can be found in after an NALu start code with a type of 5 (e.g. Coded slice of an IDR picture). The byte payload of these NALu's contains all the necessary data to construct a full frame. Albeit to, my understanding, in a H.264 encoded format.

I would like to build a solution to extract these I-frame from an incoming byte stream, by finding NALu's that contain I-frames, saving the payload and decoding the payload into some ubiquitous raw image format to access pixel data etc.

Note: I would like to avoid using filesystem dependency binaries like ffmpeg if possible and more importantly if feasible!

So far I have build an PoC in rust to find the byte offset, and byte size of I-frames:

there are a h264 rtp stream passing through server, I catch every rtp packets and extract every nalu by getting rid of rtp header, and then write every nalu to file record.h264 with adding a h264 prefix start code 0x00000001, but file record.h264 cannot be played by ffplay and cannot be parsed by ffprobe, where is wrong?

here is my record file:https://github.com/sshsu/record_h264_file

Suppose I am receiving packets containing H264 encoded NAL Units, and each NAL has correct START_CODE (0x00 00 00 01).

But in some NALUs, the later Bytes of the NAL may have been corrupted. Is there any standard way to validate whether the information represented by a NALU is correct or not?

And if it can be validated, is there any standard way to correct it according to the H264 standards ?

Further Clarification:

The problem to specify is somewhat like this ->

Server sends a x264 NALU like 0x 00000001abcdefgh and, when I receive the packet, it contains : 0x 00000001abcmnopdefgh.

This leads to failure of decompression , hence I was looking for a way to eliminate these bad data bytes.