What is the correct way to stream custom packets using ffmpeg?












0














I want to encode frames from camera using NvPipe and stream them via RTP using FFmpeg. My code produces the following error when I want to decode the stream:



[h264 @ 0x7f3c6c007e80] decode_slice_header error

[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced

[h264 @ 0x7f3c6c007e80] decode_slice_header error

[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced

[h264 @ 0x7f3c6c007e80] decode_slice_header error

[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced

[h264 @ 0x7f3c6c007e80] decode_slice_header error

[h264 @ 0x7f3c6c007e80] no frame!

[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced    0B f=0/0   

    Last message repeated 1 times


On another PC, it is even not able to stream, and fails with an segmentation fault on av_interleaved_write_frame(..). How to initialize the AVPacket and its timebase correctly to successfully send and receive the stream using ffplay/VLC/ other software?



My code:



avformat_network_init();

// init encoder

AVPacket *pkt = new AVPacket();

int targetBitrate = 1000000;

int targetFPS = 30;

const uint32_t width = 640;

const uint32_t height = 480;



NvPipe* encoder = NvPipe_CreateEncoder(NVPIPE_BGRA32, NVPIPE_H264, NVPIPE_LOSSY, targetBitrate, targetFPS);



// init stream output

std::string str = "rtp://127.0.0.1:49990";

AVStream* stream = nullptr;

AVOutputFormat *output_format = av_guess_format("rtp", nullptr, nullptr);;

AVFormatContext *output_format_ctx = avformat_alloc_context();



avformat_alloc_output_context2(&output_format_ctx, output_format,   output_format->name, str.c_str());



// open output url

if (!(output_format->flags & AVFMT_NOFILE)){

     ret = avio_open(&output_format_ctx->pb, str.c_str(), AVIO_FLAG_WRITE);

}



output_format_ctx->oformat = output_format;

output_format->video_codec = AV_CODEC_ID_H264;



stream  = avformat_new_stream(output_format_ctx,nullptr);

stream->id = 0;

stream->codecpar->codec_id = AV_CODEC_ID_H264;

stream->codecpar->codec_type = AVMEDIA_TYPE_VIDEO;

stream->codecpar->width = width;

stream->codecpar->height = height;

stream->time_base.den = 1;

stream->time_base.num = targetFPS; // 30fps



/* Write the header */

avformat_write_header(output_format_ctx, nullptr); // this seems to destroy the timebase of the stream



std::vector<uint8_t> rgba(width * height * 4);

std::vector<uint8_t> compressed(rgba.size());

int frameCnt = 0;



// encoding and streaming

while (true) 

{

frameCnt++;

// Encoding

// Construct dummy frame

for (uint32_t y = 0; y < height; ++y)

    for (uint32_t x = 0; x < width; ++x)

        rgba[4 * (y * width + x) + 1] = (255.0f * x* y) / (width * height) * (y % 100 < 50);



uint64_t size = NvPipe_Encode(encoder, rgba.data(), width * 4, compressed.data(), compressed.size(), width, height, false); // last parameter needs to be true for keyframes



av_init_packet(pkt);

pkt->data = compressed.data();

pkt->size = size;

pkt->pts = frameCnt;



if(!memcmp(compressed.data(), "x00x00x00x01x67", 5)) {

    pkt->flags |= AV_PKT_FLAG_KEY;

}



//stream



fflush(stdout);



// Write the compressed frame into the output

pkt->pts = av_rescale_q(frameCnt, AVRational {1, targetFPS}, stream->time_base);

pkt->dts = pkt->pts;

pkt->stream_index = stream->index;



/* Write the data on the packet to the output format  */

av_interleaved_write_frame(output_format_ctx, pkt);



/* Reset the packet */

av_packet_unref(pkt); 

}


The .sdp file to open the stream with ffplay looks like this:



v=0

o=- 0 0 IN IP4 127.0.0.1

s=No Name

c=IN IP4 127.0.0.1

t=0 0

a=tool:libavformat 58.18.101

m=video 49990 RTP/AVP 96

a=rtpmap:96 H264/90000

a=fmtp:96 packetization-mode=1





c++ ffmpeg







share|improve this question





























    0














    I want to encode frames from camera using NvPipe and stream them via RTP using FFmpeg. My code produces the following error when I want to decode the stream:



    [h264 @ 0x7f3c6c007e80] decode_slice_header error
    
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced
    
[h264 @ 0x7f3c6c007e80] decode_slice_header error
    
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced
    
[h264 @ 0x7f3c6c007e80] decode_slice_header error
    
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced
    
[h264 @ 0x7f3c6c007e80] decode_slice_header error
    
[h264 @ 0x7f3c6c007e80] no frame!
    
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced    0B f=0/0   
    
    Last message repeated 1 times


    On another PC, it is even not able to stream, and fails with an segmentation fault on av_interleaved_write_frame(..). How to initialize the AVPacket and its timebase correctly to successfully send and receive the stream using ffplay/VLC/ other software?



    My code:



    avformat_network_init();
    
// init encoder
    
AVPacket *pkt = new AVPacket();
    
int targetBitrate = 1000000;
    
int targetFPS = 30;
    
const uint32_t width = 640;
    
const uint32_t height = 480;
    

    
NvPipe* encoder = NvPipe_CreateEncoder(NVPIPE_BGRA32, NVPIPE_H264, NVPIPE_LOSSY, targetBitrate, targetFPS);
    

    
// init stream output
    
std::string str = "rtp://127.0.0.1:49990";
    
AVStream* stream = nullptr;
    
AVOutputFormat *output_format = av_guess_format("rtp", nullptr, nullptr);;
    
AVFormatContext *output_format_ctx = avformat_alloc_context();
    

    
avformat_alloc_output_context2(&output_format_ctx, output_format,   output_format->name, str.c_str());
    

    
// open output url
    
if (!(output_format->flags & AVFMT_NOFILE)){
    
     ret = avio_open(&output_format_ctx->pb, str.c_str(), AVIO_FLAG_WRITE);
    
}
    

    
output_format_ctx->oformat = output_format;
    
output_format->video_codec = AV_CODEC_ID_H264;
    

    
stream  = avformat_new_stream(output_format_ctx,nullptr);
    
stream->id = 0;
    
stream->codecpar->codec_id = AV_CODEC_ID_H264;
    
stream->codecpar->codec_type = AVMEDIA_TYPE_VIDEO;
    
stream->codecpar->width = width;
    
stream->codecpar->height = height;
    
stream->time_base.den = 1;
    
stream->time_base.num = targetFPS; // 30fps
    

    
/* Write the header */
    
avformat_write_header(output_format_ctx, nullptr); // this seems to destroy the timebase of the stream
    

    
std::vector<uint8_t> rgba(width * height * 4);
    
std::vector<uint8_t> compressed(rgba.size());
    
int frameCnt = 0;
    

    
// encoding and streaming
    
while (true) 
    
{
    
frameCnt++;
    
// Encoding
    
// Construct dummy frame
    
for (uint32_t y = 0; y < height; ++y)
    
    for (uint32_t x = 0; x < width; ++x)
    
        rgba[4 * (y * width + x) + 1] = (255.0f * x* y) / (width * height) * (y % 100 < 50);
    

    
uint64_t size = NvPipe_Encode(encoder, rgba.data(), width * 4, compressed.data(), compressed.size(), width, height, false); // last parameter needs to be true for keyframes
    

    
av_init_packet(pkt);
    
pkt->data = compressed.data();
    
pkt->size = size;
    
pkt->pts = frameCnt;
    

    
if(!memcmp(compressed.data(), "x00x00x00x01x67", 5)) {
    
    pkt->flags |= AV_PKT_FLAG_KEY;
    
}
    

    
//stream
    

    
fflush(stdout);
    

    
// Write the compressed frame into the output
    
pkt->pts = av_rescale_q(frameCnt, AVRational {1, targetFPS}, stream->time_base);
    
pkt->dts = pkt->pts;
    
pkt->stream_index = stream->index;
    

    
/* Write the data on the packet to the output format  */
    
av_interleaved_write_frame(output_format_ctx, pkt);
    

    
/* Reset the packet */
    
av_packet_unref(pkt); 
    
}


    The .sdp file to open the stream with ffplay looks like this:



    v=0
    
o=- 0 0 IN IP4 127.0.0.1
    
s=No Name
    
c=IN IP4 127.0.0.1
    
t=0 0
    
a=tool:libavformat 58.18.101
    
m=video 49990 RTP/AVP 96
    
a=rtpmap:96 H264/90000
    
a=fmtp:96 packetization-mode=1





    c++ ffmpeg







    share|improve this question



























      0












      0








      0







      I want to encode frames from camera using NvPipe and stream them via RTP using FFmpeg. My code produces the following error when I want to decode the stream:



      [h264 @ 0x7f3c6c007e80] decode_slice_header error
      
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced
      
[h264 @ 0x7f3c6c007e80] decode_slice_header error
      
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced
      
[h264 @ 0x7f3c6c007e80] decode_slice_header error
      
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced
      
[h264 @ 0x7f3c6c007e80] decode_slice_header error
      
[h264 @ 0x7f3c6c007e80] no frame!
      
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced    0B f=0/0   
      
    Last message repeated 1 times


      On another PC, it is even not able to stream, and fails with an segmentation fault on av_interleaved_write_frame(..). How to initialize the AVPacket and its timebase correctly to successfully send and receive the stream using ffplay/VLC/ other software?



      My code:



      avformat_network_init();
      
// init encoder
      
AVPacket *pkt = new AVPacket();
      
int targetBitrate = 1000000;
      
int targetFPS = 30;
      
const uint32_t width = 640;
      
const uint32_t height = 480;
      

      
NvPipe* encoder = NvPipe_CreateEncoder(NVPIPE_BGRA32, NVPIPE_H264, NVPIPE_LOSSY, targetBitrate, targetFPS);
      

      
// init stream output
      
std::string str = "rtp://127.0.0.1:49990";
      
AVStream* stream = nullptr;
      
AVOutputFormat *output_format = av_guess_format("rtp", nullptr, nullptr);;
      
AVFormatContext *output_format_ctx = avformat_alloc_context();
      

      
avformat_alloc_output_context2(&output_format_ctx, output_format,   output_format->name, str.c_str());
      

      
// open output url
      
if (!(output_format->flags & AVFMT_NOFILE)){
      
     ret = avio_open(&output_format_ctx->pb, str.c_str(), AVIO_FLAG_WRITE);
      
}
      

      
output_format_ctx->oformat = output_format;
      
output_format->video_codec = AV_CODEC_ID_H264;
      

      
stream  = avformat_new_stream(output_format_ctx,nullptr);
      
stream->id = 0;
      
stream->codecpar->codec_id = AV_CODEC_ID_H264;
      
stream->codecpar->codec_type = AVMEDIA_TYPE_VIDEO;
      
stream->codecpar->width = width;
      
stream->codecpar->height = height;
      
stream->time_base.den = 1;
      
stream->time_base.num = targetFPS; // 30fps
      

      
/* Write the header */
      
avformat_write_header(output_format_ctx, nullptr); // this seems to destroy the timebase of the stream
      

      
std::vector<uint8_t> rgba(width * height * 4);
      
std::vector<uint8_t> compressed(rgba.size());
      
int frameCnt = 0;
      

      
// encoding and streaming
      
while (true) 
      
{
      
frameCnt++;
      
// Encoding
      
// Construct dummy frame
      
for (uint32_t y = 0; y < height; ++y)
      
    for (uint32_t x = 0; x < width; ++x)
      
        rgba[4 * (y * width + x) + 1] = (255.0f * x* y) / (width * height) * (y % 100 < 50);
      

      
uint64_t size = NvPipe_Encode(encoder, rgba.data(), width * 4, compressed.data(), compressed.size(), width, height, false); // last parameter needs to be true for keyframes
      

      
av_init_packet(pkt);
      
pkt->data = compressed.data();
      
pkt->size = size;
      
pkt->pts = frameCnt;
      

      
if(!memcmp(compressed.data(), "x00x00x00x01x67", 5)) {
      
    pkt->flags |= AV_PKT_FLAG_KEY;
      
}
      

      
//stream
      

      
fflush(stdout);
      

      
// Write the compressed frame into the output
      
pkt->pts = av_rescale_q(frameCnt, AVRational {1, targetFPS}, stream->time_base);
      
pkt->dts = pkt->pts;
      
pkt->stream_index = stream->index;
      

      
/* Write the data on the packet to the output format  */
      
av_interleaved_write_frame(output_format_ctx, pkt);
      

      
/* Reset the packet */
      
av_packet_unref(pkt); 
      
}


      The .sdp file to open the stream with ffplay looks like this:



      v=0
      
o=- 0 0 IN IP4 127.0.0.1
      
s=No Name
      
c=IN IP4 127.0.0.1
      
t=0 0
      
a=tool:libavformat 58.18.101
      
m=video 49990 RTP/AVP 96
      
a=rtpmap:96 H264/90000
      
a=fmtp:96 packetization-mode=1





      c++ ffmpeg







      share|improve this question















      I want to encode frames from camera using NvPipe and stream them via RTP using FFmpeg. My code produces the following error when I want to decode the stream:



      [h264 @ 0x7f3c6c007e80] decode_slice_header error
      
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced
      
[h264 @ 0x7f3c6c007e80] decode_slice_header error
      
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced
      
[h264 @ 0x7f3c6c007e80] decode_slice_header error
      
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced
      
[h264 @ 0x7f3c6c007e80] decode_slice_header error
      
[h264 @ 0x7f3c6c007e80] no frame!
      
[h264 @ 0x7f3c6c007e80] non-existing PPS 0 referenced    0B f=0/0   
      
    Last message repeated 1 times


      On another PC, it is even not able to stream, and fails with an segmentation fault on av_interleaved_write_frame(..). How to initialize the AVPacket and its timebase correctly to successfully send and receive the stream using ffplay/VLC/ other software?



      My code:



      avformat_network_init();
      
// init encoder
      
AVPacket *pkt = new AVPacket();
      
int targetBitrate = 1000000;
      
int targetFPS = 30;
      
const uint32_t width = 640;
      
const uint32_t height = 480;
      

      
NvPipe* encoder = NvPipe_CreateEncoder(NVPIPE_BGRA32, NVPIPE_H264, NVPIPE_LOSSY, targetBitrate, targetFPS);
      

      
// init stream output
      
std::string str = "rtp://127.0.0.1:49990";
      
AVStream* stream = nullptr;
      
AVOutputFormat *output_format = av_guess_format("rtp", nullptr, nullptr);;
      
AVFormatContext *output_format_ctx = avformat_alloc_context();
      

      
avformat_alloc_output_context2(&output_format_ctx, output_format,   output_format->name, str.c_str());
      

      
// open output url
      
if (!(output_format->flags & AVFMT_NOFILE)){
      
     ret = avio_open(&output_format_ctx->pb, str.c_str(), AVIO_FLAG_WRITE);
      
}
      

      
output_format_ctx->oformat = output_format;
      
output_format->video_codec = AV_CODEC_ID_H264;
      

      
stream  = avformat_new_stream(output_format_ctx,nullptr);
      
stream->id = 0;
      
stream->codecpar->codec_id = AV_CODEC_ID_H264;
      
stream->codecpar->codec_type = AVMEDIA_TYPE_VIDEO;
      
stream->codecpar->width = width;
      
stream->codecpar->height = height;
      
stream->time_base.den = 1;
      
stream->time_base.num = targetFPS; // 30fps
      

      
/* Write the header */
      
avformat_write_header(output_format_ctx, nullptr); // this seems to destroy the timebase of the stream
      

      
std::vector<uint8_t> rgba(width * height * 4);
      
std::vector<uint8_t> compressed(rgba.size());
      
int frameCnt = 0;
      

      
// encoding and streaming
      
while (true) 
      
{
      
frameCnt++;
      
// Encoding
      
// Construct dummy frame
      
for (uint32_t y = 0; y < height; ++y)
      
    for (uint32_t x = 0; x < width; ++x)
      
        rgba[4 * (y * width + x) + 1] = (255.0f * x* y) / (width * height) * (y % 100 < 50);
      

      
uint64_t size = NvPipe_Encode(encoder, rgba.data(), width * 4, compressed.data(), compressed.size(), width, height, false); // last parameter needs to be true for keyframes
      

      
av_init_packet(pkt);
      
pkt->data = compressed.data();
      
pkt->size = size;
      
pkt->pts = frameCnt;
      

      
if(!memcmp(compressed.data(), "x00x00x00x01x67", 5)) {
      
    pkt->flags |= AV_PKT_FLAG_KEY;
      
}
      

      
//stream
      

      
fflush(stdout);
      

      
// Write the compressed frame into the output
      
pkt->pts = av_rescale_q(frameCnt, AVRational {1, targetFPS}, stream->time_base);
      
pkt->dts = pkt->pts;
      
pkt->stream_index = stream->index;
      

      
/* Write the data on the packet to the output format  */
      
av_interleaved_write_frame(output_format_ctx, pkt);
      

      
/* Reset the packet */
      
av_packet_unref(pkt); 
      
}


      The .sdp file to open the stream with ffplay looks like this:



      v=0
      
o=- 0 0 IN IP4 127.0.0.1
      
s=No Name
      
c=IN IP4 127.0.0.1
      
t=0 0
      
a=tool:libavformat 58.18.101
      
m=video 49990 RTP/AVP 96
      
a=rtpmap:96 H264/90000
      
a=fmtp:96 packetization-mode=1





      c++ ffmpeg




      c++ ffmpeg






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Nov 19 '18 at 13:30

























      asked Nov 19 '18 at 12:51









      Lucker10

      13910




      13910





























          active

          oldest

          votes











          Your Answer






          StackExchange.ifUsing("editor", function () {
          StackExchange.using("externalEditor", function () {
          StackExchange.using("snippets", function () {
          StackExchange.snippets.init();
          });
          });
          }, "code-snippets");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "1"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53375051%2fwhat-is-the-correct-way-to-stream-custom-packets-using-ffmpeg%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown






























          active

          oldest

          votes













          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes
















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid …



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.





          Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


          Please pay close attention to the following guidance:


          • Please be sure to answer the question. Provide details and share your research!

          But avoid …



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53375051%2fwhat-is-the-correct-way-to-stream-custom-packets-using-ffmpeg%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          MongoDB - Not Authorized To Execute Command

          Image
          .everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box; } 0 I have successfully enabled authorization on MongoDB and I have created an account on the admin database and then I created an account for my database called test. The following connection string to connect to my test database works successfully: mongo --host 192.168.17.52 --port 27017 -u user1 -p password --authenticationDatabase test Only problem I have now is, I cannot execute commands such as: show dbs. I get the following error when I try to do so: "errmsg" : "not authorized on admin to execute command { listDatabases: 1.0, lsid: { id: UUID("a1d5bc0d-bc58-485e-b232-270758a89455") }, $db: "admin...
          Read more

          How to fix TextFormField cause rebuild widget in Flutter

          Image
          .everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box; } 0 I've got the same issue at #9280. I tried all solutions from that topic with/without GlobalKey for Scaffold and Form but the problem wasn't fixed. I tried to build a authentication form with login and signup. But the keyboard doesn't show when I tap the TextFormField at the first time. Then I try to input some letter from physical keyboard, the widget is rebuilt. Like this: login screen Nothing to be log when I run flutter run --verbose, so I logged manually. Every tapping on field, the widget called dispose -> init -> build. [√] Flutter (Channel beta, v1.0.0, on Microsoft Windows [Version 10.0.17763.195], ...
          Read more

          Npm cannot find a required file even through it is in the searched directory

          Image
          up vote 0 down vote favorite I got that error: users-Air:pdfuploader user$ npm run start client@0.1.0 start /Users/user/Documents/pdfuploader react-scripts start Could not find a required file. Name: index.html Searched in: /Users/user/Documents/pdfuploader/public npm ERR! code ELIFECYCLE npm ERR! errno 1 npm ERR! client@0.1.0 start: `react-scripts start` npm ERR! Exit status 1 npm ERR! npm ERR! Failed at the client@0.1.0 start script. npm ERR! This is probably not a problem with npm. There is likely additional logging output above. npm ERR! A complete log of this run can be found in: npm ERR! /Users/user/.npm/_logs/2018-11-19T10_19_14_555Z-debug.log users-Air:pdfuploader user$ And the file is in /Users/user/Documents/pdfuploader/public as you can see in my github repository: https://github.c...
          Read more