Inheritance diagram for com::avpkit::core::VideoPicture:

[legend]

Collaboration diagram for com::avpkit::core::VideoPicture:

[legend]

Public Member Functions
virtual int64_t	getTimeStamp ()
	Get the time stamp of this object in getTimeBase() units. More...

virtual void	setTimeStamp (int64_t aTimeStamp)
	Set the time stamp for this object in getTimeBase() units. More...

virtual bool	isKey ()
	Is this object a key object? i.e. More...

virtual IRational *	getTimeBase ()
	Get the time base that time stamps of this object are represented in. More...

virtual void	setTimeBase (IRational *aBase)
	Set the time base that time stamps of this object are represented in. More...

virtual bool	isKeyFrame ()
	Is this a key frame? More...

virtual void	setKeyFrame (bool aIsKey)
	Reset if this is a key frame or not. More...

virtual bool	isComplete ()
	Is this picture completely decoded? More...

virtual int	getWidth ()
	What is the width of the picture. More...

virtual int	getHeight ()
	What is the height of the picture. More...

virtual IPixelFormat::Type	getPixelType ()
	Returns the pixel format of the picture. More...

virtual int64_t	getPts ()
	What is the Presentation Time Stamp (in Microseconds) of this picture. More...

virtual void	setPts (int64_t)
	Set the Presentation Time Stamp (in Microseconds) for this picture. More...

virtual int	getQuality ()
	This value is the quality setting this VideoPicture had when it was decoded, or is the value to use when this picture is next encoded (if reset with setQuality() More...

virtual void	setQuality (int newQuality)
	Set the Quality to a new value. More...

virtual int32_t	getSize ()
	Total size in bytes of the decoded picture. More...

virtual com::avpkit::ferry::IBuffer *	getData ()
	Get any underlying raw data available for this object. More...

virtual int	getDataLineSize (int lineNo)
	Return the size of each line in the VideoPicture data. More...

virtual void	setComplete (bool aIsComplete, IPixelFormat::Type format, int width, int height, int64_t pts)
	After modifying the raw data in this buffer, call this function to let the object know it is now complete. More...

virtual bool	copy (IVideoPicture *srcFrame)
	Copy the contents of the given picture into this picture. More...

virtual void	setData (com::avpkit::ferry::IBuffer *buffer)
	Sets the underlying buffer used by this object. More...

virtual void	render (bool drop, int64_t timeStamp)
	Render this picture on configured surface. More...

virtual void *	getOpaqueData ()

void	fillAVFrame (AVFrame *frame)
	Called by the StreamCoder before it encodes a picture. More...

void	copyAVFrame (AVFrame *frame, IPixelFormat::Type pixel, int32_t width, int32_t height)
	Called by the StreamCoder once it's done decoding. More...

VS_API_AVPKIT AVFrame *	getAVFrame ()
	Call to get the raw underlying AVFrame we manage; don't pass this to ffmpeg directly as ffmpeg often does weird stuff to these guys. More...

virtual IVideoPicture::PictType	getPictureType ()
	Get the picture type. More...

virtual void	setPictureType (IVideoPicture::PictType type)
	Set the picture type. More...

virtual void	setSideData (IVideoPicture::FrameDataType type, com::avpkit::ferry::IBuffer *buffer)

Public Member Functions inherited from com::avpkit::ferry::RefCounted
virtual int32_t	acquire ()
	Internal Only. More...

virtual int32_t	release ()
	Internal Only. More...

virtual RefCounted *	copyReference ()
	Create a new Java object that refers to the same native object. More...

virtual int32_t	getCurrentRefCount ()
	Return the current reference count on this object. More...

void	setJavaAllocator (void *allocator)
	This method is public but not part of the standard API. More...

void *	getJavaAllocator ()
	This method is public but not part of the standard API. More...

Static Public Member Functions
static VideoPicture *	make (IPixelFormat::Type format, int width, int height)
	The default factory for a frame. More...

static VideoPicture *	make (com::avpkit::ferry::IBuffer *buffer, IPixelFormat::Type format, int width, int height)

Static Public Member Functions inherited from com::avpkit::core::IVideoPicture
static IVideoPicture *	make (IPixelFormat::Type format, int width, int height)
	Get a new picture object. More...

static IVideoPicture *	make (IVideoPicture *src)
	Get a new picture by copying the data in an existing frame. More...

static IVideoPicture *	make (com::avpkit::ferry::IBuffer *buffer, IPixelFormat::Type format, int width, int height)
	Get a new picture object, by wrapping an existing com.avpkit.ferry.IBuffer. More...

Additional Inherited Members
Public Types inherited from com::avpkit::core::IVideoPicture
enum	PictType { DEFAULT_TYPE =0 , I_TYPE = 1 , P_TYPE = 2 , B_TYPE = 3 , S_TYPE = 4 , SI_TYPE = 5 , SP_TYPE = 6 , BI_TYPE = 7 }
	The different types of images that we can set. More...

enum	FrameDataType { AV_FRAME_DATA_PANSCAN , AV_FRAME_DATA_A53_CC , AV_FRAME_DATA_STEREO3D , AV_FRAME_DATA_MATRIXENCODING , AV_FRAME_DATA_DOWNMIX_INFO , AV_FRAME_DATA_REPLAYGAIN , AV_FRAME_DATA_DISPLAYMATRIX , AV_FRAME_DATA_AFD , AV_FRAME_DATA_MOTION_VECTORS , AV_FRAME_DATA_SKIP_SAMPLES , AV_FRAME_DATA_AUDIO_SERVICE_TYPE , AV_FRAME_DATA_MASTERING_DISPLAY_METADATA , AV_FRAME_DATA_GOP_TIMECODE , AV_FRAME_DATA_SPHERICAL , AV_FRAME_DATA_CONTENT_LIGHT_LEVEL , AV_FRAME_DATA_ICC_PROFILE }

Protected Member Functions inherited from com::avpkit::ferry::RefCounted
virtual void	destroy ()
	This method is called by RefCounted objects when their Ref Count reaches zero and they are about to be destroyed.

Protected Attributes inherited from com::avpkit::ferry::RefCounted
AtomicInteger *	mRefCount
	This is the internal reference count, represented as an AtomicInteger to make sure it is thread safe.

void *	mAllocator
	Not part of public API.

Detailed Description

Definition at line 33 of file VideoPicture.h.

Member Function Documentation

◆ copy()

bool com::avpkit::core::VideoPicture::copy ( IVideoPicture * srcPicture )

virtual

Copy the contents of the given picture into this picture.

All buffers are copied by value, not be reference.

Parameters

srcPicture The picture you want to copy.

Returns: true if a successful copy; false if not.

Implements com::avpkit::core::IVideoPicture.

Definition at line 155 of file VideoPicture.cpp.

   {
     bool result = false;
     try
     {
       if (!srcFrame)
         throw std::runtime_error("empty source frame to copy");
  
       if (!srcFrame->isComplete())
         throw std::runtime_error("source frame is not complete");
  
       VideoPicture* src = static_cast<VideoPicture*>(srcFrame);
       if (!src)
         throw std::runtime_error("src frame is not of right subtype");
  
       // now copy the data
       allocInternalFrameBuffer();
  
       // get the raw buffers
       unsigned char* srcBuffer = (unsigned char*)src->mBuffer->getBytes(0, src->getSize());
       unsigned char* dstBuffer = (unsigned char*)mBuffer->getBytes(0, getSize());
       if (!srcBuffer || !dstBuffer)
         throw std::runtime_error("could not get buffer to copy");
       memcpy(dstBuffer, srcBuffer, getSize());
  
       this->setComplete(true,
           srcFrame->getPixelType(),
           srcFrame->getWidth(),
           srcFrame->getHeight(),
           srcFrame->getPts());
       result = true;
     }
     catch (std::exception & e)
     {
       VS_LOG_DEBUG("error: %s", e.what());
       result = false;
     }
     return result;
   }

References com::avpkit::ferry::IBuffer::getBytes(), com::avpkit::core::IVideoPicture::getHeight(), com::avpkit::core::IVideoPicture::getPixelType(), com::avpkit::core::IVideoPicture::getPts(), getSize(), com::avpkit::core::IVideoPicture::getWidth(), com::avpkit::core::IVideoPicture::isComplete(), and setComplete().

◆ copyAVFrame()

void com::avpkit::core::VideoPicture::copyAVFrame	(	AVFrame *	frame,
		IPixelFormat::Type	pixel,
		int32_t	width,
		int32_t	height
	)

Called by the StreamCoder once it's done decoding.

We copy data from the buffers that ffmpeg allocated into our own buffers.

Parameters

frame	The AVFrame that ffmpeg filled in.
pixel	The pixel type
width	The width of the AVFrame
height	The height of the AVFrame

Definition at line 279 of file VideoPicture.cpp.

   {
     try
     {
       // Need to copy the contents of frame->data to our
       // internal buffer.
       VS_ASSERT(frame, "no frame?");
       if (!(av_pix_fmt_desc_get((AVPixelFormat) pixel)->flags & AV_PIX_FMT_FLAG_HWACCEL)) {
         VS_ASSERT(frame->data[0], "no data in frame");
         // resize the frame to the AVFrame
         mFrame->width = width;
         mFrame->height = height;
         mFrame->format = (int)pixel;
       
         int bufSize = getSize();
         if (bufSize <= 0)
           throw std::runtime_error("invalid size for frame");
  
         if (!mBuffer || mBuffer->getBufferSize() < bufSize)
           // reuse buffers if we can.
           allocInternalFrameBuffer();
  
         uint8_t* buffer = (uint8_t*)mBuffer->getBytes(0, bufSize);
         if (!buffer)
           throw std::runtime_error("really?  no buffer");
  
         if (frame->data[0])
         {
           // Make sure the frame isn't already using our buffer
           if(buffer != frame->data[0])
           {
             av_image_fill_arrays(mFrame->data, mFrame->linesize, buffer, 
               (AVPixelFormat) frame->format, width, height, 1);
             av_image_copy(mFrame->data, mFrame->linesize, (const uint8_t **)frame->data,
                   frame->linesize, (AVPixelFormat)frame->format, frame->width, frame->height);
           }
           mFrame->key_frame = frame->key_frame;
         }
         else
         {
           throw std::runtime_error("no data in frame to copy");
         }
       } 
       else 
       {
         mFrame->width = width;
         mFrame->height = height;
 //      mFrame->format = (int) pixel;
         if (pixel != IPixelFormat::MEDIACODEC) 
         {
             //mFrame->hw_frames_ctx = frame->hw_frames_ctx;
           av_hwframe_transfer_data(mFrame, frame, 0);
         } 
         else 
         {
             //av_frame_copy_props(mFrame, frame);
           mFrame->data[3] = frame->data[3];    
         }
       }
     }
     catch (std::exception & e)
     {
       VS_LOG_DEBUG("error: %s", e.what());
     }
   }

References com::avpkit::ferry::IBuffer::getBufferSize(), com::avpkit::ferry::IBuffer::getBytes(), getSize(), and com::avpkit::core::IPixelFormat::MEDIACODEC.

Referenced by com::avpkit::core::StreamCoder::decodeVideo(), and com::avpkit::core::BufferSink::fillVideoPicture().

◆ fillAVFrame()

void com::avpkit::core::VideoPicture::fillAVFrame ( AVFrame * frame )

Called by the StreamCoder before it encodes a picture.

The VideoPicture fills in Ffmpeg's AVFrame structure with the underlying data for the frame we're managing, but we maintain memory management.

Definition at line 257 of file VideoPicture.cpp.

   {
     if (!mBuffer || mBuffer->getBufferSize() < getSize())
       allocInternalFrameBuffer();
     unsigned char* buffer = (unsigned char*)mBuffer->getBytes(0, getSize());
     // This is an inherently unsafe operation; it copies over all the bits in the AVFrame
     memcpy(frame, mFrame, sizeof(AVFrame));
     //*frame = *mFrame;
     // and then relies on avpicture_fill to overwrite any areas in frame that
     // are pointed to the wrong place.
     av_image_fill_arrays(frame->data,
               frame->linesize,
               buffer, 
               (AVPixelFormat) frame->format, 
               frame->width, 
               frame->height, 
               1);
     frame->quality = getQuality();
 //    frame->type = FF_BUFFER_TYPE_USER;
   }

References com::avpkit::ferry::IBuffer::getBufferSize(), com::avpkit::ferry::IBuffer::getBytes(), getQuality(), and getSize().

Referenced by com::avpkit::core::StreamCoder::encodeVideo().

◆ getAVFrame()

AVFrame * com::avpkit::core::VideoPicture::getAVFrame ( )

Call to get the raw underlying AVFrame we manage; don't pass this to ffmpeg directly as ffmpeg often does weird stuff to these guys.

Note: This method is exported out of the DLL because the extras library uses it.

Definition at line 347 of file VideoPicture.cpp.

   {
     if (!mBuffer || mBuffer->getBufferSize() < getSize())
     {
       // reuse buffers if we can.
       allocInternalFrameBuffer();
     }
     return mFrame;
   }

References com::avpkit::ferry::IBuffer::getBufferSize(), and getSize().

Referenced by com::avpkit::core::BufferSource::addVideoPicture(), getDataLineSize(), and com::avpkit::core::VideoResampler::resample().

◆ getData()

com::avpkit::ferry::IBuffer * com::avpkit::core::VideoPicture::getData ( )

virtual

Get any underlying raw data available for this object.

Returns: The raw data, or null if not accessible.

Implements com::avpkit::core::IMediaData.

Definition at line 196 of file VideoPicture.cpp.

   {
     com::avpkit::ferry::IBuffer *retval = 0;
     try {
       if (getSize() > 0) {
         if (!mBuffer || mBuffer->getBufferSize() < getSize())
         {
           allocInternalFrameBuffer();
         }
         retval = mBuffer.get();
         if (!retval) {
           throw std::bad_alloc();
         }
       }
     } catch (std::bad_alloc &e) {
       VS_REF_RELEASE(retval);
       throw e;
     } catch (std::exception & e)
     {
       VS_LOG_DEBUG("Error: %s", e.what());
       VS_REF_RELEASE(retval);
     }
     return retval;
   }

References com::avpkit::ferry::RefPointer< T >::get(), com::avpkit::ferry::IBuffer::getBufferSize(), and getSize().

◆ getDataLineSize()

int com::avpkit::core::VideoPicture::getDataLineSize ( int lineNo )

virtual

Return the size of each line in the VideoPicture data.

Usually there are no more than 4 lines, but the first line no that returns 0 is the end of the road.

Parameters

lineNo The line you want to know the (byte) size of.

Returns: The size (in bytes) of that line in data.

Implements com::avpkit::core::IVideoPicture.

Definition at line 358 of file VideoPicture.cpp.

   {
     int retval = -1;
     if (getAVFrame()
         && lineNo >= 0
         && (unsigned int) lineNo < (sizeof(mFrame->linesize)/sizeof(mFrame->linesize[0])))
       retval = mFrame->linesize[lineNo];
     return retval;
   }

References getAVFrame().

◆ getHeight()

virtual int com::avpkit::core::VideoPicture::getHeight ( )

inlinevirtual

What is the height of the picture.

Returns: the height of the picture

Implements com::avpkit::core::IVideoPicture.

Definition at line 49 of file VideoPicture.h.

49 { return mFrame->height; }

Referenced by com::avpkit::core::StreamCoder::encodeVideo(), com::avpkit::core::BufferSink::fillVideoPicture(), and com::avpkit::core::VideoResampler::resample().

◆ getPictureType()

IVideoPicture::PictType com::avpkit::core::VideoPicture::getPictureType ( )

virtual

Get the picture type.

This will be set on decoding to tell you what type of packet this was decoded from, and when encoding is a request to the encoder for how to encode the picture.

The request may be ignored by your codec.

Returns: the picture type.

Implements com::avpkit::core::IVideoPicture.

Definition at line 507 of file VideoPicture.cpp.

   {
     IVideoPicture::PictType retval = IVideoPicture::DEFAULT_TYPE;
     if (mFrame)
       retval = (PictType) mFrame->pict_type;
     return retval;
   }

◆ getPixelType()

virtual IPixelFormat::Type com::avpkit::core::VideoPicture::getPixelType ( )

inlinevirtual

Returns the pixel format of the picture.

Returns: the pixel format of the picture.

Implements com::avpkit::core::IVideoPicture.

Definition at line 50 of file VideoPicture.h.

50 { return (IPixelFormat::Type) mFrame->format; }

com::avpkit::core::IPixelFormat::Type

Type

Pixel format.

Definition: IPixelFormat.h:65

Referenced by com::avpkit::core::StreamCoder::encodeVideo(), and com::avpkit::core::VideoResampler::resample().

◆ getPts()

int64_t com::avpkit::core::VideoPicture::getPts ( )

virtual

What is the Presentation Time Stamp (in Microseconds) of this picture.

The PTS is is scaled so that 1 PTS = 1/1,000,000 of a second.

Returns: the presentation time stamp (pts)

Implements com::avpkit::core::IVideoPicture.

Definition at line 382 of file VideoPicture.cpp.

   {
     return (mFrame ? mFrame->pts : -1);
   }

Referenced by com::avpkit::core::BufferSource::addVideoPicture(), com::avpkit::core::StreamCoder::encodeVideo(), getTimeStamp(), and com::avpkit::core::VideoResampler::resample().

◆ getQuality()

int com::avpkit::core::VideoPicture::getQuality ( )

virtual

This value is the quality setting this VideoPicture had when it was decoded, or is the value to use when this picture is next encoded (if reset with setQuality()

Returns: The quality.

Implements com::avpkit::core::IVideoPicture.

Definition at line 395 of file VideoPicture.cpp.

   {
     return (mFrame ? mFrame->quality : FF_LAMBDA_MAX);
   }

Referenced by fillAVFrame(), and com::avpkit::core::VideoResampler::resample().

◆ getSize()

int32_t com::avpkit::core::VideoPicture::getSize ( )

virtual

Total size in bytes of the decoded picture.

Returns: number of bytes of decoded picture

Implements com::avpkit::core::IVideoPicture.

Definition at line 442 of file VideoPicture.cpp.

   {
     int retval = -1;
     if (mFrame->width > 0 && mFrame->height > 0)
       retval = av_image_get_buffer_size((AVPixelFormat)mFrame->format, mFrame->width, mFrame->height, 1);
     return retval;
   }

Referenced by copy(), copyAVFrame(), com::avpkit::core::StreamCoder::encodeVideo(), fillAVFrame(), getAVFrame(), getData(), and make().

◆ getTimeBase()

virtual IRational* com::avpkit::core::VideoPicture::getTimeBase ( )

inlinevirtual

Get the time base that time stamps of this object are represented in.

Caller must release the returned value.

Returns: the time base.

Implements com::avpkit::core::IMediaData.

Definition at line 41 of file VideoPicture.h.

41 { return mTimeBase.get(); }

Referenced by com::avpkit::core::BufferSource::addVideoPicture(), and com::avpkit::core::BufferSink::fillVideoPicture().

◆ getTimeStamp()

virtual int64_t com::avpkit::core::VideoPicture::getTimeStamp ( )

inlinevirtual

Get the time stamp of this object in getTimeBase() units.

Returns: the time stamp

Implements com::avpkit::core::IMediaData.

Definition at line 38 of file VideoPicture.h.

38 { return getPts(); }

com::avpkit::core::VideoPicture::getPts

virtual int64_t getPts()

What is the Presentation Time Stamp (in Microseconds) of this picture.

Definition: VideoPicture.cpp:382

References getPts().

◆ getWidth()

virtual int com::avpkit::core::VideoPicture::getWidth ( )

inlinevirtual

What is the width of the picture.

Returns: the width of the picture

Implements com::avpkit::core::IVideoPicture.

Definition at line 48 of file VideoPicture.h.

48 { return mFrame->width; }

Referenced by com::avpkit::core::StreamCoder::encodeVideo(), com::avpkit::core::BufferSink::fillVideoPicture(), and com::avpkit::core::VideoResampler::resample().

◆ isComplete()

virtual bool com::avpkit::core::VideoPicture::isComplete ( )

inlinevirtual

Is this picture completely decoded?

Returns: is this picture completely decoded?

Implements com::avpkit::core::IVideoPicture.

Definition at line 47 of file VideoPicture.h.

47 { return mIsComplete; }

Referenced by com::avpkit::core::VideoResampler::resample().

◆ isKey()

virtual bool com::avpkit::core::VideoPicture::isKey ( )

inlinevirtual

Is this object a key object? i.e.

it can be interpreted without needing any other media objects

Returns: true if it's a key, false if not

Implements com::avpkit::core::IMediaData.

Definition at line 40 of file VideoPicture.h.

40 { return isKeyFrame(); }

com::avpkit::core::VideoPicture::isKeyFrame

virtual bool isKeyFrame()

Is this a key frame?

Definition: VideoPicture.cpp:369

References isKeyFrame().

◆ isKeyFrame()

bool com::avpkit::core::VideoPicture::isKeyFrame ( )

virtual

Is this a key frame?

Returns: is this a key frame

Implements com::avpkit::core::IVideoPicture.

Definition at line 369 of file VideoPicture.cpp.

   {
     return (mFrame ? mFrame->key_frame : false);
   }

Referenced by isKey().

◆ make() [1/2]

VideoPicture * com::avpkit::core::VideoPicture::make	(	com::avpkit::ferry::IBuffer *	buffer,
		IPixelFormat::Type	format,
		int	width,
		int	height
	)

static

Use the buffer

Set the internal flags

Definition at line 101 of file VideoPicture.cpp.

   {
     if (!buffer)
       return 0;
     VideoPicture *retval = 0;
     try {
       retval = make(format, width,height);
       if (!retval)
         throw std::bad_alloc();
       
       int32_t size = retval->getSize();
       if (size > 0 && size > buffer->getBufferSize())
         throw std::runtime_error("input buffer is not large enough for given picture");
       
       retval->mBuffer.reset(buffer, true);
       unsigned char* bytes = (unsigned char*)buffer->getBytes(0, size);
       if (!bytes)
         throw std::runtime_error("could not access raw memory in buffer");
  
       (void) av_image_fill_arrays(retval->mFrame->data,
               retval->mFrame->linesize,
               bytes, 
               (AVPixelFormat) format, 
               width, 
               height, 
               1);
  
     }
     catch (std::bad_alloc &e)
     {
       VS_REF_RELEASE(retval);
       throw e;
     }
     catch (std::exception& e)
     {
       VS_LOG_DEBUG("error: %s", e.what());
       VS_REF_RELEASE(retval);
     }
     return retval;
   }

References com::avpkit::ferry::IBuffer::getBufferSize(), com::avpkit::ferry::IBuffer::getBytes(), getSize(), make(), and com::avpkit::ferry::RefPointer< T >::reset().

◆ make() [2/2]

VideoPicture * com::avpkit::core::VideoPicture::make	(	IPixelFormat::Type	format,
		int	width,
		int	height
	)

static

The default factory for a frame.

We require callers to always tell us the format, width and height of the image they want to store in this VideoPicture.

Parameters

format	The pixel format
width	The expected width of this image.
height	The expected height of this image.

Returns: A new frame that can store an image and associated decoding information.

Definition at line 75 of file VideoPicture.cpp.

   {
     VideoPicture * retval=0;
     try {
       retval = VideoPicture::make();
       retval->mFrame->format = format;
       retval->mFrame->width = width;
       retval->mFrame->height = height;
       // default new frames to be key frames
       retval->setKeyFrame(true);
     }
     catch (std::bad_alloc &e)
     {
       VS_REF_RELEASE(retval);
       throw e;
     }
     catch (std::exception& e)
     {
       VS_LOG_DEBUG("error: %s", e.what());
       VS_REF_RELEASE(retval);
     }
  
     return retval;
   }

References setKeyFrame().

Referenced by make(), and com::avpkit::core::IVideoPicture::make().

◆ render()

void com::avpkit::core::VideoPicture::render	(	bool	drop,
		int64_t	timeStamp
	)

virtual

Render this picture on configured surface.

Works only with HW accelerated com.avpkit.core.IPixelFormat. com.avpkit.core.IStreamCoder#setHardwareDecoding(IPixelFormat.Type, Object) must be called before opening decoder.

Implements com::avpkit::core::IVideoPicture.

Definition at line 222 of file VideoPicture.cpp.

                                                    {
       if (mFrame && (av_pix_fmt_desc_get((AVPixelFormat) mFrame->format)->flags & AV_PIX_FMT_FLAG_HWACCEL)) {
         #ifdef __ANDROID__
           mediacodec_render_frame(mFrame, timeStamp, drop);
         #elif __APPLE__
           CVImageBufferRef image = (CVImageBufferRef) mFrame->data[3];
           CMVideoFormatDescriptionRef formatDescription;
           if (mCMSampleBuffer){
               CFRelease(mCMSampleBuffer);
           }
           CMTime duration = kCMTimeIndefinite;
           CMTime pts = CMTimeMake(timeStamp , 1000000000);
           const CMSampleTimingInfo timingInfo = {
                         .decodeTimeStamp = kCMTimeInvalid,
                         .duration = duration,
                         .presentationTimeStamp = pts
                     };
           CMVideoFormatDescriptionCreateForImageBuffer(NULL, image, &formatDescription);
           CMSampleBufferCreateReadyWithImageBuffer(NULL, image, formatDescription, &timingInfo, &mCMSampleBuffer);
           return sampleBuffer;
         #endif
       }
   }

◆ setComplete()

void com::avpkit::core::VideoPicture::setComplete	(	bool	aIsComplete,
		IPixelFormat::Type	format,
		int	width,
		int	height,
		int64_t	pts
	)

virtual

After modifying the raw data in this buffer, call this function to let the object know it is now complete.

Parameters

aIsComplete	Is this VideoPicture complete
format	The pixel format of the data in this picture. Must match what the picture was originally constructed with.
width	The width of the data in this picture. Must match what the picture was originally constructed with.
height	The height of the data in this picture. Must match what the picture was originally constructed with.
pts	The presentation timestamp of the picture that is now complete. The caller must ensure this PTS is in units of 1/1,000,000 seconds.

Implements com::avpkit::core::IVideoPicture.

Definition at line 410 of file VideoPicture.cpp.

   {
     try {
       mIsComplete = aIsComplete;
  
       if (mIsComplete)
       {
         setPts(pts);
       }
  
       if (!mFrame)
         throw std::runtime_error("no AVFrame allocated");
       if (format != IPixelFormat::NONE && mFrame->format != (int)IPixelFormat::NONE && (int)format != mFrame->format)
         throw std::runtime_error("pixel formats don't match");
       if (width > 0 && mFrame->width >0 && width != mFrame->width)
         throw std::runtime_error("width does not match");
       if (height > 0 && mFrame->height > 0 && height != mFrame->height)
         throw std::runtime_error("height does not match");
     }
     catch (std::exception& e)
     {
       VS_LOG_DEBUG("error: %s", e.what());
     }
   }

References setPts().

Referenced by copy(), com::avpkit::core::StreamCoder::decodeVideo(), com::avpkit::core::BufferSink::fillVideoPicture(), and com::avpkit::core::VideoResampler::resample().

◆ setData()

void com::avpkit::core::VideoPicture::setData ( com::avpkit::ferry::IBuffer * buffer )

virtual

Sets the underlying buffer used by this object.

This is an advanced method and is not recommended for use by those who don't fully understand how IBuffers work. Implementations of IMediaData may behave in undefined ways if the buffer you pass in is not big enough for what you ask them to do (e.g. they may discard your buffer and allocate a larger one if they need more space). It is up to the caller to ensure the buffer passed in is large enough, and is not simultaneously in use by another part of the system.

Parameters

buffer The buffer to set. If null, this method is ignored.

Use the buffer

Implements com::avpkit::core::IMediaData.

Definition at line 147 of file VideoPicture.cpp.

   {
     if (!buffer) return;
     mBuffer.reset(buffer, true);
   }

References com::avpkit::ferry::RefPointer< T >::reset().

◆ setKeyFrame()

void com::avpkit::core::VideoPicture::setKeyFrame ( bool aIsKey )

virtual

Reset if this is a key frame or not.

Note that regardless of how this flag is set, an IVideoPicture always contains raw video data (hence the key setting isn't really that important).

Parameters

aIsKey True if a key frame; false if not.

Implements com::avpkit::core::IVideoPicture.

Definition at line 375 of file VideoPicture.cpp.

   {
     if (mFrame)
       mFrame->key_frame = aIsKey;
   }

Referenced by make().

◆ setPictureType()

void com::avpkit::core::VideoPicture::setPictureType ( IVideoPicture::PictType type )

virtual

Set the picture type.

Parameters

type The type.

See also: getPictureType()

Implements com::avpkit::core::IVideoPicture.

Definition at line 516 of file VideoPicture.cpp.

   {
     if (mFrame)
       mFrame->pict_type = (enum AVPictureType) type;
   }

◆ setPts()

void com::avpkit::core::VideoPicture::setPts ( int64_t value )

virtual

Set the Presentation Time Stamp (in Microseconds) for this picture.

See also: getPts()

Parameters

value the new timestamp

Implements com::avpkit::core::IVideoPicture.

Definition at line 388 of file VideoPicture.cpp.

   {
     if (mFrame)
       mFrame->pts = value;
   }

Referenced by setComplete(), and setTimeStamp().

◆ setQuality()

void com::avpkit::core::VideoPicture::setQuality ( int newQuality )

virtual

Set the Quality to a new value.

This will be used the next time this VideoPicture is encoded by a StreamCoder

Parameters

newQuality The new quality.

Implements com::avpkit::core::IVideoPicture.

Definition at line 401 of file VideoPicture.cpp.

   {
     if (newQuality < 0 || newQuality > FF_LAMBDA_MAX)
       newQuality = FF_LAMBDA_MAX;
     if (mFrame)
       mFrame->quality = newQuality;
   }

Referenced by com::avpkit::core::VideoResampler::resample().

◆ setTimeBase()

virtual void com::avpkit::core::VideoPicture::setTimeBase ( IRational * aBase )

inlinevirtual

Set the time base that time stamps of this object are represented in.

Parameters

aBase the new time base. If null an exception is thrown.

Implements com::avpkit::core::IMediaData.

Definition at line 42 of file VideoPicture.h.

42 { mTimeBase.reset(aBase, true); }

◆ setTimeStamp()

virtual void com::avpkit::core::VideoPicture::setTimeStamp ( int64_t aTimeStamp )

inlinevirtual

Set the time stamp for this object in getTimeBase() units.

Parameters

aTimeStamp The time stamp

Implements com::avpkit::core::IMediaData.

Definition at line 39 of file VideoPicture.h.

39 { setPts(aTimeStamp); }

References setPts().

The documentation for this class was generated from the following files:

csrc/com/avpkit/core/VideoPicture.h
csrc/com/avpkit/core/VideoPicture.cpp

Public Member Functions

Static Public Member Functions

Additional Inherited Members

Detailed Description

Member Function Documentation

◆ copy()

◆ copyAVFrame()

◆ fillAVFrame()

◆ getAVFrame()

◆ getData()

◆ getDataLineSize()

◆ getHeight()

◆ getPictureType()

◆ getPixelType()

◆ getPts()

◆ getQuality()

◆ getSize()

◆ getTimeBase()

◆ getTimeStamp()

◆ getWidth()

◆ isComplete()

◆ isKey()

◆ isKeyFrame()

◆ make() [1/2]

◆ make() [2/2]

◆ render()

◆ setComplete()

◆ setData()

◆ setKeyFrame()

◆ setPictureType()

◆ setPts()

◆ setQuality()

◆ setTimeBase()

◆ setTimeStamp()