Digital Video Processing - CS 6870

                                  

                                                                              

Course contents:   

 

Video Acquisition and Representation -  Spatio Temporal Sampling - Sampling Structure Conversion - Interpolation - Color spaces - Video formats.

   

Motion analysis - 2D and 3D Motion Estimation and Compensation  - Optical Flow methods - Block based - Point correspondences - Gradient based - Intensity matching - Feature matching - Frequency domain motion estimation - Depth from motion - Structure from stereo - 3D Reconstruction - Motion analysis Applications: Video Summarization, Video Surveillance, Video Watermarking, Video Mosaicing.

 

Video Object Tracking and segmentation - 2D and 3D motion tracking - blob tracking - kernel based -Contour tracking - Feature matching - Filtering - mosaicing - Video Segmentation - Mean Shift based - Active shape model - Video shot boundary detection.

 

Video Filtering: Motion Compensation - Noise Filtering - Enhancement and Restoration - Video Stabilization and Super Resolution.

 

Video coding, representation - Video Standards: MPEG 1, 2, MPEG-4, MPEG-7, H.261, H.263, H.264. Video compression - Interframe Compression - 3D Waveform based - Motion Compensation.

 

Content based Video retrieval - Object based coding - Content based representation - Feature extraction - MPEG 7 Visual descriptors - Low to high level representation (CSS, Poly, B-Splines etc.) - Video Indexing and retrieval - search engines.

 

Video based Rendering - Generation of mosaics from video; Detection of Video object alpha-matte and Video cut&paste for Virtual Reality applications.

                      

 

 

Text Books:

 

     1. Handbook of Image and Video processing - Al Bovik (Alan C Bovik), Academic Press, Second Edition, 2005.

 

    2. Digital Image Sequence Processing, Compression, and Analysis - Todd R. Reed, CRC Press, 2004.

 

    3. H.264 and MPEG-4 Video Compression: Video Coding for Next Generation Multimedia  - Iain E.G. Richardson, Wiley, 2003

 

         4. Digital Video Processing - A. Murat Tekalp, Prentice Hall, 1995     

  

Reference:

 

        IEEE Transactions of Circuits and Systems for Video technology.

 

Lecture Slides - Click here to download (Last updated: 18th April 2009)