ELEN E688X
- Introduction to source coding (review)
- Review of probability and information theory concepts
- Brief review of entropy coding principles and algorithms
- Information theory bounds
- Huffman coding
- Arithmetic coding
- Scalar and vector quantization
- Rate-distortion characterization of lossy coding
- Shannon Lossy Coding Theorem
- Operational RD function of practical quantizers
- Waveform-based Video Coding
- Block-based transform coding
- Overview
- Unitary transforms
- The Discrete Cosine Transform (DCT)
- Bit allocation and transform coding gain
- Optimal transform design and the KLT
- DCT-based image coders and the JPEG Standard
- Vector Transform Coding
- Predictive coding
- Optimal predictor design and predictive coding gain
- Spatial-domain linear prediction
- Motion-Compensated temporal prediction
- Two-dimensional Motion Estimation
- General Methodologies
- Block-Matching Algorithm
- Global Motion Estimation
- Region-based Motion Estimation
- Multiresolution Motion Estimation
- Other Motion Estimation Techniques
- Basic design of block-based hybrid video coding systems
- Overview
- Building blocks
- Coding parameter selection
- Loop filtering
- Rate Control Strategies
- Fundamentals of MPEG Digital Video Compression Standards
- Brief review of MPEG-1 and MPEG-2 compression standards
- MPEG-4 multimedia compression standard
- Applications
- General overview of the various MPEG-4 parts (MPEG-4 Visual,
Audio, Systems etc.)
- MPEG-4 Visual
- Object based video coding
- Coding of Motion Information
- Binary Shape Coding
- Video Texture Coding
- Sprite coding
- Scalable Video Coding
- Differences compared with the MPEG-2 standard
- Brief discussion of Synthetic-Natural Hybrid Coding (SNHC)
- Overview of MPEG-4 Profiles and Levels
- Demonstrations
- Overview of H.264/MPEG-4 Part 10: Advanced Video Coding (AVC)
Standard
- Introduction
- Video Coding Layer (VCL)
- Network Adaptation Layer (NAL)
- Coding efficiency comparisons with MPEG-2, MPEG-4
- Demonstration
- Scalable video coding - principles and standards
- Principles of Scalable Coding
- Data Partitioning, Rate-Distortion optimized data
partitioning mechanisms
- SNR scalability
- Bitplane coding
- Spatial scalability
- Temporal scalability
- Content-related scalability
- Hybrid scalabilities
- Multiresolution concepts ? Pyramids
- Scalability in existing video coding standards
- Fine Granularity Scalability (FGS)
- Transcaling
- Demonstrations
- Wavelet coding ? the intraframe case
- Filter pairs
- Biorthogonality principle
- Lifting filters
- Discrete Wavelet Transform (DWT)
- Two-dimensional filter banks, two dimensional DWT
- Statistical Properties of Wavelet-Transformed Images
- Spatial-Frequency Localization
- Energy Compaction
- Within-Subband Clustering of Significant Coefficients
- Cross-Subband Similarity
- Decaying of Coefficient Magnitudes Across Subbands
- Encoding of wavelet coefficients
- Embedded Zerotree Wavelet (EZW)
- Set Partitioning In Hierarchical Trees (SPIHT)
- Morphological Representation of Wavelet Data (MRWD)
- JPEG-2000 ? brief overview and future developments
- Comparisons between different intraframe wavelet coding
techniques
- Demonstration
- Wavelet coding ? the interframe case (Part I)
- Wavelets and Motion Compensation
- Hybrid video coding using wavelets
- Motion compensation in wavelet domain
- Overcomplete wavelet motion compensated coding
- Three dimensional wavelet coding
- Motion compensated temporal filtering (MCTF)
- MCTF versus Motion Compensation Prediction ? comparisons and
discussion
- Wavelet coding ? the interframe case (Part II)
- Brief Review of MCTF (previous lecture)
- MCTF lifting filters
- Unconstrained Motion Compensated Temporal Filtering (UMCTF)
- Complexity and Delay analysis
- Scalability of side information (Motion, Shape etc.)
- Spatial-hierarchical coding of motion vectors
- Temporal-hierarchical coding of motion vectors
- Scalable binary shape coding
- Wavelet coding standardization in MPEG
- Comparisons between H.26L and fully scalable wavelet video
coding (in terms of complexity, efficiency)
- Demonstration
- Multiple Description Coding (MDC)
- Motivation
- The information theory of channel splitting
- General principles
- Multiple Description Quantization
- Multiple Description Correlating Transforms
- Multiple Description Coding with Frames
- Progressive coding and unequal error protection
- Multiple Description Motion Compensation Coding
- Multiple Description Scalable Coding
- Applications over networks
- State-of-the-art error resilient coding and error concealment
strategies for video communication
- Analysis of error propagation in predictive compression
schemes
- Error detection mechanisms
- Robust Entropy Coding
- Synchronization markers to prevent error propagation
- Fixed Length Codes
- Semi-fixed Length codes
- Reversible Variable Length Codes
- Error resilient entropy coding (EREC)
- Temporal Error Resilient Coding Techniques
- Reference Picture Selection
- Video Redundancy Coding
- Leaky Prediction
- Adaptive Intra Update
- Feedback-based Error Control
- Error resilience tools in current video coding standards
(MPEG-2, MPEG-4, H.264/MPEG-4 AVC)
- State-of-the-art error concealment strategies
- Spatial domain error concealment
- Spatial domain interpolation
- Maximally Smooth Recovery
- Projection Onto Convex Sets (POCS)
- Temporal domain error concealment
- Motion compensated prediction
- Spatio-temporal smoothing
- Recovery of motion vectors and coding modes
- Multiframe-based error concealment
- Model based error concealment
- Error concealment using mixtures of principal components
- Encoder-decoder-network interactive error control
- Robust video transmission over error prone networks (focus is
on wireless networks)
- Challenges for video transmission over error prone
networks
- Packetization strategies
- Prioritization and classification algorithms
- Video-optimized channel coding and error control
mechanisms
- Forward Error Correction (FEC)
- Interleaving
- Automatic Repeat Request (ARQ)
- Trading-off Source and Channel Coding
- Survey of QoS provisioning in the various network layers
(PHY, MAC, Transport, Application)
- Solutions and limitations of protection and adaptation
mechanisms in the various network layers
- Comparisons between different protection mechanisms
- Cross-layer optimization strategies
- Remaining technical challenges
- Example: Design of a robust in-home video transmission
system
- Demonstration
- Multimedia Networking ? algorithms, protocols and
architectures
- Multimedia Networking Applications
- Protocols for media streaming (brief review of RTP; media
delivery & control protocols)
- Comparison between Download versus Real-Time Streaming (HTTP
vs. RTP streaming)
- RTP payload formats for video coding standards (e.g. MPEG-2,
H.263+, MPEG-4 etc.)
- Bandwidth estimation mechanisms
- Streaming architectures for wireless video (proprietary versus
open solutions, industry consortium ? ISMA etc.)
- Adaptive Media Playout
- Rate-Distortion Optimal Packet Scheduling
- Demonstration
- Presentations of Final Projects