ELEN E688X

<-- Return to the previous page

Topics in Signal Processing

  1. Introduction to source coding (review)
    • Review of probability and information theory concepts
    • Brief review of entropy coding principles and algorithms
    • Information theory bounds
    • Huffman coding
    • Arithmetic coding
    • Scalar and vector quantization
    • Rate-distortion characterization of lossy coding
    • Shannon Lossy Coding Theorem
    • Operational RD function of practical quantizers

  2. Waveform-based Video Coding
    • Block-based transform coding
    • Overview
    • Unitary transforms
    • The Discrete Cosine Transform (DCT)
    • Bit allocation and transform coding gain
    • Optimal transform design and the KLT
    • DCT-based image coders and the JPEG Standard
    • Vector Transform Coding
    • Predictive coding
    • Optimal predictor design and predictive coding gain
    • Spatial-domain linear prediction
    • Motion-Compensated temporal prediction

  3. Two-dimensional Motion Estimation
    • General Methodologies
    • Block-Matching Algorithm
    • Global Motion Estimation
    • Region-based Motion Estimation
    • Multiresolution Motion Estimation
    • Other Motion Estimation Techniques

  4. Basic design of block-based hybrid video coding systems
    • Overview
    • Building blocks
    • Coding parameter selection
    • Loop filtering
    • Rate Control Strategies

  5. Fundamentals of MPEG Digital Video Compression Standards
    • Brief review of MPEG-1 and MPEG-2 compression standards
    • MPEG-4 multimedia compression standard
    • Applications
    • General overview of the various MPEG-4 parts (MPEG-4 Visual, Audio, Systems etc.)
    • MPEG-4 Visual
    • Object based video coding
    • Coding of Motion Information
    • Binary Shape Coding
    • Video Texture Coding
    • Sprite coding
    • Scalable Video Coding
    • Differences compared with the MPEG-2 standard
    • Brief discussion of Synthetic-Natural Hybrid Coding (SNHC)
    • Overview of MPEG-4 Profiles and Levels
    • Demonstrations

  6. Overview of H.264/MPEG-4 Part 10: Advanced Video Coding (AVC) Standard
    • Introduction
    • Video Coding Layer (VCL)
    • Network Adaptation Layer (NAL)
    • Coding efficiency comparisons with MPEG-2, MPEG-4
    • Demonstration

  7. Scalable video coding - principles and standards
    • Principles of Scalable Coding
    • Data Partitioning, Rate-Distortion optimized data partitioning mechanisms
    • SNR scalability
    • Bitplane coding
    • Spatial scalability
    • Temporal scalability
    • Content-related scalability
    • Hybrid scalabilities
    • Multiresolution concepts ? Pyramids
    • Scalability in existing video coding standards
    • Fine Granularity Scalability (FGS)
    • Transcaling
    • Demonstrations

  8. Wavelet coding ? the intraframe case
    • Filter pairs
    • Biorthogonality principle
    • Lifting filters
    • Discrete Wavelet Transform (DWT)
    • Two-dimensional filter banks, two dimensional DWT
    • Statistical Properties of Wavelet-Transformed Images
    • Spatial-Frequency Localization
    • Energy Compaction
    • Within-Subband Clustering of Significant Coefficients
    • Cross-Subband Similarity
    • Decaying of Coefficient Magnitudes Across Subbands
    • Encoding of wavelet coefficients
    • Embedded Zerotree Wavelet (EZW)
    • Set Partitioning In Hierarchical Trees (SPIHT)
    • Morphological Representation of Wavelet Data (MRWD)
    • JPEG-2000 ? brief overview and future developments
    • Comparisons between different intraframe wavelet coding techniques
    • Demonstration

  9. Wavelet coding ? the interframe case (Part I)
    • Wavelets and Motion Compensation
    • Hybrid video coding using wavelets
    • Motion compensation in wavelet domain
    • Overcomplete wavelet motion compensated coding
    • Three dimensional wavelet coding
    • Motion compensated temporal filtering (MCTF)
    • MCTF versus Motion Compensation Prediction ? comparisons and discussion

  10. Wavelet coding ? the interframe case (Part II)
    • Brief Review of MCTF (previous lecture)
    • MCTF lifting filters
    • Unconstrained Motion Compensated Temporal Filtering (UMCTF)
    • Complexity and Delay analysis
    • Scalability of side information (Motion, Shape etc.)
    • Spatial-hierarchical coding of motion vectors
    • Temporal-hierarchical coding of motion vectors
    • Scalable binary shape coding
    • Wavelet coding standardization in MPEG
    • Comparisons between H.26L and fully scalable wavelet video coding (in terms of complexity, efficiency)
    • Demonstration

  11. Multiple Description Coding (MDC)
    • Motivation
    • The information theory of channel splitting
    • General principles
    • Multiple Description Quantization
    • Multiple Description Correlating Transforms
    • Multiple Description Coding with Frames
    • Progressive coding and unequal error protection
    • Multiple Description Motion Compensation Coding
    • Multiple Description Scalable Coding
    • Applications over networks

  12. State-of-the-art error resilient coding and error concealment
      strategies for video communication
    • Analysis of error propagation in predictive compression schemes
    • Error detection mechanisms
    • Robust Entropy Coding
    • Synchronization markers to prevent error propagation
    • Fixed Length Codes
    • Semi-fixed Length codes
    • Reversible Variable Length Codes
    • Error resilient entropy coding (EREC)
    • Temporal Error Resilient Coding Techniques
    • Reference Picture Selection
    • Video Redundancy Coding
    • Leaky Prediction
    • Adaptive Intra Update
    • Feedback-based Error Control
    • Error resilience tools in current video coding standards (MPEG-2, MPEG-4, H.264/MPEG-4 AVC)
    • State-of-the-art error concealment strategies
    • Spatial domain error concealment
    • Spatial domain interpolation
    • Maximally Smooth Recovery
    • Projection Onto Convex Sets (POCS)
    • Temporal domain error concealment
    • Motion compensated prediction
    • Spatio-temporal smoothing
    • Recovery of motion vectors and coding modes
    • Multiframe-based error concealment
    • Model based error concealment
    • Error concealment using mixtures of principal components
    • Encoder-decoder-network interactive error control

  13. Robust video transmission over error prone networks (focus is on wireless networks)
    • Challenges for video transmission over error prone networks
    • Packetization strategies
    • Prioritization and classification algorithms
    • Video-optimized channel coding and error control mechanisms
    • Forward Error Correction (FEC)
    • Interleaving
    • Automatic Repeat Request (ARQ)
    • Trading-off Source and Channel Coding
    • Survey of QoS provisioning in the various network layers (PHY, MAC, Transport, Application)
    • Solutions and limitations of protection and adaptation mechanisms in the various network layers
    • Comparisons between different protection mechanisms
    • Cross-layer optimization strategies
    • Remaining technical challenges
    • Example: Design of a robust in-home video transmission system
    • Demonstration

  14. Multimedia Networking ? algorithms, protocols and architectures
    • Multimedia Networking Applications
    • Protocols for media streaming (brief review of RTP; media delivery & control protocols)
    • Comparison between Download versus Real-Time Streaming (HTTP vs. RTP streaming)
    • RTP payload formats for video coding standards (e.g. MPEG-2, H.263+, MPEG-4 etc.)
    • Bandwidth estimation mechanisms
    • Streaming architectures for wireless video (proprietary versus open solutions, industry consortium ? ISMA etc.)
    • Adaptive Media Playout
    • Rate-Distortion Optimal Packet Scheduling
    • Demonstration

  15. Presentations of Final Projects