Evolution of Digital Video
- Evolution of Video Encoding Standards
- H.261, H.262 MPEG-2, H.263, MPEG-4, H.264
- Colour Television and Video
- Progressive encoding, Interlacing and Deinterlacing
- Digitally-Encoded Video Pictures
- Formats: 4:2:2, 4:2:0, CIF, QSIF: The Signals
- Digital Systems using YCbCr formats
- Capture of Images
- Colour Rendering
HEVC Encoding Design and Key Concepts
- HEVC Encoding algorithm structure
- Video Coding Layer
- Coding Tree Units (CTU) and Coding Tree Blocks (CTB)
- Deriving Coding Blocks (CB) and Coding Units (CU)
- Splitting CTUs into CBs and forming CUs
- Prediction Units (PU) and Prediction Blocks (PB)
- Transform Units (TU) and Transform Blocks (TB)
- Selecting the Transforms to be used
- Motion Vector Signalling
- Advanced Motion Vector Prediction (AMVP)
- Motion Compensation 7-tap and 8-tap Filters
- Intra-Prediction
- Quantization Control
- Entropy Coding Enhancements
- CABAC coding
- In-loop Deblocking Filtering
- Sample Adaptive Offset (SAO)
New Innovations within HEVC
- Parameter Set Structure
- Video Parameter Set (VPS) structure
- Network Abstraction Layer (NAL) unit syntax structure
- Slices
- Supplemental Enhancement Information (SEI)
- Video Usability Information (VUI)
- Parallel Decoding Syntax
- Modified Slice Structuring
- Tiles
- Wave-front Parallel Processing (WPP)
- Dependent Slice Segments
High-Level Transfer Syntax
- Transfer over Transports: RTP/UDP, ISO MP4, H.222.0 MPEG Transport
- Classifying NAL Units
- Video Coding Layer (VCL)
- Random Access
- Bitstream Splicing
- Clean Random Access (CRA)
- Random Access Point (RAP)
- Temporal Coding Order
- Open Group Of Pictures (GOP) operation
- Random Access Skipped Leading (RASL)
- Random Access Decodable Leading (RADL)
- Temporal Sublayer Support
- Scalable Video Coding (SVC) extension
- Temporal Sublayer Access (TSA) and stepwise TSA (STSA)
- Additional Parameter Sets
- Reference Picture Sets
- Decode Picture Buffer (DPB)
- Picture Order Count (POC)
- Reference Picture Set (RPS)
- Establishing Reference Pictures
- Trick Mode Operations
HEVC Video Coding Techniques
- Block-based Hybrid Video Coding
- The basic source-coding algorithm
- Improvements in HEVC when compared with earlier standards
- Representation of video signals
- Precision selection
- Division of Pictures into CTUs
- Subdivision Selection and Modes for Splitting
- Application to Luma and Chroma
- CTU Quadtree Syntax
- Selecting the Prediction Mode
- Partitioning into Transform Blocks and Units
- Span of TSs and PBs
- Slices and Tiles
- I-slices, P-slices and B-slices
- Re-synchronization after data loss
- Designing for parallel processing
- Interpicture Prediction
- Directional predictions
- Selection coding type
- Reference Sample Substitution
- Mode coding: Intra Angular, Intra Planar and Intra DC predictions
- Chroma intra-picture prediction
- PB Partitioning
- Fractional Sample Interpolation
- Interpolation Filtering
- Merge mode and Non-merge mode
- Memory management by restricting granularity
Profiles, Tiers, Levels and Conformance
- Conformance points to HEVC standard
- Sample Rate Restrictions imposed by Levels
- Main Tier and High Tier
- Main, Main 10 and Main Still Picture Profiles
- Level Limits for Main Profile
- Maximum Picture Rates
- Bitstream Conformance
- Decoder Conformance
Transform Scaling and Quantization
- Core Transform
- Two-dimensional transforms
- 16x16, 8x8 and 4x4 Transforms
- Block size scaling from 4x4 to 32x32
- Entropy Coding
- Context Modelling
- Skip and Split Flag syntax elements
- Adaptive Coefficient Scanning
- Coefficient Coding
- Sign Data Hiding
- In-Loop Filters
- Two Step Operation
- Goal of De-Blocking Filter
- PU and TU boundaries for applications
- Strength of DBF
- Order of DBF operation
- SAO Filter Operation
- Conditional added offsets
- Segment bands
- SAO types
- Special Coding Modes
- I_PCM mode
- Lossless Mode
- Transform Skipping Mode
Conclusions and Implementation Considerations
- Likely efficiency improvements
- Open source developments
- Sample encoded content
- Sample players
- Early Encoders
- Patents and Licensing
Nex-G Innovations
