xref: /aosp_15_r20/external/intel-media-driver/docs/media_features.md (revision ba62d9d3abf0e404f2022b4cd7a85e107f48596f)
1# Media Features Summary
2
3## Supported Decoding Output Format and Max Resolution
4Note: Before vaapi version(1.9.0), media driver only allow to create 16bit surface for 12bit bitstream decoding, padding bits will be filled with 0 by hardware. After 1.9.0 vaapi version, media driver is supported to create both 12bit and 16bit surface for 12bit bitstream decoding.
5
6| Codec      | Type     | BMG            | LNL            | MTLx            | DG2/ATSM       | DG1/SG1        | TGLx           | ICL            | KBLx | BXTx | SKL  | BDW  |
7|------------|--------- |----------------|----------------|----------------|----------------|----------------|----------------|----------------|------|------|------|------|
8| AVC        | Output   | NV12           | NV12           | NV12           | NV12           | NV12           | NV12           | NV12           | NV12 | NV12 | NV12 | NV12 |
9|            | Max Res. | 4k             | 4k             | 4k             | 4k             | 4k             | 4k             | 4k             | 4k   | 4k   | 4k   | 4k   |
10| MPEG-2     | Output   | NV12           | NV12           | NV12           | NV12           | NV12           | NV12           | NV12           | NV12 | NV12 | NV12 | NV12 |
11|            | Max Res. | 2k             | 2k             | 2k             | 2k             | 2k             | 2k             | 2k             | 2k   | 2k   | 2k   | 2k   |
12| VC-1       | Output   |                |                |                |                | NV12           | NV12           | NV12           | NV12 | NV12 | NV12 | NV12 |
13|            | Max Res. |                |                |                |                | 4k             | 4k             | 4k             | 4k   | 4k   | 4k   | 4k   |
14| VP8        | Output   | NV12           | NV12           | NV12           |                |                | NV12*          | NV12           | NV12 | NV12 | NV12 | NV12 |
15|            | Max Res. | 4k             | 4k             | 4k             |                |                | 4k*            | 4k             | 4k   | 4k   | 4k   | 4k   |
16| HEVC 8bit  | Output   | NV12/YUY2/AYUV | NV12/YUY2/AYUV | NV12/YUY2/AYUV | NV12/YUY2/AYUV | NV12/YUY2/AYUV | NV12/YUY2/AYUV | NV12/YUY2/AYUV | NV12 | NV12 | NV12 |      |
17|            | Max Res. | 16k            | 16k            | 16k            | 16k            | 8k             | 8k             | 8k             | 8k   | 8k   | 8k   |      |
18| HEVC 10bit | Output   | P010/Y210/Y410 | P010/Y210/Y410 | P010/Y210/Y410 | P010/Y210/Y410 | P010/Y210/Y410 | P010/Y210/Y410 | P010/Y210/Y410 | P010 | P010 |      |      |
19|            | Max Res. | 16k            | 16k            | 16k            | 16k            | 8k             | 8k             | 8k             | 8k   | 8k   |      |      |
20| HEVC 12bit | Output** | P016/Y216/Y416 | P016/Y216/Y416 | P016/Y216/Y416 | P016/Y216/Y416 | P016/Y216/Y416 | P016/Y216/Y416 |                |      |      |      |      |
21|            | Max Res. | 16k            | 16k            | 16k            | 16k            | 8k             | 8k             |                |      |      |      |      |
22| VP9 8bit   | Output   | NV12/AYUV      | NV12/AYUV      | NV12/AYUV      | NV12/AYUV      | NV12/AYUV      | NV12/AYUV      | NV12/AYUV      | NV12 | NV12 |      |      |
23|            | Max Res. | 16k            | 16k            | 16k            | 16k            | 8k             | 8k             | 8k             | 8k   | 4k   |      |      |
24| VP9 10bit  | Output   | P010/Y410      | P010/Y410      | P010/Y410      | P010/Y410      | P010/Y410      | P010/Y410      | P010/Y410      | P010 |      |      |      |
25|            | Max Res. | 16k            | 16k            | 16k            | 16k            | 8k             | 8k             | 8k             | 8k   |      |      |      |
26| VP9 12bit  | Output** | P016/Y416      | P016/Y416      | P016/Y416      | P016/Y416      | P016/Y416      | P016/Y416      |                |      |      |      |      |
27|            | Max Res. | 16k            | 16k            | 16k            | 16k            | 8k             | 8k             |                |      |      |      |      |
28| AV1 8bit   | Output   | NV12           | NV12           | NV12           | NV12           | NV12           | NV12           |                |      |      |      |      |
29|            | Max Res. | 16k            | 16k            | 16k            | 16k            | 8k             | 8k             |                |      |      |      |      |
30| AV1 10bit  | Output   | P010           | P010           | P010           | P010           | P010           | P010           |                |      |      |      |      |
31|            | Max Res. | 16k            | 16k            | 16k            | 16k            | 8k             | 8k             |
32| VVC 8bit   | Output   |                | NV12           |                |                |                |                |                |      |      |      |      |
33|            | Max Res. |                | 16k            |                |                |                |                |
34| VVC 10bit  | Output   |                | P010           |                |                |                |                |                |      |      |      |      |
35|            | Max Res. |                | 16k            |                |                |                |                |
36
37- \* VP8 is only supported on TGL platform
38- \** HVEC/VP9 12bit use P016/Y216/Y416 with the least significant 4 bits are set to zero
39
40### JPEG Decoding Format Support
41| Input Format                                         | Output Format | Max resolution | Supported Platforms |
42|------------------------------------------------------|---------------|----------------|---------------------|
43| 4:2:0, 8-bit                                         | IMC3          | 16K            | BDW+                |
44| 4:2:2, 8-bit                                         | 422H          | 16K            | BDW+                |
45| 4:2:2, 8-bit                                         | 422V          | 16K            | BDW+                |
46| 4:1:1, 8-bit                                         | 411P          | 16K            | BDW+                |
47| 4:4:4, 8-bit                                         | 444P          | 16K            | BDW+                |
48| 4:4:4, 8-bit                                         | RGBP / BGRP   | 16K            | BDW+                |
49| 4:0:0, 8-bit                                         | 400P          | 16K            | BDW+                |
50| 420 / 422H<br/>interleaved single scan               | YUY2          | 16K            | BDW+                |
51| 420 / 422H<br/>interleaved single scan               | UYVY          | 16K            | BDW+                |
52| 420 / 422H / 422V<br/>interleaved single scan        | NV12          | 16K            | BDW+                |
53| 400/420/422H/444/RGB/BGR<br/>interleaved single scan | A8R8G8B8      | 16K            | SKL+                |
54
55## Supported Encoding Input Format and Max Resolution
56
57### Hardware Encoding, Low Power Encoding(VDEnc/Huc)
58
59| Codec      | Type         | LNL                | MTLx               |  DG2/ATSM          | DG1/SG1            | TGLx               | ICL       | KBLx   | BXTx   | SKL    | BDW |
60|------------|--------------|--------------------|--------------------|--------------------|--------------------|--------------------|-----------|--------|--------|--------|-----|
61| AVC        | Input        | *More              | *More              | *More              | *More              | *More              | *More     | *More  | NV12   | NV12   |     |
62|            | Max Res.     | 4k                 | 4k                 | 4k                 | 4k                 | 4k                 | 4k        | 4k     | 4k     | 4k     |     |
63| JPEG       | Input/Output | **Note             | **Note             | **Note             | **Note             | **Note             | **Note    | **Note | **Note | **Note |     |
64|            | Max Res.     | 16k                | 16k                | 16k                | 16k                | 16k                | 16k       | 16k    | 16k    | 16k    |     |
65| HEVC 8bit  | Input        | NV12/YUY2/AYUV/RGB | NV12/YUY2/AYUV/RGB | NV12/YUY2/AYUV/RGB | NV12/YUY2/AYUV/RGB | NV12/YUY2/AYUV/RGB | NV12/AYUV |        |        |        |     |
66|            | Max Res.     | 16k***             | 16k***             | 16k***             | 8k                 | 8k                 | 8k        |        |        |        |     |
67| HEVC 10bit | Input        | P010/Y210/Y410/RGB | P010/Y210/Y410/RGB | P010/Y210/Y410/RGB | P010/Y210/Y410/RGB | P010/Y210/Y410/RGB | P010/Y410 |        |        |        |     |
68|            | Max Res.     | 16k***             | 16k***             | 16k***             | 8k                 | 8k                 | 8k        |        |        |        |     |
69| VP9 8bit   | Input        |                    | NV12/AYUV          | NV12/AYUV          | NV12/AYUV          | NV12/AYUV          | NV12/AYUV |        |        |        |     |
70|            | Max Res.     |                    | 8k                 | 8k                 | 8k                 | 8k                 | 8k        |        |        |        |     |
71| VP9 10bit  | Input        |                    | P010/Y410          | P010/Y410          | P010/Y410          | P010/Y410          | P010/Y410 |        |        |        |     |
72|            | Max Res.     |                    | 8k                 | 8k                 | 8k                 | 8k                 | 8k        |        |        |        |     |
73| AV1 8bit   | Input        | NV12               | NV12               | NV12               |                    |                    |           |        |        |        |     |
74|            | Max Res.     | 8k                 | 8k                 | 8k                 |                    |                    |           |        |        |        |     |
75| AV1 10bit  | Input        | P010               | P010               | P010               |                    |                    |           |        |        |        |     |
76|            | Max Res.     | 8k                 | 8k                 | 8k                 |                    |                    |           |        |        |        |     |
77
78- \*More: KBL/CFL/ICL/TGL AVC encoding supported input formats: NV12/YUY2/YUYV/YVYU/UYVY/AYUV/ARGB
79- \**Note: JPEG encoding supports input format NV12/YUY2/UYVY/ABGR/Y8 and output format YUV400/YUV420/YUV422H_2Y/YUV444/RGB24.
80- \***: 16k=16384x12288
81
82
83### Hardware(PAK) + Shader(media kernel+VME) Encoding
84
85| Codec      | Type     | DG1/SG1        | TGLx           | ICL       | KBLx | BXTx | SKL  | BDW  |
86|------------|----------|----------------|----------------|-----------|------|------|------|------|
87| AVC        | Input    | NV12           | NV12           | NV12      | NV12 | NV12 | NV12 | NV12 |
88|            | Max Res. | 4k             | 4k             | 4k        | 4k   | 4k   | 4k   | 4k   |
89| MPEG2      | Input    | NV12           | NV12           | NV12      | NV12 |      | NV12 | NV12 |
90|            | Max Res. | 2k             | 2k             | 2k        | 2k   |      | 2k   | 2k   |
91| VP8        | Input    | NV12           | NV12           | NV12      | NV12 |      |      |      |
92|            | Max Res. | 4k             | 4k             | 4k        | 4k   |      |      |      |
93| HEVC 8bit  | Input    | NV12/YUY2/AYUV | NV12/YUY2/AYUV | NV12/AYUV | NV12 | NV12 | NV12 |      |
94|            | Max Res. | 8k             | 8k             | 8k        | 4k   | 4k   | 4k   |      |
95| HEVC 10bit | Input    | P010/Y210/Y410 | P010/Y210/Y410 | P010/Y410 |      |      |      |      |
96|            | Max Res. | 8k             | 8k             | 8k        |
97
98## Supported Video Processing CSC/Scaling Format
99
100| Platform      | Format | NV12 | YV12 | I420 | P010 | YUY2 | UYVY | Y210 | AYUV | Y410 | P016* | Y216* | Y416* | ARGB/ABGR | A2R10G10B10/A2B10G10R10 |
101|---------------|--------|------|------|------|------|------|------|------|------|------|-------|-------|-------|-----------|-------------------------|
102| BDW           | Input  | Y    | Y    | Y    |      | Y    |      |      |      |      |       |       |       | Y         | N                       |
103|               | Output | Y    | Y    | Y    |      | Y    |      |      |      |      |       |       |       | Y         | N                       |
104| SKL/BXTx/KBLx | Input  | Y    | Y    | Y    | Y    | Y    |      |      |      |      |       |       |       | Y         | N                       |
105|               | Output | Y    | Y    | Y    |      | Y    |      |      |      |      |       |       |       | Y         | N                       |
106| ICL           | Input  | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    |       |       |       | Y         | N                       |
107|               | Output | Y    | Y    | Y    | Y    | Y    |      | Y    | Y    | Y    |       |       |       | Y         | Y                       |
108| JSL/EHL       | Input  | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    |       |       |       | Y         | N                       |
109|               | Output | Y    | Y    | Y    | Y    | Y    |      | Y    | Y    | Y    |       |       |       | Y         | Y                       |
110| TGLx          | Input  | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y     | Y     | Y     | Y         | N                       |
111|               | Output | Y    | Y    | Y    | Y    | Y    |      | Y    | Y    | Y    | Y     | Y     | Y     | Y         | Y                       |
112| DG1/SG1       | Input  | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y     | Y     | Y     | Y         | N                       |
113|               | Output | Y    | Y    | Y    | Y    | Y    |      | Y    | Y    | Y    | Y     | Y     | Y     | Y         | Y                       |
114| DG2/ATSM      | Input  | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y     | Y     | Y     | Y         | N                       |
115|               | Output | Y    | Y    | Y    | Y    | Y    |      | Y    | Y    | Y    | Y     | Y     | Y     | Y         | Y                       |
116| MTLx          | Input  | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y     | Y     | Y     | Y         | N                       |
117|               | Output | Y    | Y    | Y    | Y    | Y    |      | Y    | Y    | Y    | Y     | Y     | Y     | Y         | Y                       |
118| LNL           | Input  | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y     | Y     | Y     | Y         | N                       |
119|               | Output | Y    | Y    | Y    | Y    | Y    |      | Y    | Y    | Y    | Y     | Y     | Y     | Y         | Y                       |
120| BMG           | Input  | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y    | Y     | Y     | Y     | Y         | N                       |
121|               | Output | Y    | Y    | Y    | Y    | Y    |      | Y    | Y    | Y    | Y     | Y     | Y     | Y         | Y                       |
122* \* For SFC path, there are NOT real 16bit, SFC precision is 12bit; For kernel path, we support real 16bit.
123* TGL/DG1/SG1 capable of max resolution: 16K; ICL/JSL/EHL/SKL/BXT/KBL/BDW capable of max resolution: 4k.
124* Composition path does not support conversion from BT2020 RGB to BT2020 YUV, BT2020->BT601/BT709, BT601/BT709 -> BT2020. So if some formats, RGB444 planar for example, are only supported by compositon path, make sure the color space isn't BT2020.
125
126## Supported Video Processing Feature Combination
127Video processing has various feature filters including Blending(or Composition), CSC(Color Space Conversion), De-Interlace, De-Noise, Luma Key, Mirroring, Procamp, Rotation, Scaling, Sharpening, STD/E, TCC, Color Fill, Chroma Sitting, HDR10 TM, 3DLUT. These features can be divided into VEBOX/SFC/EU 3 categories according to hardware units. Generally, VEBOX+SFC or VEBOX+EU feature combination is valid and HW execution sequence is usually VEBOX first, SFC/EU second.
128* VEBOX: Chroma Sitting, De-Interlace, De-Noise, Procamp, STD/E, TCC, HDR10 TM, 3DLUT, CSC
129     ##### HDR10 TM is the feature for HDR video content, hence, not compatible with denoise, deinterlace, STD/E, TCC.
130* SFC: Chroma Sitting, CSC, Mirroring, Rotation, Scaling, Sharpening, Color Fill
131* EU (Media Kernel or Shader): Blending, CSC, Rotation, Scaling, Color Fill
132
133## Supported Media Copy
134For media usage, there are a lot of interactive between CPU and GPU memory. To accelerate CPU<->GPU surface sharing performance, media copy is enabled to use GPU hardware engine or GPU kernel to copy the surface from/to CPU accessable location. It's supported from ATSM/Meteor Lake(MTL)+ platforms. You could get the detail API information from [vaCopy](http://intel.github.io/libva/va_8h.html#a5ff39794f6201b8a68ccb0d0f934be1e).
135
136Media Copy support most of formats like Nv12/p010/p016/ARGB/yuy2/y210/y216/AYUV/y410/ARGB10, and also popular resolution like 8K/4k/2k/1080p/720p/480p/320P, etc.
137
138Besides, it's required that CPU start address need 4k alignment, you can refer: [drm_i915_gem_userptr](https://dri.freedesktop.org/docs/drm/gpu/driver-uapi.html#c.drm_i915_gem_userptr)
139
140
141##### Resolution definition: 2k=2048x2048, 4k=4096x4096, 8k=8192x8192, 16k=16384x16384
142