[PATCH v2 3/8] media: add Mediatek's MM21 format

[Alexandre Courbot]

Hi Nicolas,

On Wed, Mar 3, 2021 at 2:38 AM Nicolas Dufresne <nicolas at ndufresne.ca> wrote:
>
> Le jeudi 25 février 2021 à 19:16 +0900, Alexandre Courbot a écrit :
> > Add Mediatek's non-compressed 8 bit block video mode. This format is
> > produced by the MT8183 codec and can be converted to a non-proprietary
> > format by the MDP3 component.
> >
> > Signed-off-by: Alexandre Courbot <acourbot at chromium.org>
> > ---
> >  Documentation/userspace-api/media/v4l/pixfmt-reserved.rst | 7 +++++++
> >  drivers/media/v4l2-core/v4l2-ioctl.c                      | 1 +
> >  include/uapi/linux/videodev2.h                            | 1 +
> >  3 files changed, 9 insertions(+)
> >
> > diff --git a/Documentation/userspace-api/media/v4l/pixfmt-reserved.rst
> > b/Documentation/userspace-api/media/v4l/pixfmt-reserved.rst
> > index c9231e18859b..187ea89f7a25 100644
> > --- a/Documentation/userspace-api/media/v4l/pixfmt-reserved.rst
> > +++ b/Documentation/userspace-api/media/v4l/pixfmt-reserved.rst
> > @@ -242,6 +242,13 @@ please make a proposal on the linux-media mailing list.
> >         It is an opaque intermediate format and the MDP hardware must be
> >         used to convert ``V4L2_PIX_FMT_MT21C`` to ``V4L2_PIX_FMT_NV12M``,
> >         ``V4L2_PIX_FMT_YUV420M`` or ``V4L2_PIX_FMT_YVU420``.
> > +    * .. _V4L2-PIX-FMT-MM21:
> > +
> > +      - ``V4L2_PIX_FMT_MM21``
> > +      - 'MM21'
> > +      - Non-compressed, tiled two-planar format used by Mediatek MT8183.
> > +       This is an opaque intermediate format and the MDP3 hardware can be
> > +       used to convert it to other formats.
> >      * .. _V4L2-PIX-FMT-SUNXI-TILED-NV12:
>
> The SUNXI one was a mistake,  it's linear layout 32x32 tiles. The problem with
> calling this a vendor format, is that other vendor might be using it too. But
> they won't know and the format might endup duplicated, even if it's the same
> one.
>
> So here's my request, have you tried to understand a bit more what the tiling
> layout is ? Could be tiled + SAND, could use zigzag layout like Samsung do. I
> think if we can avoid vendor formats, we can preserve the pixel format list
> sanity here. Most of the HW I've encoutered was very easy to reverse, even if
> undocumented (except the compressed one).

Unfortunately I don't think I can look too closely into that, for
non-technical reasons. But if MTK could come forward and document
their format, that would be indeed ideal.

>
> If not possible, I would like to suggest:
>
>   V4L2_PIX_FMT_MTK_NV21
>
> The important part is to add a clear seperation for the vendor name, it easy to
> recognize then.

The MTK prefix makes sense, but I do not know if NV21 is a correct
denomination for that format. Note that we have another MTK-only
format currently named V4L2_PIX_FMT_MT21C, which is already public. It
would be nice to rename it as well, but since it is part of the public
API I'm afraid the cat is already out of the bag for that one...

>
> >
> >        - ``V4L2_PIX_FMT_SUNXI_TILED_NV12``
> > diff --git a/drivers/media/v4l2-core/v4l2-ioctl.c b/drivers/media/v4l2-
> > core/v4l2-ioctl.c
> > index 31d1342e61e8..0b85b2bbc628 100644
> > --- a/drivers/media/v4l2-core/v4l2-ioctl.c
> > +++ b/drivers/media/v4l2-core/v4l2-ioctl.c
> > @@ -1384,6 +1384,7 @@ static void v4l_fill_fmtdesc(struct v4l2_fmtdesc *fmt)
> >         case V4L2_PIX_FMT_TM6000:       descr = "A/V + VBI Mux Packet"; break;
> >         case V4L2_PIX_FMT_CIT_YYVYUY:   descr = "GSPCA CIT YYVYUY"; break;
> >         case V4L2_PIX_FMT_KONICA420:    descr = "GSPCA KONICA420"; break;
> > +       case V4L2_PIX_FMT_MM21:         descr = "Mediatek 8-bit block format";
> > break;
> >         case V4L2_PIX_FMT_HSV24:        descr = "24-bit HSV 8-8-8"; break;
> >         case V4L2_PIX_FMT_HSV32:        descr = "32-bit XHSV 8-8-8-8"; break;
> >         case V4L2_SDR_FMT_CU8:          descr = "Complex U8"; break;
> > diff --git a/include/uapi/linux/videodev2.h b/include/uapi/linux/videodev2.h
> > index 79dbde3bcf8d..e6890dae76ec 100644
> > --- a/include/uapi/linux/videodev2.h
> > +++ b/include/uapi/linux/videodev2.h
> > @@ -731,6 +731,7 @@ struct v4l2_pix_format {
> >  #define V4L2_PIX_FMT_Y12I     v4l2_fourcc('Y', '1', '2', 'I') /* Greyscale
> > 12-bit L/R interleaved */
> >  #define V4L2_PIX_FMT_Z16      v4l2_fourcc('Z', '1', '6', ' ') /* Depth data
> > 16-bit */
> >  #define V4L2_PIX_FMT_MT21C    v4l2_fourcc('M', 'T', '2', '1') /* Mediatek
> > compressed block mode  */
> > +#define V4L2_PIX_FMT_MM21     v4l2_fourcc('M', 'M', '2', '1') /* Mediatek 8-
> > bit block mode, two non-contiguous planes */
> >  #define V4L2_PIX_FMT_INZI     v4l2_fourcc('I', 'N', 'Z', 'I') /* Intel Planar
> > Greyscale 10-bit and Depth 16-bit */
> >  #define V4L2_PIX_FMT_SUNXI_TILED_NV12 v4l2_fourcc('S', 'T', '1', '2') /*
> > Sunxi Tiled NV12 Format */
> >  #define V4L2_PIX_FMT_CNF4     v4l2_fourcc('C', 'N', 'F', '4') /* Intel 4-bit
> > packed depth confidence information */
>
>