Multimedia Backend Development


A multimedia backend provides the glue between platform specific libraries, and Qt Multimedia. In some cases the available cross-platform Multimedia APIs or implementations are not sufficient, or not immediately available on a certain platform. Alternatively, the multimedia implementation on a platform might expose certain extra properties or functionality that other platforms do not, or a finer degree of control might be possible. For these cases, it is possible to use extended controls directly.

In addition, if you plan to port the Qt Multimedia APIs to a new platform, you do this by implementing certain control and service classes, as detailed below.

Extending the API

For the developer who wishes to extend the functionality of the Qt Multimedia classes there are several classes of particular importance. The classes providing default functionality are QMediaService, QMediaServiceProvider and QMediaControl. Some of these classes are not in the public API since they are very seldom useful to application developers.

To extend the Multimedia API you would use the following three classes or classes derived from them.

  • QMediaServiceProvider is used by the top level client class to request a service. The top level class knowing what kind of service it needs.
  • QMediaService provides a service and when asked by the top level object, say a component, will return a QMediaControl object.
  • QMediaControl allows the control of the service using a known interface.

Consider a developer creating, for example, a media player class called MyPlayer. It may have special requirements beyond ordinary media players and so may need a custom service and a custom control. We can subclass QMediaServiceProvider to create our MyServiceProvider class. Also we will create a MyMediaService, and the MyMediaControl to manipulate the media service.

The MyPlayer object calls MyServiceProvider::requestService() to get an instance of MyMediaService. Then the MyPlayer object calls this service object it has just received and calling requestControl() it will receive the control object derived from QMediaControl.

Now we have all the parts necessary for our media application. We have the service provider, the service it provides and the control used to manipulate the service. Since our MyPlayer object has instances of the service and its control then it would be possible for these to be used by associated classes that could do additional actions, perhaps with their own control since the parameter to requestControl() is a zero-terminated string, const char *, for the interface.

Adding a Media Service Provider

In general, adding a new media service provider is outside the scope of this documentation. For best results, consult the existing provider source code, and seek assistance on the relevant mailing lists and IRC channels.

Classes for service implementers.


Access to the audio decoding functionality of a QMediaService


Access to the settings of a media service that performs audio encoding


Audio input selector media control


Audio output selector media control


Control for setting the capture buffer format


Control for setting capture destination


Abstract base class for classes that control still cameras or video cameras


Allows controlling camera exposure parameters


Allows controlling feedback (sounds etc) during camera operation


Allows controlling a camera's flash


Supplies control for focusing related camera parameters


Control interface for image capture services


Abstract class for controlling image processing parameters, like white balance, contrast, saturation, sharpening and denoising


Camera info media control


Abstract base class for classes that control still cameras or video cameras


Abstract class for controlling camera viewfinder parameters


Access to the viewfinder settings of a camera media service


Supplies control for optical and digital camera zoom


Access to the settings of a media service that performs image encoding


Allows control over probing audio data in media objects


Supplies a control for reporting availability of a service


Access to the output container format of a QMediaService


Base interface for media service controls


Access to the gapless playback related control of a QMediaService


Allows the setting of the Network Access Point for media related activities


Access to the media playing functionality of a QMediaService


Access to the recording functionality of a QMediaService


Common base class for media service implementations


Media stream selection control


Allows control over probing video frames in media objects


Read access to the meta-data of a QMediaService's media


Write access to the meta-data of a QMediaService's media


Access to the RDS functionality of the radio in the QMediaService


Access to the radio tuning functionality of a QMediaService


Video device selector media control


Access to the settings of a media service that performs video encoding


Media control for rendering video to a QAbstractVideoSurface


Media control for rendering video to a window

© 2016 The Qt Company Ltd. Documentation contributions included herein are the copyrights of their respective owners. The documentation provided herein is licensed under the terms of the GNU Free Documentation License version 1.3 as published by the Free Software Foundation. Qt and respective logos are trademarks of The Qt Company Ltd. in Finland and/or other countries worldwide. All other trademarks are property of their respective owners.