What is DxOMark?
DxOMark is a trusted industry standard for camera and lens image quality measurements and rating. They have been known over the years for rigorously testing cameras and lens using industry grade tools for analyzing and establishing comprehensive references based on results from thousands of cameras and lenses over the period. It is a subsidiary of DXOLabs a software company based in Boulogne-Billancourt, France, known for developing image processing software and records technical measurements of lenses and cameras on its website.
Introduction to DxOMark Mobile test protocol
The DxOMark Mobile test protocol was launched back in 2012 those were the days when tests were carried out on high end smartphones of that time like the Apple iPhone 4 and 5, the Samsung Galaxy S2 and S3, the Nokia 808, and the HTC 8X. Technological changes have introduced far superior mobile cameras as of now and the mobile sector has become the number one driver of innovation in imaging.
DxOMark brought various original test protocols to keep up with the advancements in the camera technology. The various protocols introduced were as follows:
- Advanced CMOS image sensor technology with powerful chipsets allowed real time multi frame processing, resulting in substantial improvements in low-light performance.
- On-sensor phase detection and laser-based time-of-flight sensors drastically improved autofocus speed and precision, especially in low-light conditions.
- The Dual camera setups introduced the optical zooming feature and bokeh-like(Bokeh is the visual quality of the out-of-focus areas of a photographic image, especially as rendered by a particular lens.) features which reproduce on smartphone cameras the shallow depth-of-field of a fast lens on a DSLR. Incase of other dual cams data from RGB sensor is captured by a secondary monochrome chip for improved detail, reduced noise levels, and increased dynamic range.
Considering the various developments taking place in the compact camera market segment, DxOMark redesigned the DxOMark Mobile test protocol to include new and expanded outdoor and lab test scenes and evaluation methodologies.
DxOMark Mobile new protocols for 2017
The new protocols allowed analysing more than 1500 images and 2 hours of video for each device. The new protocols were able to carry out extensive tests at multiple focal lengths called the new zoom sub- score and a new bokeh sub-score based on lab and outdoor testing. Low light testing was possible up to 1 Lux and Motion based test scenes were able to be conducted for more accurate evaluation of camera performance and processing techniques in real-world situations.
In today’s world most of the components such as display and chipsets can be differentiated in terms of the processor speed, pixel view etc. But it is the camera which has become a decisive factor for many users when they buy a smartphone and all smartphone manufacturers as well to deliver the goods. DxOMark Mobile test protocol helps consumers make an informed buying decision by evaluating the true camera performance, compared to the claims made by the manufacturers. For details overview of the latest DxOMark Mobile test protocol here.
DxOMark Mobile Scores
The DxOMark Mobile Photo and Video sub-scores and the overall scores are generated from various combination of impartial lab measurements and perceptual analyses.
The Photo sub-score is feed with the following test criteria:
- Exposure and contrast, including dynamic range, exposure repeatability, and contrast
- Color, including saturation and hue, white balance, white balance repeatability, and color shading
- Texture and noise
- Autofocus, including AF speed and repeatability
- Artifacts, including softness in the frame, distortion, vignetting, chromatic aberrations, ringing, flare, ghosting, aliasing, moiré patterns, and more.
- Zoom at several subject distances
The Video sub-score is feed with the following test criteria:
- Texture and noise
Scores are presented in the format as shown below.
Both the DxoMark Mobile test protocols are valid for evaluation purpose but you cannot compare the test results with each other ie results from the earlier protocol cannot be compared with those from the new protocol. To understand the DxOMark lens testing protocol and scores you can click here.