The VCX test measurement currently updated to the 2020 version. It has now included a selfie camera test, also rear camera test has been extended to cover various capturing environment as well as video. The image quality test of the rear camera consists of several parts: Sunny, Indoor, Night, Flashlights conditions, Zoom, Video, Selfie(each under 3 condition: sunny, indoor, night). Even more VCX-Forum members consider that taking pictures under low light conditions is challenging, hence it additionally tested under 6 different faint lightroom as an ‘Extended Low Light condition’. Still, you can find the camera performance test in the updated version.
Variables are controlled and kept constant throughout the test. Any changes in a variable during an experiment or in between tests would invalidate the correlation of dependent variables to the independent variable, thus skewing the results.
Ideally one image contains all the information that we need for the various image quality aspects, e.g. dynamic range and sharpness.
Factory default settings are selected and the default camera app with automatic exposure control is used. The analysis is performed based on the final JPG image data using the camera internal image processing pipeline.
The image quality evaluation based on the TE42 LL test chart is performed under different lighting conditions:
Extended Low light – Additionally images captured under decreasing illumination. A reference at bright (see above) and then the images with the illumination of 10lux, 5 lux, 2.5 lux, 1 lux, 0.75 lux
Zoom(4x) – To zoom onto a smaller object is a very common action user of mobile phone cameras performs. To evaluate the image quality of a zoomed image, we capture an image of the TE42 LL with 4x zoom at the mentioned conditions bright, mid and low. If the device provides an optical zoom, we use the optical zoom first and add digital zoom, if needed, to achieve a 4x zoom. For devices that only offer digital zoom (the standard case of the majority of today’s mobile phones), we use a 4x digital zoom. Devices that achieve less than 4x zoom will receive 0 points for this measurement condition. To perform the measurement, the distance between the chart and the camera is increased according to the zoom factor and the entire chart is captured.
Video The image quality evaluation of video is based on the TE42 LL test chart, an extracted image of a frame from the 10 seconds of the video is used for the calculation. The extracted frames for analysis are extracted using ffmpeg after at least 5s in the video file. This is also performed under three different measurement conditions: Sunny, Indoor, Night
Selfie The image quality evaluation based on the TE42 LL A460 test chart is performed under three different measurement conditions: Sunny, Indoor, Night
The metrics in the part “Response Time” are measured using the TE42-LL chart as well as LED panel.
The device under the shooting time lag test will be given the time to focus on the near-focus-chart in order to have a controlled starting point for the autofocus, which is then removed quickly so the device can focus on the far-focus-chart. The setup consists of a near-focus-chart and a far-focus-chart. The start of the exposure can still be determined, as it is the position of the first LED that is of interest.
The frame rate is normally reported as the number of frames that can be captured within one second. We decided to change this slightly and measure and report the time needed to capture 10 images.
The analysis is made using software that has been shown to comply with the IQ-Analyzer and the VCX own tools. All the data which is extracted from the measurements will be computed without additional subjective analysis. Totally over 350 test metrics are engaged to calculate the final VCX score. The proportion of each metric is determined by the VCX-Forum members when generating a VCX version.
The process is updated annually with new versions. the professional and detailed information can be found on the white paper. If you have any further questions, please contact the VCX coordinator.