The VCX Forum held a two-day workshop on 10–11 February at the DXOMARK laboratory in Paris, France. The workshop was attended by 10 VCX Forum members, including representatives from Amazon, DXOMARK and Image Engineering.
The primary objective was to align on testing protocols for smart home security cameras. The workshop aimed to overcome limitations of previous online meetings by enabling participants to observe real test scenes, practical challenges, and methodological constraints in a laboratory environment. This in-person format enabled more constructive and realistic discussions grounded in hands-on evaluation setups rather than abstract assumptions.
Given the diversity of real-world use cases (including indoor and outdoor operation, day-to-night transitions, low-light conditions, and moving subjects), the need for clearly defined evaluation scopes and repeatable test conditions was a central theme throughout the discussions.
Discussions focused on test areas directly related to practical performance, such as low-light and extended low-light evaluation, dynamic range assessment, distortion and corner performance, noise characteristics, and the convergence behaviour of white balance and exposure. As a result, the scope of evaluation was clarified, and the majority of conditions required for quantitative and repeatable testing were defined. In addition, common definitions were established for transition regions, particularly between day and night modes, as well as for the associated test environments.
AI-based analysis was addressed at a high level. In this context, participants reaffirmed that transparency, explainability, and reproducibility remain essential principles of the VCX evaluation framework.
The workshop resulted in shared conclusions on several core topics, based on the practical experience of participating organisations. At the same time, it clarified remaining common challenges and significantly improved technical alignment among members. Building on these outcomes, the VCX Forum will continue to refine smart home security camera testing protocols through its regular group activities.
Thanks for your attention
Warm regards,
Benjamin Pak Coordinator