As automotive technology advances, the need for in-cabin monitoring systems has grown, particularly to support driver assistance and safety features. Traditional camera-based systems, however, raise significant privacy concerns by capturing identifiable images. Thermal Sense addresses this challenge by utilizing low-resolution thermal sensors, which record only heat signatures rather than visual details. This approach ensures that personal identity remains protected while maintaining the effectiveness of safety monitoring.
Research conducted during the development of Thermal Sense demonstrated that thermal sensors are as effective as traditional cameras in detecting driver drowsiness, distractions, and the presence of children. In controlled experiments with 50 participants, no significant difference in performance was observed between the two methods. This finding underscores the system’s ability to balance safety and privacy, setting a new industry benchmark.
The core of Thermal Sense is a compact thermal sensor module, discreetly mounted on the rearview mirror. Measuring just 40mm x 30mm x 20mm and featuring a 32x32 pixel array, the device captures subtle thermal variations within the cabin. Advanced machine learning algorithms, powered by convolutional neural networks, analyze these patterns in real time—delivering alerts with a latency of under 100 milliseconds. This ensures immediate response to potential safety risks without invasive data collection.
Thermal Sense’s unobtrusive design allows it to operate seamlessly in the background, continuously monitoring the cabin environment. The system detects physiological indicators such as eye closure rates and head movements, providing real-time alerts for drowsiness or distraction. Its energy-efficient and lightweight construction makes it ideal for integration into modern vehicles, offering a privacy-conscious alternative to conventional monitoring solutions.
Developed in Shanghai in collaboration with leading automotive technology labs, Thermal Sense overcame challenges related to sensor quality and real-time processing through close partnerships with original equipment manufacturers and artificial intelligence experts. The result is a robust, reliable, and privacy-first solution, recognized with a Bronze A' Design Award for its ingenuity and contribution to quality of life improvements.
By prioritizing both safety and privacy, Thermal Sense establishes a new standard for in-car monitoring, paving the way for more secure and respectful automotive experiences worldwide.
Project Designers: Zeyuan Zhang
Image Credits: All Image: Zeyuan Zhang
Project Team Members: Lead Designer: Zeyuan Zhang
Lead Designer: Xuechun Tao
Lead Designer: Yangyi Tai
Project Name: Thermal Sense
Project Client: Tick Design Labs (Shanghai)