The perfect combination of road vehicle driving safety systems and cameras.
DMS （Driver Monitor System）
The main function is to monitor the driver's fatigue status around the clock. After discovering that the driver is fatigued, yawning, squinting, smoking, talking on handheld phones, etc., the DMS system will promptly analyze such behaviors and perform voice and lighting and other prompts, which serve to warn the driver and correct wrong driving behavior. DMS cameras can detect and warn of unsafe driving behavior. Through eye and facial change detection, all unsafe driving behaviors of the driver while driving are identified, and corresponding voice prompts are given.
DMS generally uses a 2MP infrared camera and does not need to use RGB working mode. The pictures it takes need to be visible to the "machine" so that the AI algorithm can accurately analyze the driver's status; they do not need to be comfortable for the "human" to see. Therefore, DMS only requires a pixel resolution of 2MP, and an infrared light camera to ensure that the machine can clearly see the driver's facial features under any lighting conditions.
DMS camera installation location:
It is recommended to install it on the center console or dashboard. If the above conditions are met, the smaller the deviation angle between the DMS camera and the driver's face, the better. It is best to face the driver directly.
Wintop Optics representative lenses for DMS application:
OMS （Occupant Monitoring System）
It is mainly used to monitor passengers to ensure the safety of passengers and driving, so that passengers do not interfere with the driver. The OMS camera can detect whether the passenger is wearing the seat belt correctly. Just inserting a safety buckle cannot get away with it.
Another very important function of OMS is live body detection, which can ensure whether there are pets or children left in the back seat of the car. In addition, OMS is also used in in-car conference systems, secure payment systems, and artificial intelligence assistant fusion sensing systems.
OMS passenger monitoring cameras generally achieve good results if they reach 5MP. Generally, a 5MP or even 8MP OMS main camera is placed at the front rearview mirror; a 2MP rear OMS is added above the second and third rows of seats. Through the application of AI algorithms such as face recognition, motion capture, and live body detection, OMS can improve the perception in smart cockpit cars.
In terms of regulations, many regions and countries have already enacted legislation requiring in-car child testing. Euro NCAP plans to increase the score for detecting the presence of children in cars from January 2023, and the regulations are very detailed. The United States is legislating to require all new cars to be pre-installed with child presence detection functions, which is expected to be fully implemented in 2025. It is said that relevant domestic regulations are also being evaluated and formulated.
Regarding OMS, there are currently two solutions, one is the visual solution （equipped with camera sensing）, and the other is the millimeter wave solution （lidar rays）.
In the past two years, the advantages of the millimeter wave solution have obviously increased, because of the rear life monitoring system,90seconds after the car is locked, senses that there is a life missing in the car, it will sound a warning through the vehicle siren, and send text messages and APP notifications to the car owner to remind them. Even if the car owner cannot return in time, when the temperature exceeds 23 degrees, the vehicle will automatically open the sunroof to dissipate the heat inside the vehicle in a timely manner.
But there are also some solutions that combine the two, that is, in-cabin monitoring solutions that integrate millimeter waves and cameras, which can perfectly combine the advantages of the two.
For example, in October 2021, Continental launched the "Cockpit Fusion Sensing" solution. This cockpit sensing system can combine camera data with radar sensors and intelligent algorithms to cover the entire car. After the car is locked, the cockpit sensing technology will pass through the radar Sensors and stored object classification algorithms detect children left behind and sound an alert.
In the future, additional recording and assessment of health indicators (such as pulse, respiratory rate or body temperature) and emotional functions of the driver and passengers will be added. This combination of the two can improve the accuracy of detection and make it even safer!
Wintop Optics representative lenses for DMS application:
Some people may be curious about what is so-called DOMS.
It is actually a combination of DMS and OMS!
Currently, the hardware that implements DMS and OMS functions in a car usually requires two cameras.
In order to save costs, some manufacturers have begun to use a single wide-angle OMS camera to cover functions that originally required a combination of the two.
For example, in September 2022, Eyeris launched an in-car monocular 3D sensing AI solution to obtain additional depth data about the driver, occupants, objects and surfaces through a single 2D RGBIR image sensor. Eyeris uses proprietary technology to accurately return depth information through the 3D output of 2D image sensors and is suitable for all in-car functions.
This technology is mainly collected by collecting natural in-car 3D data and training to run on AI-enabled processors. It is implemented with a computationally efficient deep inference model. For example, the data generated can be used to map a car's interior and accurately identify the location of the occupant's face, body, hands, objects and other objects in the car in three dimensions.
CMS （Camera Monitor System）
The streaming media rearview mirror.
The emergence of car side-view CMS lenses actually replaces traditional rearview mirrors with electronic rearview mirrors, whose main function is blind spot monitoring.
CMS uses electronic means to replace traditional glass mirror reversing mirrors. It has many names, including electronic side-view mirrors, virtual reversing mirrors, electronic reversing mirrors, electronic replacement mirrors, etc. The ISO International Standards Organization calls it a camera monitoring system. That is Camera Monitor System.
Currently, only Japanese and European regulations in the world allow the use of electronic rearview mirror systems instead of glass mirrors. The main European regulations include UN ECE R46-2016"Uniform regulations on the certification of indirect vision devices and vehicles equipped with indirect vision devices" and ISO 16505-2019"Requirements and test procedures for ergonomics and performance of camera surveillance systems".
There is also a regulation IEEEP 2020 Standard for Automotive System Image Quality （vehicle camera image quality standard）. IEEEP2020 hopes that the specification will be tests and issues related to the image quality of all cameras in the vehicle. Both human vision applications and computer vision applications are within its scope. And its main specification is the image quality of the camera imaging system.
Currently, CMS also requires dedicated cameras (HDR), transmission channels, and displays. The camera resolution and frame rate generally can only reach up to 2MP 60fps or 4MP 30fps, and the cost is quite high, and there is still a certain gap in practicality.
For passenger cars, it is very important to first distinguish the difference between Class I mirrors and Class III mirrors.
Type I mirror, also known as electronic interior rearview mirror, mainly uses the rear camera to transmit the video stream captured by the Camera to the rearview mirror in the center of the car for display.
Type III mirrors, also known as electronic exterior rearview mirrors, are mainly used to replace the left and right exterior rearview mirrors of the car body and display the video streams of cameras installed in rear viewing positions on both sides of the car body on the in-car display.
Wintop Optics representative lenses for CMS application:
DVR （Digital Video Recorder）
The function of the driving recorder is similar to the "black box" on an airplane. It records and updates the road conditions in front of, inside and around the car through digital video. Information data includes recording the conditions inside the car, the car’s acceleration, steering, braking, etc. Liability for investigating travel accidents.
Recommended by LinkedIn
If a rear-end collision or pedestrian injury occurs due to a car collision or illegal overtaking, the recorder will provide evidence and record materials and play back the footage through in-car DVDs, mobile phones and other carriers. In order to prevent fatigue driving, the driving recorder monitors the driver's driving time to avoid fatigue driving.
Among the functions of DVR, it is divided into vehicle-mounted front-mounted DVR and rear-mounted DVR. A rear-mounted DVR is generally an independent driving recorder device. It uses audio and video encoding technology to convert and compress the camera data that comes with the DVR and save it in the DVR's storage device.
Since after-installed equipment does not need to meet vehicle regulations and is not included when the car leaves the factory, it needs to be installed later in the auto parts market. Therefore, it can use consumer-grade electronic chips, and its reliability is far less than that of vehicle regulations. level requirements.
The front-mounted DVR needs to meet the car-level standards and has been installed when the car leaves the factory. Its service life and reliability need to be in accordance with the car-level electronic standards, because usually, the front-mounted DVR does not need to set up a separate camera but can directly reuse the camera in the ADAS autonomous driving domain. Generally speaking, DVR can save the image data of the forward wide-area camera （FOV up to 120°） + SVC 360 surround camera.
Wintop Optics representative lenses for CMS application:
SVC （Surround View Cameras）
Car panoramic cameras generally have 4, used for panoramic parking.
It is generally arranged at the front of the car (forward-facing), the rear of the car (rear-facing), the left rearview mirror (left-facing), and the right rearview mirror (right-facing). SVC is a multi-camera system that allows the driver to have a 360-degree view of the vehicle's surroundings in real time. This system uses a display image synthesis algorithm to fuse the perspectives of multiple cameras to obtain a "God's perspective" of looking around the vehicle from a high place.
SVC also mainly belongs to the ADC automatic driving domain, because for parking assistance systems, SVC cameras are needed to help perceive the parking space and surrounding environment. Therefore, the SVC 360 Surround View Camera is also called Parking Assistance Camera.
Friends who have driven a car have some pain points, especially when reversing, you need to see six directions and listen to all directions. Even if there is a reversing rear view and reversing radar, you still need to pay attention to the environment on both sides at all times, so at the beginning, the 360 panoramic view The pain point of the image is to solve the problem of parking by seeing the image in all directions.
Since it needs to be spliced into a 360° image, three cameras can theoretically be spliced, but the location on the vehicle is inconvenient and can basically only be placed on the roof. At the same time, the software algorithm is difficult to splice. It has also increased, so currently it requires at least 4 cameras, and a wide FOV wide-angle camera is required.
Installation location: vehicle logos on the front and rear （or near）, and a set of cameras integrated on the left and right rearview mirrors. Surround cameras are used to identify parking lane signs, road conditions and surrounding vehicle conditions, and use images from multiple cameras for splicing to provide 360-degree imaging for vehicles, because of the need to detect the surrounding conditions of vehicle sounds, it is generally installed at the front of the vehicle, such as the logo or grille.
Automotive Surround View Camera features:
Fisheye panoramic lens,360camera images are mainly used by drivers. The accuracy requirements of this image are not that high, and the observation distance is relatively close, so the pixel requirements of the image are not that high, and the higher the pixels, the better the processing power of the processor is also higher. Currently,360surround-view cameras are all cameras with 100W-200W pixels, which can completely meet the requirements.
Wintop Optics representative lenses for SVC application:
ADAS （Advanced Driver Assistance System）
The front-view camera is the core camera of ADAS, covering ranging, object recognition, road markings, etc. Therefore, the algorithm is complex, and the threshold is high. Therefore, to see whether a car vision algorithm is good or not, it directly depends on whether it has the ability to use multiple front-view cameras.
ADAS camera features:
It can provide early warning for lane deviation and collision.
For small cars (typically passenger cars, online ride-hailing, etc.), the front-view （ADAS） camera should be installed in the middle and upper part of the windshield, near the bottom of the rearview mirror, within a range of 10cm to the left and right of the vehicle's central axis.
For medium and large vehicles (typically commercial vehicles, such as buses, dump trucks, etc.), the front-view （ADAS） camera should be installed in the middle of the windshield, close to the bottom, within 10cm to the left and right of the vehicle's central axis.
Although ADAS and DMS have similarities, they have completely different purposes. ADAS helps drivers and provides vehicle safety. It scans the external environment for potential hazards, such as pedestrians and other vehicles. ADAS pays more attention to the behavior of the vehicle. , while DMS mainly focuses on driver behavior. DMS can be used to assist and supplement ADAS to complete vehicle safety monitoring.
Wintop Optics representative lenses for CMS application:
In addition, about the camera architecture of SVC （surround view camera） and RVC （rear view camera）.
Since the camera is placed outside the car, it needs to have good waterproofing requirements. At the same time, it needs long-distance transmission and requires video transmission chip transmission. It usually uses coaxial transmission. FVC （front view camera） is also a front-view camera.
This type of camera generally does not need to be assembled into a complete camera product. It is usually used in the car. It only needs to ship the camera module. The waterproof requirement is also low, and the transmission distance to the CPU is also short. MIPI signal transmission is generally used. it can be transmitted to the CPU end through short-distance transmission via FPC wire, and both cost and performance can be guaranteed.
The FOV angle required by the front-view camera is not large. Generally, the H direction is about 40-50° and the frequency is 30-60HZ. It requires a high-dynamic camera of 100db. The pixels are generally between 100W-200W. The mainstream Still a 100W camera.
Since the distance you need to see when reversing is not far, the angle range you focus on should be wider to facilitate the line of sight when reversing, so the FOV angle should reach H greater than 130°, and the pixels must also be greater than 100W pixels when viewed on the display. The images obtained are only high definition.
Since the camera here is used for reversing and rear view, generally from a cost perspective, a wide dynamic camera is not used. It only needs to be greater than 70db, and the refresh rate of the camera only needs to be above 30HZ.
The indicators of the surround-view camera are very similar to those of the front-view camera. They both require wide dynamic range. At the same time, the transmission interface is also based on the GSML transmission protocol. The FOV viewing angle is very large. Because image splicing is required, the viewing angle here needs to be H greater than 170°, which is very A wide-angle camera requires a refresh rate greater than 30HZ.
Road vehicle driving safety is receiving more and more attention. As a company that has been engaged in the production and R&D of vehicle camera lenses for 17 years, Wintop Optics, although it only provides a small lens for vehicle safety systems, also hopes to make its own contribution to road safety.
See you next time!
Nicole Yu
Email: nicole@yuntal.com
WhatsApp/ WeChat: +86 13966970253