Compared with ordinary vehicles, special vehicles are tall and long, which are easy to cause traffic accidents due to visual blindness. A special vehicle manufacturer in order to improve the driving safety of special vehicles, on the basis of the original excellent mechanical properties, the introduction of new technology to achieve product intelligent look around. In conjunction with its pursuit of specialty vehicle safety, the company decided to develop a new vehicle safety solution that integrates 360° circumnavigation and AI image recognition.

In order to realize the 360° round-view function, the control host needs to access multiple high-definition cameras to obtain real-time road conditions, and through processing, the multiple images are spliced and corrected, and finally presented on the display device. The scheme further introduces AI for image recognition to help drivers drive safely. However, as a traditional special vehicle manufacturer, the manufacturer lacks the development capability of 360° circumnavigation and AI image recognition, and needs suppliers to provide complete circumnavigation AI solutions. At the same time, the working environment of special vehicles is complex, so it is also necessary to use seismic, wide temperature design to resist violent vibration, the influence of high and low temperature of the working environment.

While searching for a solution, they learned that Advantech is widely used in the vision related unit ROM-5880 industrial-grade core module solution. With Advantech’s mature AI algorithm development capabilities and existing vehicle circumnavigation solutions, the two parties further confirmed the cooperation of the project.

Challenges faced

DS200TCPDG2BEC

Real-time HD camera access

Image data splicing processing capability

Wide temperature x vibration protection

AI algorithm and computing power support

The use of Arm platform NPU

Car gauge products long life cycle supply

02 Advantech Solutions

Based on the above challenges, Advantech sorted out the requirements of the company’s vehicle compatible models, equipment use scenarios and so on. After several rounds of exchanges and cooperation, the two sides gave full play to the advantages of their respective fields and jointly designed the preliminary hardware program. The hardware scheme adopts ROM-5880 core module, which can access MIPI camera, support 4K H.264/H.265 video decoding, and realize fast image processing. At the same time, it is equipped with 1 Tops AI computing power NPU to meet the needs of image recognition. At the same time, the ROM-5880 core board solution can pass the 3.0Grms vibration standard test and support a wide temperature of -40 to +85°, ensuring the stable operation of special vehicles in harsh environments. In addition, Advantech provides customers with four fisheye camera access schemes, front, rear, left and right, through the four-way AHD fisheye camera data input to the MIPI-CSI on ROM-5880 to collect vehicle circumnavigation image data, and then output 360° circumnavigation image through the software solution developed by Advantech. At the same time, in terms of AI, based on the existing AI vision algorithm model and the image database provided by customers, Advantech has helped customers complete the application of a complete set of AI vision solutions from AI model selection to training and deployment. In terms of OS, Advantech’s unique JelinaOS meets the needs of secure networking updates, rapid deployment models, and continuous optimization iterations.