On April 16, the Create 2024 Baidu AI Developer Conference was held in Shenzhen International Convention and Exhibition Center. The conference invited nearly 10,000 top developers and industry leaders at home and abroad to participate, focusing on hot AI topics and demonstrating the world’s leading AI technologies. Youbi humanoid robot Walker S “parachuted” to the scene, and Baidu AI large model “group debut”, the first offline joint demonstration of China’s AI large model + humanoid robot innovation application.

80MPD5.300S000-01 Through Baidu Intelligence Cloud Qianfan AppBuilder platform access to Baidu Wenxin large model, UBI selection robot Walker S smart “understanding” to “collect things” and deliver fruit instructions, but also to provide the experience of eating orange “health tips”, so that the visitor is refreshing. At the scene, Baidu founder, chairman and CEO Robin Li personally visited the museum, and also received an AI content full of oranges as a greeting gift.

According to reports, Walker S shows the deep integration of embodied intelligence technology, including multi-modal large model, multi-modal perception, reasoning tasks, decision planning and other aspects, and its innovative application and realization difficulty belong to the industry’s first echelon level in the world. When completing tasks such as collecting things and delivering fruits, Walker S obtains spatial positioning and semantic information by relying on the end-to-side multi-modal perception model, and then hands the information to the Wenxin large model for task understanding and planning, cooperating with the precise operation of the robot arm and dexterous hand, and successfully completing the full set of task processes.

80MPD5.300S000-01

Walker S demonstrates the innovative application of AI large model + humanoid robot

At the same time, with the “blessing” of the Wenxin large model, Walker S will conduct semantic analysis of the “heard” human speech data, and understand objects and people in the environment in real time according to visual feedback, so as to realize intelligent voice interaction and answer random questions intelligently.

The live audience interacts randomly with Walker S

80MPD5.300S000-01 The offline display of the fusion application of Walker S humanoid robot and Baidu Wenxin large model technology shows that the intelligence technology of the body is gradually moving from the research environment to the real world scenario application. In the future, Baidu and Youbi will also explore cooperation in data sharing and model training optimization, digital twin and virtual reality, cross-field application expansion and other aspects, jointly promote the co-evolution of China’s AI large model + humanoid robot, promote the close interaction between scientific and technological innovation and industrial innovation, and prepare for the high-quality development of new quality productivity.