At the sixth Digital China Construction Summit, Zhang Yong, chairman and CEO of Alibaba’s Board of Directors and CEO of Alibaba Cloud Intelligence Group, revealed that Alibaba Cloud engineers are experimenting with connecting the Thousand Questions large model to an industrial robot, and entering a human language in the Dingding dialog box can remotely direct the robot to work.
A demonstration video released by Alibaba Cloud on the same day shows the results of this experiment. “I’m thirsty. Let’s get something to drink.” After the engineer gave the robot instructions through the Pegging dialog box, the big model replied, “OK, I’ll find something to drink.” Then, the large model automatically wrote a set of code in the background to send to the robot, the robot began to recognize the surrounding environment, find a bottle of water from the nearby table, and automatically complete a series of actions such as moving, grasping, and distribution, and delivered to the engineer.

1746-HSCE

Alibaba Cloud engineers said that the robot was able to complete some fixed tasks set by humans before, but it could not perform some tasks that needed to be “random”, “AI big model broke through the limitations of robots, so that humans can direct the machine to complete the task through natural language, so that the robot really has a brain.”
According to Alibaba Cloud engineers, large models can play an important role in both the development and application stages of robots. For example, in the production operation, Qianwen grand model provides the ability of reasoning and decision-making for the robot to perform tasks. Front-line workers only need to send a text, Qianwen can understand its intention to conduct task reasoning, and automatically translate it into code that the machine can understand, and command the machine to perform tasks, effectively improving production efficiency.

“Manufacturing is an important battlefield for AI big models,” Zhang said. “The biggest opportunity in the next 10 years is the integration of cloud, AI and machines in the physical world. Robots fetching water is just the first step.