Caterpillar Inc. is collaborating with FieldAI to advance physical artificial intelligence (AI), autonomy and robotics for applications across industrial jobsites and manufacturing environments.
The collaboration combines Caterpillar’s engineering expertise and operational data with FieldAI’s AI-enabled robot foundation models. The companies are focusing on autonomous systems capable of operating in complex and dynamic environments, where conventional automation can be difficult to deploy.
Physical AI refers to AI systems that can perceive and respond to physical environments. In industrial applications, this can enable machines and robotic systems to interpret their surroundings, process operational data and perform tasks with a degree of autonomy.
Initial applications identified by the companies include autonomous inspections, digital twins, enhanced situational awareness and operational optimisation.
Autonomous inspections
Autonomous inspections can provide an alternative means of monitoring equipment, infrastructure and facilities, particularly in environments where inspections may expose personnel to operational hazards. Robotic systems can gather visual and other environmental data for analysis and identification of potential issues.
Digital twins
Digital twins can provide virtual representations of jobsites and manufacturing facilities, incorporating operational data to provide information about equipment, infrastructure and processes. These models can also be used for simulation and analysis before changes are implemented in physical environments.
Enhanced situational awareness
Enhanced situational awareness involves using AI to interpret information from the operating environment and identify potential risks or changes in conditions. This can support personnel in making more informed operational decisions.
Operational optimisation
Operational optimisation uses simulation, automation and AI-based analysis to examine how equipment, processes and workflows perform. Such applications could assist in identifying inefficiencies and evaluating potential changes to industrial operations.
“ The future of our industries will be shaped by how effectively we combine human expertise with AI-powered machines,” said Jaime Mineart, Caterpillar chief technology officer. “Collaborations like this help accelerate the journey.”
FieldAI’s robot-agnostic autonomy and foundation models
Caterpillar has selected FieldAI for its ability to deploy autonomous systems in complex industrial environments. FieldAI’s robot-agnostic autonomy and foundation models are designed to process large volumes of operational and jobsite data.
The collaboration also incorporates NVIDIA accelerated computing, NVIDIA Omniverse technologies and digital twins developed from operational data.
Maintenance and reliability operations
For maintenance and reliability operations, the development is particularly relevant to the increasing use of autonomous inspection, remote monitoring, digital twins and AI-assisted decision-making. The technology could provide additional sources of condition and operational data while reducing the need for personnel to enter potentially hazardous areas.
The companies are applying the technology across Caterpillar’s manufacturing facilities and jobsites as they develop practical industrial applications for physical AI and autonomous systems.
