Remote Operation

Trend Overview

Impact:

Low

Adoption:

< 5 Years

Focus Areas:

Sustainability Health, Safety & Future of Work Physical & Digital Security

Trend Clusters:

Bionic Enhancements Robotics

Sectors:

The trend of Remote Operation refers to the use of telecommunications technology to remotely control and operate devices or machines located in a different physical location from the operator. This can include the use of remote control devices, sensors, and other technologies to transmit data between the operator and the machine.

The global remote operation market was estimated to be US$ 403 million in 2022 and is expected to reach $3.19 billion by 2032 at a compound annual growth rate (CAGR) of 23.1%. Key drivers of this market include the growing adoption of industrial automation, rising demand for unmanned vehicles and drones, the development of these types of autonomous vehicles, and the growing trends of smart manufacturing and Industry 4.0.

These developments are driven by advances in artificial intelligence (AI) and machine learning (specifically their integration which enables predictive analytics, autonomous decision making, and adaptive control systems) and connectivity improvements in 5G and other networks and low-latency communication technologies (facilitating real-time remote operations with reliable connectivity). In addition, advances in computer vision and sensor technology are paving the way for application in an ever-widening range of scenarios; for example, remote operation of various robotic arms and hands to tackle different manual tasks.

The ability to operate a system or machine at a distance is already proving useful in a broad range of applications. In logistics, it supports remote operation of unmanned forklifts, tuggers, yard trucks, and robots. In healthcare, it enables remote surgeries, patient care, and precise interventions. For manufacturers and companies involved in mining, it allows remote operation of heavy machinery and equipment, sometimes for intricate operations, in hazardous and what can be remote environments. The automotive industry uses telerobotics for testing, quality control, and even autonomous vehicle operations. In agriculture, remote operation systems support remote handling of robots for crop monitoring and spraying. And, in space exploration, these systems enable astronauts to explore uncharted territories, conduct experiments, and repair equipment remotely.

The adoption timeline for this trend in logistics is within the next five years. With the increasing uptake of unmanned vehicles and robots in warehouses and logistics operations, a cost-effective and safe way to monitor and use these assets is through remote operation, whenever possible and reasonable.

The impact of remote operation on the logistics industry will be rather low. While ways of working will continue to change, the supply chain will not be significantly affected. With a shifting demographics in the workforce (with older workers retiring and digital natives entering the workforce), the possibility of remote operation and remote work has broader appeal to the younger workforce and opens an even wider pool of talent.

Driverless Vehicle remote operation

Source: EE Times (2023): Next Time You Hear 'Teleoperation,' You'll Know a Lot More

Relevance to the Future of Logistics

Remotely Controlled Vehicles

The COVID-19 pandemic made the option of remote work essential across businesses and functions. This presented technology providers with an opportunity finding ways to maintain operations while also ensuring employee safety in various environments.

Examples of remotely controlled vehicles include material-handling forklifts, tuggers, and the like. Solutions from Phantom Auto as well as Teleo allow one person to control multiple machines, with supervised autonomy, from the comfort of a command center.

Germany has its first remote-controlled inland waterway shipping center, a Seafar solution that enable captains on dry land to remotely navigate vessels on inland waterways. In another solution, Europe’s first smart railway logistics terminal, East-West Gate located in Hungary, leverages the 5G network and AI. One worker can control four cranes at the same time from an office location, boosting efficiency by 20% and attracting new people to the role of crane operator. Similarly, remote operations will enable truck drivers to steer vehicles from their desk, making the job more attractive by creating a better work-life balance and providing a safer workplace.

Next use case

Remote Controlled Operations Using Digital Twins

Further efficiency in remote operations can be achieved by using digital twins. A virtual representation of the physical elements of machinery, facilities, or an entire production system eliminates the need for a human to physically go to a location to undertake any task.

For example, Shell has launched a digital twin initiative at its Singapore manufacturing site, enabling engineers to receive live information on operations via augmented reality (AR) and virtual reality (VR). They can remotely operate troubleshooting on the digital twin before deciding on the best course of action at the actual site.

In another example, a researcher from the University of Edinburgh has demonstrated human-robot interaction, with VR and digital twin-based remote operation of a robotic arm. The researcher used a VR headset to control the robot arm located 320 km (200 miles) away through cloud using VR and deep-learning technology.

Previous use case Next use case

Remote Operations as Safety Fallbacks

Remote operations represent a valuable addition to autonomous driving. Autonomous vehicles require AI models to be trained and it is challenging to ensure each vehicle responds correctly in every different driving scenario. Standard control processes can certainly be performed by AI but, when a situation gets tricky and requires complex decision making, a remote human operator can take over.

A common scenario that may require human intervention is that of a double-parked delivery vehicle. If the autonomous van is prevented from driving over a solid line, it will remain where it is until the remote operator intervenes. Another scenario is when a construction site has not yet been incorporated into the automated system. A remote operator would need to guide all vehicles safely into and out of this location. And a further scenario requiring human intervention is the decision on whether an autonomous vehicle can safely overtake a stalled moving truck that is blocking a lane.

Examples of remote operations as safety fallbacks include the six autonomous yard trucks deployed in the Port of Rotterdam – a pilot project between partners StreetDrone and Terberg to alleviate several hazards and challenges in the port and enable the workforce to move containers with greater precision, efficiency, and safety. The pilot runs until early 2025, after which the partners aim to scale operations rapidly and add several additional autonomous yard trucks to the fleet.

StreetDrone is also partnering with Nissan to trial 40-ton self-driving trucks, aiming to prove last-mile delivery for capabilities. Uniquely, 5G enables the removal of any safety drivers from these vehicles and remote operations will be used to overcome abnormal situations.

Norwegian chemical company Yara and its technology partner Kongsberg have created the world’s first fully electric and crewless cargo ship with zero emissions – MV Yara Birkeland. It uses cloud technologies to provide all required data to an on-shore remote operations office, allowing human takeover if this is ever needed.

Examples of remote operations with autonomous robots include systems created by Sarcos Technology and Robotics Corp that augment humans to improve worker safety and efficiency. In a successful trial for the US Navy, two robot types were remotely operated to work at height both on board and alongside a ship – they performed visual inspections, removed rust and paint, and undertook various other repairs.Meanwhile, up to 2,000 little AI-powered sidewalk food-delivery bots will be deployed across the US via the Uber Eats platform by partners Serve Robotics and Ottopia. A remote assistance platform using remote operation software will enable human operators to monitor the fleet and lend a hand if the bots ever run into a complex or unpredictable safety situation.

Previous use case

Challenges

The absence of physical sensing makes it difficult for the remote operator to take an informed decision on behalf of an autonomous vehicle.

When remotely operating both autonomous vehicles and machinery, the lack of human cognition and perception may present a “blind spot” in situational awareness, spatial awareness, and/or depth perception.

If there is a malfunction that cannot be supported or resolved remotely, this introduces a security and IT risk; a flexible, agile response would be required from the human operator.

It will be challenging for remote operators to maintain their attention over a long period of time, due to the lack of physical stimuli and overwhelming amounts of information.

The absence of physical sensing makes it difficult for the remote operator to take an informed decision on behalf of an autonomous vehicle.

If there is a malfunction that cannot be supported or resolved remotely, this introduces a security and IT risk; a flexible, agile response would be required from the human operator.

It will be challenging for remote operators to maintain their attention over a long period of time, due to the lack of physical stimuli and overwhelming amounts of information.

Challenge 1 Challenge 2 Challenge 3 Challenge 4

Outlook

With a significant rise in demand for autonomous vehicles and growing adoption of remote-controlled operations in logistics, this trend will likely be realized within the next five years.

Remote operations not only improve efficiency and safety when carrying out certain tasks but also address the challenge of labor shortages in the industry by allowing a single remote operator to control multiple vehicles from one location.

This trend should be PASSIVELY monitored,with use cases in some applications that can already be addressed today.