$$\rightleftharpoonup{xx}$$
$$\longleftharp{xx}$$,
$$\longrightharp{xx}$$,
All experiments involving operators were conducted in accordance with safety guidelines. The teleoperation experiments were conducted by three trained operators (all right-handed, with at least 1 h of training) who are members of the research team. No external human participants were recruited, and this study did not require institutional ethics review. Volunteers were informed of the experimental procedures, and no personal or sensitive data were collected during the study.
Shared control framework
In live-line working scenarios, factors such as the irregular bending of power lines, the loss of depth information caused by complex outdoor lighting, and the random movement of power lines create a highly unstructured and dynamic environment. These factors make it difficult for the robot to accurately recognize and locate power lines within the environment. Consequently, relying entirely on autonomous robot operation would lead to task failure.
To address the limited adaptability of fully autonomous robot operations, human operators intervene in the robot's decision-making process via teleoperation, leveraging human experience to help the robot adapt to the environment. Furthermore, to address the issue of excessive frequency of reference trajectory input by the human operator during teleoperation, a human-robot shared control method is studied. This method reduces the dependency of the actual trajectory on the human operator, thereby alleviating the operator's mental burden and achieving an effective combination of human intelligent decision-making capabilities and the robot's high-precision control capabilities.
The structure of the teleoperated distribution live-line working robot based on shared control proposed in this paper is shown in Figure 4. Where xh is the trajectory point output by the teleoperation device, rh is the reference trajectory point provided by the human operator (mapped to the Cartesian space of the manipulator), rr is the reference trajectory point autonomously planned by the robot, serving an auxiliary role. r is the integrated reference trajectory point sent to the slave manipulator (which is referred as the Shared Trajectory in the following text), fo is the raw data collected by the force sensor at the end of the manipulator, fe is the contact force between the tool set at the end of the manipulator and the environment after gravity compensation and x is the current pose of the manipulator.
The teleoperated distribution live-line working robot is divided into two parts: the master side and the slave side. The master side is located on the ground, where the human operator controls the movement of the teleoperation device. By receiving the force feedback from the device rendered to the operator's hand, and information fed back by the vision system, the operator achieves immersive operation. The slave side is the robot located at an elevated height. After receiving the pose xh from the master side, the robot performs spatial mapping to obtain rh, and feeds the collected visual and haptic data back to the master side.
Due to the incomplete alignment of perception between the robot and the operator regarding contact forces, targets, and obstacles in the actual environment, the operator must maintain intense concentration to minimize the risks of rh. To reduce the dependency of r on rh and alleviate the mental burden on the operator during long-duration operations, the robot needs to autonomously plan an auxiliary trajectory rr that is approximately the shortest path and safe based on perception information that contains real-world errors. This rr is then linearly weighted with rh to obtain r, which is commanded to the manipulator as the target pose.
Motion spatial mapping
The incremental method was used to calculate the trajectory increment Δxh given by the human operator:
Δxh = xh - x′h (1)
where x′h is the pose at the starting point of the teleoperation. For live-line working robots where the motion spaces of the master side and slave side have significant differences, incremental mapping allows the operator to arbitrarily choose a convenient pose and set it as the teleoperation starting pose.
The trajectory increment, Δxh was then mapped into the Cartesian space of the slave side robot to finally obtain rh. The mathematical expression for this mapping is as follows:
Δrh = Δxh * k, rh = x′ + Δrh (2)
where k is the linear mapping parameter and x' is the pose of the manipulator at the starting point of the teleoperation.
Autonomous trajectory planning
The autonomous trajectory planning process uses linear interpolation to calculate the shortest trajectory rr from the current pose to the target pose P. The calculation process is as follows:
(3)
where P is the target point is calculated by the vision system, which includes a binocular camera and a stereo laser LiDAR. The calculation can be performed by selecting points with the mouse and transforming the coordinates using the hand-eye calibration matrix. N is the number of interpolation points, and i is the sequence number of the interpolation point. It should be noted that under complex lighting conditions, P calculated by the vision system contains errors, which prevents rr from completing the task independently.
Shared control method
In order to combine rh's adaptability to the environment and rr's efficiency, it is necessary to design a shared controller that integrates two trajectories. The shared controller uses fixed parameter arbitration weights α, and the implementation process is as follows:
r = (1 - α) * rr + α * rh (4)
Abrupt operation behavior detection method
During the process of remote teleoperation, there may be erroneous behavior caused by the operator, leading to abrupt changes in the trajectory, which can even cause a collision with the environment. In order to ensure the safe and smooth movement of the manipulator on the slave side, it is necessary to detect and handle such excessive teleoperation behavior on the master side. The shared control algorithm flow, including abrupt behavior detection, is shown in Figure 5.
Teleoperation system construction
The live-line work environment is characterized by being highly unstructured and dynamic. Consequently, robots cannot rely solely on their autonomous perception and decision-making capabilities to complete tasks; they must be augmented by human intelligence. Teleoperation presents an effective technique for integrating human intervention into the robot's trajectory planning process. In such a system, the master side involves an operator controlling a teleoperation device on the ground, while the slave side at height consists of multiple subsystems.
This study details the development of a teleoperation robotic system specifically designed for distribution network operation, with the goal of performing live-line tapping tasks.
Introduction of the teleoperated robot system
The teleoperation system includes the perception subsystem, control subsystem, manipulator subsystem, tool subsystem, insulation carrier subsystem, and master side human-robot interaction devices. The detailed usage of each subsystem carried by the robot in the system is shown in Table 1, and the hardware system is shown in Figure 6.
Perception subsystem: The subsystem is responsible for providing 2D RGB images and spatial depth information to guide the robot's motion and ensure operational safety. To achieve this, it is equipped with a laser LiDAR for large-scale environmental modeling at long distances; a binocular camera for high-precision target recognition and localization at close distances; a pan-tilt-zoom (PTZ) monitoring camera to provide an operational view and feed it back to the operator throughout the entire process. Furthermore, a force sensor is integrated to perceive external forces and provide force feedback to the human operator, which helps prevent system shutdowns caused by excessive contact forces between the robot end and the environment.
Manipulator subsystem: As the primary executor of tasks, this subsystem consists of two manipulators arranged in a homogeneous dual-arm configuration.
Control subsystem: As the core subsystem of the live-line working robot, it functions as the platform's computational, control, and energy supply center, responsible for dispatching operational commands to all other subsystems. To achieve insulation and safety isolation from the ground side, the power module utilizes an independent power supply on the elevated platform. It employs a 48V DC supply for both power and drive control, which reduces inversion losses and consequently minimizes the volume and weight of the power system.
End-effector subsystem: Specialized end-effectors (tools) are mounted on the end of the manipulator to execute specific operations. A series of specialized tools with standard interfaces has been developed for different tasks. For distribution network operations, these include a stripping tool and a crimping tool (as shown in Figure 7), where the stripping tool uses three 80 W, 450 nm wavelength laser generators with a focal spot size of 130 × 180 µm, modulated via 5 V PWM. The average operation time for stripping a 120 mm section on a distribution cable with a diameter of 18–24 mm is approximately 2 min at full rated power under ambient temperature conditions. The crimping tool is responsible for securely fastening the tap conductor wire to the main power wire with a clamp, thereby establishing electrical continuity.
Insulated carrier subsystem: This subsystem is used to transport the robot to the elevated work position. It typically consists of a crawler-type or wheeled insulated aerial work platform (also known as a bucket truck). To enable integrated control of the entire robotic system, it has digital control capabilities (as shown in Figure 8).
Master side human-robot interaction subsystem: During operation, the human operator issues commands to the robot system via a handheld tablet, PC, teleoperation handle, and other computing devices. These devices reproduce the sensor data, which includes vision and contact force fed back from the robot, allowing the operator to monitor the robot's status in real-time, and also map the motion of the operator's hand to the end of the manipulator. The communication links between the subsystems are illustrated in Figure 9.
Teleoperation devices
In this system, the master and slave devices for teleoperation are the haptic device and the manipulator, respectively. The Denavit-Hartenberg (DH) parameters for each will be introduced.
As shown in Figures 10A,B, these are the link coordinate frames of the manipulator. For the six revolute joints of the manipulator (L1,L2,L3,L4,L5,L6), a coordinate frame is established for each joint according to the right-hand rule and the principles of the Denavit-Hartenberg (DH) convention.
In Figure 10B, x1∼x6, y1∼y6, z1∼z6, represent the x,y,z axes of each joint's coordinate frame, respectively. Based on these established link frames, the forward kinematics model of the manipulator can be created. The DH notation uses four parameters: ai, αi, di and θi.
These parameters are defined as follows, ai: represents the distance from moving the z-axis of the i-th rod along its x-axis to the z-axis of the (i+1)-th rod; αi: refers to the angle of rotating the z-axis of the i-th rod around its x-axis to the z-axis of the (i+1)-th rod; di: represents the distance from moving the x-axis of the i-th rod to its x-axis along the z-axis of the i-th rod; θi: refers to the angle of rotating the x-axis of the i-th rod to its x-axis around the z-axis of the i-th rod.
The kinematic model is established using the DH parameter method, and the DH parameters for the manipulator are shown in Table 2 below.
The teleoperation handle is the haptic device used as the master manipulator, whose joints are configured in a serial chain. The joint coordinate frames are shown in Figure 10C; the modeling method is the same as that of the slave manipulator.
Experiments design
To quantitatively validate the proposed shared control algorithm before field deployment, we conduct two laboratory experiments on a 6-DOF manipulator teleoperation platform operating at 50 Hz, which was achieved by a Python script running on a standard PC. At each control cycle, the script reads the master-side pose, computes the shared trajectory, and sends the target Cartesian pose to the manipulator. A fixed interval of 20 ms is enforced between consecutive commands, yielding an update rate of 50 Hz, which is the same as the laboratory platform. The laboratory platform shares the same control architecture and shared control algorithm (Equation. 4) as the live-line working robot described in the teleoperation system construction, differing only in manipulator kinematics and workspace scale. A simulated tapping task is used: in the presence of obstacles (a water bottle and an aluminum column), the operator controls the manipulator end-effector from a start position A to a target position B, mimicking the wire-tapping operation, which is shown in Figure 11. To ensure the exact repeatability of the laboratory experiments, the physical obstacles and the target endpoint were precisely positioned within the slave manipulator's base coordinate system. Two primary obstacles were installed in the workspace: a plastic water bottle (base dimensions: 8 cm × 8 cm, height: 25 cm) placed with its bottom center at coordinates (X = 55 cm, Y = 5 cm), and an aluminum profile (base dimensions: 2 cm × 2 cm, height > 50 cm) placed with its bottom center at coordinates (X = 35 cm, Y = -30 cm). The target endpoint for the teleoperation task was set at coordinates (X = 50 cm, Y = -17 cm, Z = 26 cm). Subsequently, the validated algorithm is deployed on the live-line working robot for field demonstration.
The experimental procedure is conducted through a continuous, integrated workflow. First, during system initialization, both the slave and master manipulators are powered on, and the control software is launched to verify stable bilateral communication at a frequency of 50 Hz. To prevent sudden control jumps at the onset of teleoperation, a master-slave alignment phase is performed prior to active teleoperation. In this phase, the operator manually guides the master manipulator until its end-effector Cartesian position (defined in the master's base frame) lies within 30 mm of the slave manipulator's current end-effector Cartesian position (defined in the slave's base frame). These Cartesian positions are obtained directly from the built-in controller feedback of each manipulator, while the control software monitors their Euclidean distance in real time. Once this alignment succeeds, the current slave position is recorded as the start position, denoted as position A. Subsequently, target specification is carried out by having the operator manually guide the slave end-effector to the desired goal location to record its Cartesian coordinates, which are designated as target position B. The autonomous planner then generates a linear reference trajectory extending from the start position toward position B. Following this, the operator initiates the shared control teleoperation task. During active execution, the system operates at a 20 ms control cycle, continuously reading the master position as input, performing an online check to detect any abrupt operator behaviors, computing the shared control trajectory as output (as formulated in Equation 4), and issuing corresponding commands to the slave manipulator. As a safety measure, if an abrupt movement is detected, the slave manipulator immediately freezes and holds its last valid position in a dedicated position-hold mode; to recover from this state and resume shared control teleoperation automatically, the operator must manually move the master manipulator back until the master-slave end-effector Euclidean distance falls below a 20 mm recovery threshold. Finally, the trial is completed and deemed successful when the slave end-effector reaches and remains within 5 mm of target position B.
Experiment 1: abrupt operation behavior detection
This experiment validates the detection mechanism on the laboratory platform. During teleoperation at 50 Hz, the per-frame displacement of the master end-effector is monitored. When it exceeds Dth = 6 mm/frame (instantaneous velocity 300 mm/s), the system enters FROZEN state: the slave manipulator ceases tracking and holds its last valid configuration. The slave remains frozen until the operator returns the master to within 20 mm of the frozen position.
Experiment 2: Shared control performance comparison
Three arbitration weights α=0.3, α=0.8, α=1.0 are compared on the laboratory platform, as documented in the Supplementary Video 1, Supplementary Video 2, and Supplementary Video 3. A total of 45 experimental trials were conducted, involving three operators performing five repetitions under each of the three arbitration conditions. The system performance was assessed using three key evaluation metrics. First, completion time T: Total duration from the first operator input to the slave end-effector reaching the target position B; shorter time indicates higher operational efficiency. Second, trajectory efficiency η=Lstraight/Lactual, where Lstraight is the Euclidean distance from the start position A to the target position B, and Lactual is the total path length traversed by the slave end-effector during the trial, η=1 indicates a perfectly efficient, direct path; lower values indicate more redundant, detour-laden motion. Third, submovements count Nsub represents the number of distinct movement segments, which is computed by counting zero-crossings in the smoothed speed profile of the master end-effector; a smaller count indicates a more continuous, confident operation with lower cognitive load on the operator. Finally, statistical significance across the three arbitration conditions is assessed using the Kruskal-Wallis H-test, with pairwise Mann-Whitney U-tests employed for post-hoc comparisons.
Experiment 3: Field deployment
Following laboratory validation, the shared control algorithm (α=0.3) and abrupt behavior detection are deployed on the live-line working robot described in the teleoperation system construction.