Abstract
This paper is devoted to the control of aerial robots interacting physically with objects in the environment and with other aerial robots. The paper presents a controller for the particular case of a small-scaled autonomous helicopter equipped with a robotic arm for aerial manipulation. Two types of influences are imposed on the helicopter from a manipulator: coherent and non-coherent influence. In the former case, the forces and torques imposed on the helicopter by the manipulator change with frequencies close to those of the helicopter movement. The paper shows that even small interaction forces imposed on the fuselage periodically in proper phase could yield to low frequency instabilities and oscillations, so-called phase circles.
Keywords
1. Introduction
Aerial manipulators are a particular class of Unmanned Aerial Systems (UAS) physically interacting with the environment. Other classes include aerial slung load transportation and deployment as in Bernard et al. (2011), perching for refuelling and battery recharging remote inspection by contact as in the European AIRobot (http://www.airobots.eu/) project and the cleaning of windows or walls by applying forces while maintaining flight stability that can be found for example in Albers et al. (2010).
Free flying robots with some manipulation capabilities have been proposed for space applications since the 1980s. These applications include inspection, assembly, capture, repair and maintenance capabilities in orbit. Unlike fixed-based robots, the base body of free flying robots is allowed to respond freely to dynamic reaction forces due to the motion of the arm or arms. In these systems there is a dynamic coupling between the motion of the arm (or arms) and the base. Also the joint control torques are limited due to actuator weight constraints in space.
The kinematics and dynamics of free-floating space manipulator systems were described 25 years ago using the virtual manipulator approach in Vafa & Dubowsky (1987; 1990). In Umetani & Yoshida (1987), a generalized Jacobian matrix that reflects both momentum conservation laws and kinematic relations is used to study rigid space manipulators with revolute joints by assuming that no external forces are applied. This generalized Jacobian converges to the conventional Jacobian of the manipulator when the base is relatively massive. In Caccavale & Siciliano (2001), the generalized Jacobian is used to study the inverse kinematics. In Moosavian & Papadopoulos (1998), approaches for the kinematics modelling of a multibody space robotic system are presented. In Moosavian & Papadopoulos (2007), a review of dynamic modeling, planning and control problems for free flying robots in space is presented.
Recently, several researchers have been proposing unmanned aerial systems with grasping capabilities. In Pounds & Dollar (2010), a small RC helicopter with a gripper is able to grasp an object on the ground while in flight by means of a underactuated compliant gripper mounted ventrally between the aircraft's skids. In Pounds et al. (2011), the stability of the helicopter in contact with the object and/or the ground is studied. In particular, the longitudinal dynamics is studied and the payload effect is modelled by means of a pitch moment.
In Mellinger et al. (2010), grasping and cooperative transporting loads with quadrotors is presented. Furthermore, in Mellinger et al. (2011), several lightweight, low-complexity grippers that allow quadrotors to grasp and perch on branches or beams and pick up and transport payloads are presented. The inertial parameters of the grasped object are estimated and used to adapt the controller and improve performance during flight.
Reference Lindsey et al. (2011) presents structure construction experiments by means of indoor quadrotors with grippers.
In Korpela et al. (2012), a hybrid quadrotor-blimp prototype to test some aerial manipulation concepts is presented. In Orsag et al. (2012), the challenges in controlling a mobile manipulating UAV using a commercially available aircraft with three light-weight arms each with two degrees of freedom (DoF) is investigated.
Section 2 introduces general concepts related to aerial manipulation in the context of the European FP7 project ARCAS. The particular case of an autonomous helicopter equipped with a hand that can be used for general manipulation tasks is presented. Section 3 discusses control systems for aerial manipulation. In Section 4 the closed-loop behaviour is analysed and some simulations are presented. Section 5 closes the paper with the conclusions.
2. Aerial manipulation – the ARCAS project
In a broad sense, aerial manipulation involves a large number of functionalities from taking sole probes and picking up objects, to performing assembly operations involving force interactions with the objects.
The limitation in payloads and in general of take-off weight is a main concern and implies manipulators with reduced working space or even with less than six degrees of freedom (DoF). Therefore, it is desirable to increase the helicopter positioning precision in order to facilitate the manipulation task or even to realize some DoF of Tool Centre Point (TCP) of the manipulator by moving the helicopter fuselage.
Figure 1 shows an aerial manipulator system comprising a helicopter and a manipulator mounted on the fuselage. The task of this system is to fly close enough to the object to perform a manipulation task. The helicopter is equipped with a position sensor (e.g., GPS) and an orientation sensor (e.g., IMU) for estimation of the fuselage position and orientation in an inertial frame. The on-board perception system can be used for precise positioning and to track the position and orientation of the object with respect to the TCP.

Scheme of the system for aerial manipulation based on an autonomous helicopter.
As mentioned above, one of the main limitations in aerial manipulation is the payload of the Unmanned Aerial Vehicle (UAV). In order to overcome this limitation, the ARCAS project aims at the development and experimental validation of the first cooperative flying robot system for assembly and structure construction. In addition to the payload limitation, the adoption of several unmanned aerial aircraft instead of a single powerful one presents advantages such as enhanced manipulation capabilities, increased reliability and reduced costs.
In ARCAS both helicopters and quadrotor systems with arms, manipulation and perception devices are being developed.
Figure 2 shows the first helicopter-based set-up for experimenting on precision positioning helicopter control. This set-up is composed of an electrical helicopter with the take-off weight of 15 kg and the rotor diameter of 2 m. The helicopter is equipped with a mechanical hand mounted on a cardan joint that compensates the roll and pitch angles of the fuselage. The cardan joint will be replaced by a manipulator with five DoF.

Experimental set-up for precision control with integrated vision system.
A perception system has been integrated on the helicopter for precise positioning, tracking and guidance of the assembly operations. Alternatively, in ARCAS, the environment perception system can be carried out by other UAS by implementing cooperative perception systems. The integration of the information from multiple aerial robots will also be used in range-only Simultaneous Localization and Mapping (SLAM) techniques.
ARCAS also includes the development of coordinated control of multiple cooperating aerial systems grasping the same object and cooperative planning for assembly, disassembly or inspection tasks by maintaining the safety in the simultaneous operation of multiple flying robots. The ARCAS architecture will integrate autonomous perception, planning and control with the intervention of human operators by using virtual reality haptics.
ARCAS experiments with autonomous helicopters as shown in Fig. 2 are being performed in an outdoor scenario in order to demonstrate advanced manipulation and assembly capabilities with integrated force/torque sensors. Moreover, indoor experiments are being performed with autonomous quadrotors and the VICON system for positioning to test basic manipulation and assembly functions with simple and light devices satisfying the payload constraints of the indoor quadrotors.
ARCAS is also targeting industrial inspection, maintenance and repair scenarios, as well as space applications with free-flying robots.
3. Control systems
Figure 3 shows a basic control scheme composed of an inner loop for orientation control, R ori , and an outer loop for position control, R pos . The output of the perception system – position of the object relative to the helicopter – is integrated at the input side of the outer loop. The performance of the whole system is given by the performance of the main controller. The combination of linear controller with non-linear dynamical and kinematical inversion blocks are used. More detail on the main controller can be found in Kondak et al. (2007).

Control scheme used for experimental set-up.
Using this set-up in the flight experiments it was possible to validate that the grasping of a simple object is even possible without translational movement of TCP relative to the helicopter fuselage.
The autonomous manipulation can be decomposed in the following phases:
Approaching phase. The helicopter is guided to some position not far from the object. The control system uses the GPS, eventually with the differential corrections (DGPS). If the position of the object is not known, the perception system on board the aerial robot (see Fig. 3) should be able to detect and localize the object. In the ARCAS project, radio systems with a transmitter embedded in the object are also being used.
Precise positioning control. In this case the perception system can be used to calculate the position and orientation of the object, and grasping configurations. The output of the vision system was used only to calculate the appropriate desired position of the helicopter (see Fig. 3). The lack of reliability of the perception system in outdoor scenarios should be analysed. In particular, it is well-known that vision systems are significantly affected by environmental problems such as occlusions and variability of lighting conditions. If the pose of the object is known, sensor data fusion with DGPS is very valuable. With ideal weather conditions, we could achieve a precision of TCP positioning up to 1 cm.
Manipulation control. This phase refers to the control of the helicopter and manipulator in the last phase. This can be realized using one of the following approaches or their combinations:
a) Completely decoupled control. The helicopter and the manipulator are controlled independently. Usually, the helicopter will try to maintain a hovering position trying to compensate the disturbances from the manipulator; the manipulator
will try to keep the TCP on the object compensating the disturbances caused by the helicopter movement around the hovering position.
b) Coupling on the kinematical level. The controller for helicopter and manipulator are coupled by the positions and velocities of both subsystems.
c) Coupling on the dynamical level. The overall controller for both subsystems considers the dynamical model of the whole system. This is the most general case and potentially will provide the best possible performance from the theoretical point of view. However, the practical considerations make this general conclusion not obvious. For instance, the quality of the sensor signals, often, does not allow precise state estimation of the coupled system. In addition, the dynamical model of the coupled system is complicated and the model-based controller will usually be sensitive to system parameters, non-modelled effects and disturbances.
When the masses of the helicopter are significantly greater than the mass of the manipulator, the dynamical coupling cannot improve the performance of the whole system significantly and it might be preferable to adopt approaches (a) and (b) for control. However, if the mass of the arm is relatively significant, then the approach (c) to control the force interaction is preferable.
Regardless of which control approach and which system set-up is chosen, the following aspects should be investigated in order to design a particular control scheme and to estimate the achievable control performance:
precision control of the helicopter
force interaction between helicopter and environment
movement of the centre of gravity (CoG) due to the manipulator movement
The understanding of the above listed aspects constitutes a base for further development of approaches and technologies for aerial manipulation.
4. Closed-loop behaviour
A manipulator or other grasping device imposes forces and torques on the helicopter fuselage which influence the helicopter motion. This is illustrated in Fig. 4. The description and analysis of the interaction between helicopter and manipulator is complicated. The translational movement of the helicopter generates the interaction forces between manipulator and the fuselage. These forces change the orientation of the fuselage and the main rotor plane which again results in changes of the translational movement. Please note that the dynamical equations for translation and orientation of the helicopter without manipulator are coupled only in one direction. This means that the equations for the rotation are independent from translational movement, e.g., see Eqs. (1). The translation depends, of course, on the orientation of the main rotor plane. For the system composed of a helicopter with a manipulator, there is coupling between translational and rotational dynamics in both directions. The equations of the rotational dynamic depend on the translational movement. This fact makes the analysis of the system and, therefore, the model-based controller design, complicated.

Force torque interaction between manipulator and helicopter fuselage.
4.1 Orientation Controller
The control system is based in the same approach used by the authors for the load transportation system by means of autonomous helicopters. The key element is the orientation controller in the inner loop. The rotation dynamics for a single helicopter, represented by two rigid bodies for the fuselage and the main rotor, can be expressed (see Kondak et al. (2006)) by the following equations:
where u1,2 are rotation speeds of the fuselage, TMR1,2 are the torques generated around the longitudinal and lateral axes of the fuselage, and the coefficients Kxx are constant parameters of the helicopter and of the main rotor speed. Notice that the rotation speeds couple Eqs. (1). This coupling leads to oscillations once the system has been stimulated. Fig. 5 shows the scheme for the control of the helicopter roll and pitch angles q1,2. The helicopter controller has the internal control loop with the block
Block
The simulation experiments have shown that, unlike in the case of a helicopter without a manipulator, the orientation controller with inversion block

Scheme for the orientation control.
With the usage of block
There are two reasons for this robustness: first, the actual influence of the manipulator on the fuselage is measured through
We distinguish between two types of influences imposed on the helicopter from a manipulator: coherent and noncoherent. In case of coherent influence, the forces and torques imposed on the helicopter by the manipulator change with frequencies close to those of the helicopter movement, whereby in the case of non-coherent influence they do not change in time significantly or change with frequencies different to those of the helicopter movement.
The small-size helicopters are insensitive to the noncoherent influences. This can be verified in simulation or by analysis of the dynamical equations as well as in flight experiments. Even large non-coherent torques imposed on the fuselage are compensated by the proposed controller with compensator
The opposite is true for the coherent influence. Even small interaction forces imposed on the fuselage periodically in proper phase could yield to low frequency instabilities and oscillations, so-called phase circles. Unfortunately, these phase circles appear often when the manipulator is compensating the helicopter movement in hovering, as explained in Sect. 4.2 in more detail. In this case, the proposed controller with compensator C works only with a perfectly modelled system. Therefore, for practical applications, in addition to this controller, a coupling between the helicopter and manipulator controllers should be used in order to prevent phase circles.
4.2 Movement of the CoG
Let us consider two feedback controlled systems S1 and S2 with plants G1, G2 and controllers C1, C2, as shown in Fig. 6. These feedback systems can correspond to two separate physical systems or be two parts of one physical system. For example, a helicopter with position control allowing an independent motion in x – and y -directions can be considered as composed of two systems with y1 = x and y2 = y. Often, especially in the case where S1 and S2 belong to one physical system, there is a coupling between these two systems, as denoted in Fig. 6 with blocks P1 and P2 . This undesirable coupling can be caused by model parameter uncertainties, systematic errors in the sensors or by non-modelled physical interconnections between systems S1 and S2. This coupling can lead to periodic or coherent energy flow into the systems and induce low frequency oscillations in S1 and S2. We demonstrate this for the linear case. Let us consider the transfer function G11 = y1 / r1 for the coupled systems in Fig. 6. It can be shown that

Scheme of the system with a coupling between two outputs y1 and y2.
with
Considering symmetric systems with G1 = G2 = G,C1 = C2 = C
where only the product of both coupling blocks P1P2 has influence on the system behaviour.
On the other hand, let us consider the set-up for aerial manipulation shown in Fig. 1. Let us imagine that the TCP is fixed on the object (does not move relative to the ground) and the manipulator is compensating the movement of the helicopter caused by a wind gust or the ground effect, see Fig. 7. The displacement of the fuselage δxF is compensated by the manipulator fixing the TCP at the same position xTCP = 0. The resulting displacement of the manipulator CoG δxCoG causes additional torque on the helicopter fuselage δ T. This additional torque changes the orientation of the helicopter, which yields to some further displacement of the fuselage δ yF. The particular issue of a small-size helicopter with a single main rotor is that the torque applied to the fuselage yields the displacement in the same axis as a torque vector or, in our example, perpendicular to the direction of δxF. The fact that δ yF ⊥ δxF is important because this is the reason for the existence of low frequency diverging oscillations, i.e., phase circles (as it will be shown later).

Movement of the manipulator CoG while compensating the displacement of the helicopter.
To see that δyF ⊥ δxF, it is considered the solution of the Eqs. (1) for constant input torques T MR 1 and T MR 2 which is given by
Here β depends on the rotor properties and its rotation speed around the rotor axis (which is assumed to be constant). Furthermore
where γ is a function of mass and geometry properties of the fuselage and the rotor, and ω MR is the rotation speed of the rotor. Depending on the particular system, or its value of γ, the oscillations in Eqs. (3) can be neglected or taken into account. In any case the first part
shows that, due to the gyroscopic effect of the main rotor, the applied torque induces the rotation speed of the fuselage in perpendicular direction, e.g., T MR 2 → u1, and the corresponding change in the orientation generates an additional component of the lifting force or acceleration a2 which is perpendicular to the axis of u1. Therefore, the complete chain in our example is the following:
where coordinates x,y corresponds to axes 1, 2 and q1 is the orientation angle around axis 1.
Taking into account that δyF ⊥ δxF and the chain (5), the interaction between the helicopter and manipulator by fixing TCP relative to some object in the environment could be described by the scheme shown in Fig. 8. Without the blocks P*1 and P*2, this scheme represents the motion of a controlled helicopter along x – and y – axis. Here a simplified form for rotational dynamics represented by one integrator is used. Cr1,2 are orientation controllers and Ct1,2 are translation controllers for axes 1, 2. Using this scheme, the existence of phase circles in this case will be investigated.

Simplified scheme of the helicopter with manipulator using decoupled control.
It can be shown that the transfer function G11 = y1/r1 G11, Eq. (2) in the case of a symmetric system with Cr,t1 = Cr,t2 is
Using for Cr=Kq, for Ct = Kds + Kp with Kq = 3, Kd = 2, Kp = 1, the following G11 transfer function is obtained
As in (2) P*1 P*2 has an influence on the system poles. In Fig. 9, the pole movement for the gain of P1 P2, changing in interval [-40; 40], is shown. As it can be seen in points Re (P*1P*2) = – 25 and Re(P*1 P*2) = 9, one of the system poles' real part gets positive (or moves to the right half of the s-plain). This means that the system starts to move on the phase circles. In Fig. 10, an example of such movement is shown. The different sign of the two points Re (P*1 P*2) = −25 and Re(P*1 P*2) = 9 means that phase circles can appear for P*1 and P*2 with the same, as well as a different, sign.

Movement of system poles λ while increasing gains in P1P2.

Movement of the helicopter induced by a manipulator which moves its CoG in two dimensions (horizontal plain).
One possible solution to avoid phase circles is to set P*1 or P*2 to zero. In our case this can be done by restricting the motion of manipulator CoG by setting
This means that manipulator CoG moves only in xz -plain, so P*2 = 0 and the phase circles cannot appear for any set of system parameters. The condition (6) can be realized e.g. using a manipulator with 7 DoF.
In Fig. 10, the two horizontal coordinates (x,y) of a helicopter moving in a simulation experiment are shown. In this experiment, the TCP position is fixed in an inertial frame and the manipulator compensates the movement of the helicopter. The helicopter and the manipulator are controlled independently and condition (6) is not satisfied. As it can be seen, the phase circles appear and the helicopter controller is not able to stabilize its hovering configuration. In Fig. 11, the motion of the same system in simulation is shown. Different to the previous case, here condition (6) is satisfied, and the manipulator CoG is moving only along the x – axis. We can see that the helicopter controller stabilizes the hovering configuration and the phase circles do not appear.

Movement of the helicopter induced by a manipulator which moves its CoG along only one dimension.
Please note that even if the displacement of the manipulator CoG and the corresponding torques acting on the fuselage are small, compared to torques generated by the main rotor, they act in the phase with the fuselage movement and can induce phase circles. The disturbance torque, imposed on the fuselage, which is not changing in the phase with the fuselage movement, e.g., static displacement of the CoG, does not cause the phase circles described above and can be rejected by the helicopter controller well – even if its absolute value is comparable with the torques generated by the main rotor.
Condition (6) and the results from the second simulation experiment shown in Fig. 11 are verified in flight experiments using the set-up shown in Fig. 12. An electrical helicopter with the take-off weight of 15 kg is equipped with a pendulum, which can move a mass of 1 kg along the roll axis of the fuselage. The distance between the pendulum CoG and its rotation point is 0.12 m. The displacement of the pendulum CoG, while hovering, did not induce the oscillations as shown in Fig. 10.

Experimental platform with pendulum for displacement of the helicopter CoG.
5. Conclusions
Aerial robots physically interacting with the environment could be very useful for many applications. However, the models involved in the design of the control system are complicated due to dynamic coupling between the parts of the system. This was illustrated in the particular case of autonomous helicopters used for aerial manipulation. It was also shown that for analysis and control design of helicopters with manipulators, simplifications could be found which lead to practical, relevant solutions. Preliminary results for aerial manipulation were presented and discussed. In particular, it has been shown that if the forces and torques imposed by a manipulator on a helicopter change with frequencies close to those of the helicopter movement, even small interaction forces can generate low frequency instabilities and oscillations, so-called phase circles.
Footnotes
6. Acknowledgements
This work was partially supported by the projects ARCAS (European Commission, 7 th Framework Program, ICT-2011-287617) and by the national projects RANCOM (P11-TIC-7066) and CLEAR (DPI2011–28937-C02–01).
