Abstract
In this paper, we consider the problem of controlling a team of Quadrotors that cooperatively grasp and transport a common payload in three dimensions in the presence of external disturbances and parametric uncertainties such as wind field effects. The main contribution of this work is to propose a cooperative control algorithm based on a decentralized strategy. This algorithm consists of two main parts: first calculating the control vectors for each Quadrotor using Moore–Penrose theory and second combining these control vectors with individual control vectors, which are obtained from a closed-loop non-linear robust optimal controller. In this regard, a robust optimal sliding mode controller (ROSMC), which incorporates the state-dependent Riccati equation (SDRE) method with sliding mode control (SMC) technique, is designed. It also has the capability of maximum dynamic load carrying capacity (DLCC) to increase the carrying capacity and the efficiency of the group of Quadrotors. The proposed method inherits the advantages of both approaches including robustness against model uncertainties and high flexibility in designing the control parameters to provide an optimal solution for the non-linear dynamic of the system. The control algorithm is based on the Lyapunov technique, which is able to provide the stability of the end-effecter during tracking of the desired trajectory with acceptable precision. Finally, the simulation results demonstrate the effectiveness of the control strategy for the cooperative Quadrotors to grasp and transport a common payload in various manoeuvres.
Introduction
Undoubtedly, carrying and displacing objects is one of the most important tasks of robots in robotic science. The cooperative control of multiple vehicle systems poses significant theoretical and practical challenges. Cooperative control problems for multiple vehicle systems can also be categorized as formation control problems with applications to mobile robots, unmanned aerial vehicles (UAVs), autonomous underwater vehicles, cooperative transport, cooperative role assignment, cooperative timing and cooperative search. In this paper, we seek to develop an algorithm for cooperation between flying robots for carrying an object. The controller is designed to move the object by two or more Quadrotors.
To create mechanisms for interaction between object and cooperative Quadrotors, some research utilized the structure of a leader follower, which has unique benefits. For example, in Korayem et al. (2014) and Desai et al. (1998, 2001) a feedback linearization controller, in Das et al. (2002) a sliding mode controller and in Sanchez and Fierro (2003) a controller based on the position of the robot using a high gain are designed based on the structure of a leader follower system, which led to the desired goals of the moving robots. It should be noted that the structure of the leader follower controllers based on feedback linearization is mostly used, because of their ability to compensate for uncertainties associated with the acceleration of the leader robot motion (Orqueda and Fierro, 2006). However, this method has several disadvantages for cooperative strategy. For example, the position of the leader must be notified to the followers at each moment, and if the leader’s position signal is not issued for any reason, it is possible that the formation disappears quickly. On the other hand, there is always a delay from the moment of receiving the signal of the leader’s position to the moment when the changes are applied to the status of followers, and this leads to a high complexity in the elimination of disturbances in this method.
Another form of cooperation control strategy is the centralized control method that controls small robotic systems, which has better results than the method of the leader follower approach. As the Quadrotors are categorized as large-scale systems, using this type of controller alone to establish the necessary cooperation in the performance of these flying unmanned robots may not be useful. One of the disadvantages of this controller is increasing levels of freedom (Tarn et al., 1986). However, much effort is focused on the development of methods based on the reduced model to solve this problem in robotic systems (Liu et al., 2007; Yoshikawa and Zheng, 1997).
There has been much research in cooperative multi-robot controller design based on decentralized control methods. A cooperative control framework for vehicle formations has been proposed in Fax and Murray (2004). In Cheng et al. (2008), the authors describe the problem of the cooperation approach by a team of ground robots for a unique solution to the motion of the object and robots motions under quasi-static assumptions based on a decentralized controller. The problem of aerial manipulation using cables based on decentralized control in transporting a payload has been studied in Fink et al. (2011) and Michael et al. (2011). The focus of their works is on finding robot configurations and ensuring static equilibrium of the payload at a desired position while respecting the constraints on the tension.
In Michael et al. (2011), the authors proposed aerial grabbing based on a cooperative scheme for load transportation with a simplified model and control, and Fink et al. (2011) proposed planning of these tasks. Also, in Bernard et al. (2011), cooperative aerial towing has been studied in particular. Furthermore, it can be shown that the advantages such as decreased number of sensors and speeding up the performance of decentralized multi-agent systems are quite evident (Nathan et al., 2011). The bilinear matrix inequalities, as a special form of linear matrix inequalities, is an effective way of presenting optimal solutions for decentralized multi-agent non-linear systems (Nian, 2005; Wang et al., 2012). In all these cases, decentralized control methods are considered to solve a substantial proportion of the problems in cooperative strategy directly or indirectly.
Hence, in this research we design new cooperative decentralized control laws for a group of UAVs in a formation where each vehicle is controlled individually. This enables the manipulation of a payload in three dimensions. This cooperative control algorithm is comprised of two parts. In the first part, using Moore–Penrose theory, control fundamental vectors that guarantee the optimal performance of the coupled system are determined and, in the second part, individual control vectors that guarantee the robustness of the coupled system against uncertainties and disturbances are designed for each Quadrotor. In order to have a soft touch between the object being carried and the cooperative Quadrotors, a robust optimal sliding mode controller (ROSMC) based on the state-dependent Riccati equation (SDRE) is employed to control all of the Quadrotors in cooperative system. Finally, by combining these parts the control forces and torques of the cooperative team of Quadrotors are determined.
The SDRE technique has emerged as a design method, which provides a systematic and effective design of non-linear controllers in many fields such as aerospace (Massari and Zamaro, 2014), robotics (Korayem et al., 2014), motors (Do et al., 2014), magnitude torque attitude control of a satellite (Abdelrahman et al., 2011), flexible cable transporter system (Zhang et al., 2005) and in this paper we are to apply this technique to control cooperative UAVs as a part of our novel method. The idea of SDRE approach is to provide an optimal solution for a non-linear dynamic system similar to the linear quadratic regulator (LQR) control (Cloutier, 1997). It provides high flexibility in components design and proper functionality of the system in its real time implementation. The design flexibility, principle selection of design matrices and finding solutions in the presence of control and state constraints are its advantages. Because of these excellent features, SDRE is a suitable approach for designing individual control vectors in the proposed cooperative control strategy of this research in order to provide asymptotic stability of the closed-loop coupled system.
Another item focused on in this paper is the maximum dynamic load carrying capacity (DLCC) by a group of Quadrotors. The carrying capacity and the efficiency of the robot end-effector may be limited by the amount of deviation. It is clear that increasing the stimulus cannot be a good solution because it leads to higher power consumption and increment of the size and weight of the driver. For example, in Korayem et al. (1992), DLCC has been used as a criterion for determining the load carrying capacity in design of the robot arm. Also in Korayem et al. (1993) and Sidi et al. (1998), the maximum DLCC of the robot is determined in the usual way and two-arm robot with flexible joints is implemented. In this study, the maximum load neighbourhood robot configurations have been investigated, and some techniques to increase the carrying capacity of the cooperative system have been developed. In order to apply this algorithm, two important factors should be considered: first, the maximum torques that can be generated by motors and, second, the maximum acceptable bounds of errors within which the end-effector is permitted to move (Korayem et al., 2007). The required constraints can be easily satisfied by the aid of our proposed iterative algorithm in this paper.
A sliding mode control (SMC) algorithm as a robust control method has also been discussed for identification of the maximum DLCC, in the presence of disturbance and system uncertainties (Korayem and Pilechian, 2005). Furthermore, in Nian (2005) and Wang and Ravani (1988) the authors described DLCC for a two-link flexible manipulator dynamic optimal path planning. It should be noted that individual UAVs are fundamentally limited in their ability to manipulate and transport objects of any significant size. We address this limitation in this paper and consider the problem for cooperative Quadrotors.
In this research, we extract the system equations in state–space form and apply the combination of proposed ROSMC with an optimal cooperative algorithm to achieve a novel robust optimal controller, which successfully rejects the external disturbances for cooperative Quadrotors such as wind effect. Merits of using this approach range from simple implementation and flexible parameter learning to design criteria customization. The simulation results demonstrate the effectiveness and superior performance, and high DLCC of the proposed control strategy for the cooperative Quadrotors to grasp and transport a common payload in various manoeuvres.
The remainder of this paper approaches the development of controllers for cooperative Quadrotors and transportation as follows: at first the development of a model for a single Quadrotor is discussed. Then we describe the modelling of a team of Quadrotors rigidly attached to a payload. This section also establishes a distinction on different modalities and information of what is known as aerial grasp manipulation. We propose cooperative control algorithm laws defined with respect to the payload that stabilizes the payload along three-dimensional trajectories based on a SDRE incorporated with SMC technique. We review and analyse experimental study with teams of Quadrotors cooperatively grasping, stabilizing and transporting payloads. This includes point-to-point path planning and trajectory tracking. Maximum allowable load is computed by considering the limiting factors of the robot in each case by definition of DLCC, and finally we conclude the paper with some future improvement suggestions.
Dynamic modelling and coordinate reference frames for single Quadrotors
According to Figure 1 (Zeghlache, 2013), the Quadrotors can fly in all directions and have no limit on manoeuvre limit on manoeuvre. Two main reference frames are considered in order to analyse the dynamic model frame:

Configuration, inertial and body fixed frame of a Quadrotor.
The equations describing the altitude and the attitude motions of a Quadrotor helicopter are basically the same as those describing a rotating rigid body with six degrees of freedom. The three-axis rotational dynamic of rigid body in body-fixed reference frame is given by
where
where
The translational dynamic model of rigid body in the body-fixed reference frame is given by
where m is the mass of Quadrotor,
where
where
In this equation, d is the thrust coefficient and b is the drag coefficient. Equation (7) can be rearranged in terms of the rotational speed vector,
Therefore, the desired motor speed can be computed to be sent to the motor controllers. The model (6) can be rewritten in a state-space form
Lastly, according to the Quadrotor rigid-body structure and its entirely symmetrical model, the state–space model of the translational and the rotational subsystems based on the Newton–Euler method are defined as follows
where
The control variables
Dynamic model of coupled system
To solve the problem using the Euler equations, kinematics system must be extracted. Figure 2 (Mellinger et al., 2013) shows a team of Quadrotors manipulate a payload in three dimensions. In this scheme, four Quadrotors are used for lifting a cross configuration object. The coordinate systems including the world frame, W, and body frame, B, as well as the free body diagram for the Quadrotor are shown in Figure 2. In general, we assume the group of n UAVs are connected through a fixed interaction to the object coordinate frame B in the centre of mass and relative coordinates. The body frame axes are chosen as the principal axes of the entire system and each Quadrotor has an individual body frame

Scheme of payload being transported by four Quadrotors.
The rotation matrix from B to W is given by
The payload has a cross configuration structure, completely homogeneous, and the centre of mass of the object is intended as the centre of mass of the coupled system.
The mass of the payload is sufficiently small that n Quadrotors are able to lift the object.
The payload does not flip during manipulation.
The motion equation for each of Quadrotors is as follows:
In this equation, Quadrotor
In this equation,
In Equation (14),
In Equation (15),r denoted position vector to the centre of mass of the ith Quadrotor. The angular velocity of the object in the object coordinate system frame B in the frame W is denoted by p, q, r:
As the motor dynamics are fast compared with the rigid body dynamics and the aerodynamics, we will assume that rotor speeds can be instantly achieved during the controller development. These rotor forces can be rewritten as a total force from each Quadrotor
where L is the distance from the axis of rotation of the rotors to the centre of the Quadrotor. Also
where control input
The cooperative control algorithm
The development of the cooperative guidance controller for the case of perfect state knowledge of the chasers and target UAV is described in this section based on Mellinger et al. (2013). This control strategy is a decentralized control algorithm and includes three parts. In the first part of this algorithm, the control fundamental vectors for n Quadrotors that define a pseudo-inverse matrix of the mathematical theory of optimal control using the Moore–Penrose are determined. The second part of this strategy is composed of determining individual control vectors by ROSMC. Finally, in the last part, the cooperative control algorithm can be extracted by combining the individual control vectors and the control fundamental vectors.
Control fundamental vectors of cooperative control strategy
After determining the sum of the force vectors of the coupled system, the linear system (18), four equations with four unknowns 4n can be described as:
where
Therefore, these linear systems can be generalized to n Quadrotors. For this purpose, optimal control vectors are selected to deliver the system to the desired values, which can be minimized as subject to the following cost function (Mellinger et al., 2013):
where:
In this equation,
To consider the features of Moore–Penrose inverse theory, the optimal control vector is obtained as follows:
In Equation (26), the ‘+’ sign indicates the method of Moore–Penrose. In this regard, the columns of the matrix
The more open design of control algorithms, considering the special case in which all n Quadrotors are identical and axially symmetric, can be assumed a similar move to roll and pitch angle. Therefore, the weight of control fundamental vectors
Thus, according to the mentioned conditions in Remark 1 for the coupled system, all Quadrotors have a common role in lifting the object off the ground and equal partnership. As a result, the body force F and yaw torque produced by each of them is almost equal. Thus, the control fundamental vectors consist of the total force F and yaw moment of the coupled system for n Quadrotors is as follows,
Also, two fundamental control vectors that include pitch and roll moment generated for the coupled system structure are obtained as follows (Mellinger et al., 2013):
It is evident that the weighting parameters are dependent on control vectors and reflect a trade-off between these factors. Also, it is important to notice to the increment of the force produced by each of n Quadrotors will lead to decrement individual body moments generated by them, according to the factor
Individual control vectors of cooperative control strategy
In this subsection, to complete the cooperative control algorithm, the target is determined from individual control vectors
Sliding mode control of Quadrotors
Sliding mode is one of the robust controlling methods widely used in various non-linear systems with external disturbance and indefinite states. SMC is developed by two stages: first a suitable switching surface is selected and defined based on tracking errors. Second, a Lyapunov function is opted with needed conditions. In sliding mode, the dynamic of state variables is stated by extracting input equations (Bouadi, 2007). The SMC to Quadrotor state variables dynamic is presented by establishing the statement for control input. The choice of the sliding surfaces is based upon the synthesized tracking errors as follows:
Such that
To synthesize a stabilizing control law by sliding mode, the necessary sliding condition
Assuming here that
Same steps are followed to extract
Therefore, according to Equation (36), the time derivative of final Lyapunov function
The sufficient condition for the stability of the system is given by
The time derivative of
Problem formulation of robust optimal sliding mode controller design of Quadrotors
SDRE control, initially introduced by Cloutier (1997), was inspired by LQR design. Using the SDRE method, a non-linear control method is applied so that all properties of the linear LQR control can be exploited. Consider an uncertain non-linear system described by:
where
and
where
Optimal control design based on SDRE for Quadrotors
Consider the problem of non-linear optimal regulation of indefinite and continuous time system (44). The goal is to minimize unlimited performance time by quadratic state vector and quadratic input vector of Equation (43). To explain the SDRE approach, it is important to be familiarized with the extended notion of linearization, called the SDC (state-dependent coefficient), which is a key concept in this method. Extended linearization SDC is a process during which the non-linear system is turned into a pseudo-linear structure consisting of SDC matrices. Assuming
The choice of the matrix
which has a linear structure with matrixes
So the dynamic system (42) can be rewritten as
It is also assumed that
Inspired by the LQR problem, which is described by ARE, SDRE feedback control provides a similar guideline for the problem of optimal non-linear regulator. SDRE state feedback control is formed as follows:
where
Note, also that
As shown, any change in
Design of robust optimal sliding surface
To establish the sliding mode optimal control law, considering the uncertain system (42), the sliding surface is chosen as follows:
where
Now in conditions of
Finally, substituting (54) into (42), the sliding mode dynamics become
Comparing (55) with (46) shows the sliding mode dynamics of uncertain system (42) and the optimal dynamics of the nominal system (46) have exactly the same equation. Thus, according to above sliding surface, the defined control law will be robust against disturbance and, at the same time, guarantees optimal accurate performance of the controlled system (42). So we call
Design of robust optimal sliding mode control law
After the sliding surface is chosen, the next step is designing the SMC law. Based on the Lyapunov function
In which
The control law can impel the system trajectories to reach the sliding surface in finite time and maintain it thereafter. However, by considering the chosen Lyapunov function, prove the exponential stability of it:
where
Now according to Equations (34) and (52), we choose the optimal switching surface variables as follows:
After selecting switching variables, the only remaining passive variable is G(x), assuming:
We will have
Equation (61) shows that
where
Also weight matrixes
Note that the selected forms are not unique and can be set as different types regarding different conditions of stability. It is important to remember that these matrices were obtained in a trial and error process. Undoubtedly, considering the flexibility in choosing
Individual control vectors of cooperative control strategy
In this section, the individual control vectors are designed. These vectors are generated by the ROSMC method, which has been explained in the previous subsections, and are represented by parameters
In these equations, n represents the number of Quadrotors in the coupled system, and Xqn represents the states vector. Virtual control vectors
Cooperative control vectors
By combining the control fundamental vectors in the Equations (31) and (32) with individual control vectors Equations (67) and (68), the cooperative control vectors for each independently designed Quadrotor can be described as follows:
To test the robustness of the controller against external disturbance we chose wind field effect as a destructive factor, which is shown in Figure 3. The wind velocity component

Artificial wind gust generating setup.
The parameters of proposed controller
Controller parameters.
Simulation results
We now report on the numerical simulation we have carried out to accredit the efficiency of the proposed control scheme. The parameters for simulation of a sample cooperative Quadrotors model are set as (Wang et al., 2014),
To compare the effectiveness of proposed cooperative controller on system performance and the reduced tracking errors two cases are considered, the first one is grasping, that is, immobilize the object from different initial conditions of each Quadrotor to point-to-point path planning. The second simulation considers grasp and then manipulation for separately described predefined trajectory tracking. In both cases, terminal stability is considered to reach and touch the object at exactly the same time for all Quadrotors.
Point-to-point path planning
The initial conditions of Euler angles of each Quadrotor are set as
Quadrotors’ initial conditions.
For the first simulation, the desired point configuration is

Tracking simulation results of desired trajectories of angle (φ, θ, ψ).

Tracking simulation results of desired trajectories of position (x,y,z).

Top view trajectory tracking for the Cross configuration.

Global trajectory of the Quadrotor position.
Predefined trajectory tracking
In order to investigate the efficiency of the proposed method, in this section a simulation is performed for a case in which the end-effector must track a predefined trajectory. The desired trajectory is a spiral, which is described by the function of time according Table 3. Thus, unlike the earlier part of the navigation path, the important thing for this part of the simulation is that it is desirable to follow the trajectory by the Quadrator sets that are defined in the Table 3.
Quadrotors’ desired trajectories.
With
The convergence of the position trajectories stand for the synchronization of all Quadrotors, according to the task, as can be seen in Figures 8 and 9, respectively. The trajectory of Quadrotors in 3D space is shown in Figure 10. It shows that the system performs well and tracks to the desired trajectory in three dimensions in predefined trajectory tracking, whereas the position error is given in Figure 11, where it can be appreciated that the performance of the control scheme proposed is quite satisfactory, especially in the x- and y-axes. Even if the errors do not converge to zero, they oscillate in a bounded neighbourhood of the origin. Also, Figure 12 shows the stability rotor speed response of a Quadrotor during hovering. The results indicate that the Quadrotors lift up and put down the object, and a stable grasp has been achieved.

Cooperative Quadrotor exponential position tracking.

Cooperative Quadrotor exponential position tracking.

Global trajectory of the Quadrotors position.

Error tracking of position (x,y,z).

Control inputs of Quadrotors.
Maximum dynamic load carrying capacity
As is clear from the title, this approach is based on the increase in mass of the final payload to achieve saturation engines and detect the optimal trajectory. In previous work, when determining the maximum load carried by the robots, some constraints affecting the performance of the robot are assumed. Torque and angular speed of rotors and precision linear motion track are important factors in this study. In such a situation, the controller must satisfy the physical constraints of the system to meet the constraints of trajectory tracking. To assess the optimality of these options, the DLCC is used. The DLCC algorithm is the maximum amount of time during the movement with which end-effectors can be carried to an acceptable accuracy. DLCC definition is based on the amount of torque generated by the rotors and the range of allowable errors of the system. Hence, in general, taking into account the limitations of operator error in the implementation of this algorithm, torque can be considered calculated by this system, which is preset in one direction. In this regard, the first limitation is the lower limit of the torque generated by each motor. This constrain is described as follows (Korayem et al., 2014):
where

Saturated motor torque.
Conclusion and future works
We addressed the problem of controlling multiple Quadrotors robots that cooperatively manipulate and transport a payload in three dimensions. An optimal decentralized control algorithm based on ROSMC using the SDRE approach has been proposed for a group of cooperative Quadrotors. We approach to the problem by first developing a model for a single Quadrotor and then extending it to a team of Quadrotors rigidly attached to a payload. We propose individual robot control laws defined with respect to the payload that stabilize the payload along three-dimensional trajectories. This method provides an efficient and systematic procedure to solve a non-linear closed-loop robust control problem. In order to check the optimality of the employed method, the DLCC of the robot was obtained with taking into account of the limits of motor torques and accuracy.
To express the efficiency and optimality of the proposed method, simulation results and computed DLCC were derived for trajectory tracking movement. It is obvious from the simulation results that using our method led to better performance as well as higher DLCC in the presence of external disturbances and parametric uncertainties such as wind field effects. As future work, one may also use the load sharing approach between multiple agents in order to improve the design performance gained in this paper.
Footnotes
Conflict of interest
The authors declare that there are no conflicts of interest.
Funding
This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors. The authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.
