The trajectory tracking control problem of dynamic nonholonomic wheeled mobile robots is considered via visual servoing feedback. A novel visual feedback tracking error model is proposed. Its tracking controller is independent of uncalibrated visual parameters by using new methods. This controller consists of two units: one is an adaptive control for compensation of the uncertainties of dynamic parameters, the other is a variable structure control for the interference suppression. In addition, the torque tracking controller is global and smooth, and the chattering phenomenon is eliminated. The asymptotic convergence of tracking errors to equilibrium point is rigorously proved by the Lyapunov method. Simulation and experiment results are provided to illustrate the performance of the control law.
The control of wheeled mobile robots with nonholonomic constraints has attracted much attention due to the inherent nonlinearity in robot dynamics and the usefulness in many applications. By the theorem of Brockett (1983), a nonholonomic system cannot be stabilized at a single equilibrium point by any continuous, time-invariant, state-feedback controller. However, several other approaches have been proposed (Astolfi, 1996; Tian and Li, 2002; Hu et al., 2004; Samson, 2005; Wang et al., 2015).
In the control of nonholonomic mobile robots, it is usually assumed that the robot states are available and exactly reconstructed using proprioceptive and exteroceptive sensor measurements. Unfortunately, in real-world applications, these assumptions often do not hold due to uncertainties in the kinematic and dynamic models, mechanical limitations and measurement noise. As a consequence, the estimation of the robot states from sensor measurements can be affected by these perturbations. An interesting approach to overcome this position measurement problem is to utilize a vision system to directly obtain the Cartesian position information required by the controller. Since the late 1980s, much effort has been devoted to visual servoing and vision-based manipulations (Fang et al., 2012; Wang et al., 2010). To implement a visual servo controller, an important step is to calibrate the intrinsic and extrinsic parameters of cameras. It is well known that the camera calibration is costly and tedious. To avoid camera calibration, a lot of effort has been made to achieve uncalibrated visual servoing (Chen et al., 2014; Liang et al., 2015).
Recently, the visual tracking control problem of nonholonomic mobile robots has been proposed. In Chen et al. (2006), a visual servoing tracking controller was developed for a monocular camera system mounted on an underactuated wheeled mobile robot subject to nonholonomic motion constraints. The reference (Wang et al., 2010) presented a dynamic feedback tracking controller for a nonholonomic wheeled mobile robot (WMR) kinematic system under the assumption that the unknown visual parameters .
The methods mentioned above are based on kinematics only and the nonlinear forces in robot dynamics are neglected. However, in practice, it is more realistic to formulate the nonholonomic system control problem at dynamic level, where the torque and force are taken as the control inputs. Liu et al. (2006) presented a new adaptive controller for image-based dynamic control of a robot manipulator using a fixed camera whose intrinsic and extrinsic parameters are not known. Yang et al. (2013) used feedback from an uncalibrated, fixed (ceiling-mounted) camera to develop an adaptive tracking controller for a type (1,1) nonholonomic mobile robot, a novel trajectory tracking torque controller was designed based on Lyapunov’s direct method and backstepping technique. But the method proposed in Yang et al. (2013) cannot be used to deal with the tracking problem discussed in this paper as the typical triangular structure does not meet.
In this paper, we consider the trajectory tracking control problem of a type (2,0) nonholonomic WMR using an uncalibrated, fixed (ceiling-mounted) camera system. The main contributions can be summarized in the following several respects:
A novel uncertain kinematic tracking error model is proposed under the assumption that the visual parameters are unknown; the assumption is relaxed compared with Wang et al. (2010). For this kinematic tracking error model, a dynamic feedback tracking controller is presented, which is independent of uncalibrated visual parameters and .
The trajectory tracking control problem is discussed at an uncertain dynamic level and an adaptive variable structure torque controller is designed via visual servoing feedback. Moreover, the variable structure controller is smooth, global and the common chattering problem is overcome.
The experiment is performed on a real type (2,0) MT-R mobile robot and the results illustrate the effectiveness of the proposed controller.
This paper is organized as follows: In Section Problem formulation, the camera-object visual servoing kinematic and dynamic models of a WMR are introduced. In Section Adaptive controller design, a kinematic tracking controller and an adaptive variable structure torque controller for the WMR are designed. In Section Stability analysis, the asymptotic stability of the closed-loop system is rigorously proved by the Lyapunov method. In Section Simulation and experiment results, the controller’s performance is illustrated through the simulation and experiment results. The last section presents a conclusion and outlines future work.
Problem formulation
System configuration
A mobile robot measured by using a fixed camera is shown in Figure 1. It is assumed that a pinhole camera is fixed to the ceiling, the type (2,0) mobile robot is under the camera, the camera plane and the robot plane are parallel. There are three coordinate frames, namely the inertial frame X–Y–Z, the camera frame x–y–z and the image frame . Assume that the plane of the camera frame is identical with the u–v plane of the image frame. Here C is the crossing point between the optical axis of the camera and the X–Y plane. Its coordinate relative to the X–Y plane is . The coordinate of the original point of the camera frame with respect to the image frame is denoted by . is the coordinate of the mass centre P of the robot with respective to the X–Y plane. Suppose that is the coordinate of relative to the image frame. A pinhole camera model yields (Yang et al., 2013)
where , are constants, which are dependent on the depth information, focal length, scalar factors along the u axis and the v axis, respectively. In (1),
where denotes the angle between u axis and X axis with a positive anticlockwise orientation.
Wheeled mobile robot with monocular camera.
Kinematic and dynamic models
As shown in Figure 1, the two rear wheels of the robot are controlled independently by motors, and a front castor wheel prevents the robot from tipping over as it moves on a plane. Both wheels have the same radius denoted by r, and is the distance between two wheels. Assume that the geometric centre point and the mass centre point P of the robot are identical. The pose of the robot in the inertial coordinate frame is defined as , where is the coordinate of position P, and is the orientation angle of robot between the robot frame and the inertial frame with a positive anticlockwise direction. The kinematic of the robot can be modelled by the following differential equations (Campion et al., 1996)
where , is the forward velocity while is the angular velocity of the robot, is expressed as follows
According to the Euler-Lagrangian formulation, the dynamic model of the mobile robot can be described as follows (Fierro and Lewis, 1995)
where is a positive definite symmetric inertial matrix, represents centripetal and Coriolis torque, is an input transformation matrix, and rank , is the matrix associated with the constraints and is a Lagrange multiplier which expresses the constraint force, denotes bounded unknown disturbances including unstructured unmodelled dynamics, is the torque vector applied to the right and left wheels.
Differentiating both sides of (2), substituting it into (4) and pre-multiplying both sides by , one obtains
where , , , . System (5) is more appropriate for controller design as the constraint has been eliminated from dynamic equation (4).
Assumption 1. is bounded by a known scalar; i.e., , where is a known constant.
Remark 1. In order to facilitate the design of the controller in the following section, we generally assume that the bound of disturbance is known and its boundary is available to the designer. In theory, the boundary of disturbance may be obtained by the actual measured signal minus the ideal signal.
In system (2), generally, can be obtained from the encoders of motors and other sensors such as ultrasonic sensors, infrared sensors, etc. However, for complex environments, it is difficult to implement this strategy. Instead, we will take advantage of the vision information to deal with this challenge.
In this paper, a monocular camera is used to measure the position and determine the desired target. A key strategy is that the error between the mass centre point of the robot and its desired point in the image frame can be used in the closed-loop feedback control. As for the angle , it can be obtained easily from the angle sensor such as compass. Therefore, is still included in the error model.
Kinematic and dynamic models with monocular camera
Differentiating (1) with respect to time and using (2), in the image frame, a camera-object visual servoing kinematic model can be obtained
According to (1), the state transformation from the inertial frame to the image frame can be described by
where , F and H are constant matrices, with
According to the transformation (7), the dynamic subsystem (5) can be written as
where
According to Campion et al. (1996), we know that the coefficients of the dynamic equation (4) are only dependent on the angle and have nothing to do with x and y. However, the transformation (1) is independent of the angle . Again with the nonsingularity of S, the transformed system (8) has the same properties as (4) or (5), and is a known invertible matrix. Due to the dynamic characteristics of (4), some interesting properties of the dynamic model (8) are listed below.
Property 1. is a positive definite symmetric matrix.
Property 2. is skew-symmetric.
Property 3. For any differentiable vector
where the regressor matrix is a known matrix of , and , p is an inertia parameter vector of the robot system.
Adaptive controller design
Controller design of the kinematic model
In this paper, we consider the tracking problem when and are unknown and is known.
Assumption 2., , , , and are positive known constants.
In order to discuss the tracking problem of the system (6), we give a desired trajectory , generated by a reference robot whose equation of motion is
where is the desired path of the mass centre in the image frame, is the desired direction. and are the forward velocity and angular velocity of the reference mobile robot, respectively.
Assumption 3. and their derivatives are bounded.
The dynamic tracking problem discussed in this paper is defined as finding a feedback control law such that
when the inertia parameter vector of the robot and the camera parameters are unknown.
If are known, system (6) can be reduced to a common nonholonomic chained-form system through state and input transformations, its tracking problem can be addressed by lots of methods (Dong, 2012; Jiang and Nijmeijer, 1999). However, when and are unknown, the existing methods cannot be applied because the state and input transformations can not be implemented. Next we consider the controller design for system (6) with unknown and .
Denote . By using (6) and (10), we have
Then, a new visual feedback kinematics tracking error model can be obtained
As a basis of the full dynamic system study, let us first neglect the part of dynamics and consider the kinematic tracking problem of the system (6) only.
Based on (11) and the subsequent closed-loop error system development, a dynamic feedback tracking controller that achieves the error states to zero under the assumption
is given by
where is a small positive constant, and denote positive constant control gains. Note that, is a smooth function in .
If only the kinematic model of the mobile robot (2) with velocity input (13) is considered, and assuming ‘perfect velocity tracking’, then the kinematic model is asymptotically stable with respect to the reference trajectory. But the perfect velocity tracking assumption does not hold in practice.
To design the more realistic control law and generate the desired velocity for the complete dynamic systems (6) and (8), the auxiliary velocity tracking error signal, denoted by , is defined as follows
After substituting (13) and (14) into (11), we have , . Furthermore, the following closed-loop error system is obtained
Controller design of the dynamic system
In this subsection, we utilize the dynamic model given by (8) to design an adaptive variable structure torque controller that regulates the kinematic tracking error signals defined in (11) to zero when the camera parameters and robot dynamic parameters are all unknown.
Differentiating (14) and using the formula (8), the robot dynamics using the velocity tracking error can be rewritten as
where is defined as
and denotes the known desired regression matrix, p is defined in (9).
In order to design the final torque tracking controller, firstly, we choose a positive integrable function on such that
Remark 3. The examples of time-varying function satisfies (18), for instance, can be chosen as exponential function , ; power function , , .
Based on the subsequent stability proof and the regulation of , we design the torque control input as follows
where is an auxiliary control signal designed as shown in the following
and
where , and are positive constant control gains, is positive small constant, is bounded time-varying positive scalar defined in (18). is the estimation of p, the parameter update law for is designed as follows
where is a positive definite gain matrix.
Remark 4. The time-varying function defined in (18) can be explained as a boundary layer of variable structure controller. The difference from the common variable structure controller is that this boundary layer is time-varying.
After utilizing (16), (20), and the definition of , we can obtain the following expression of the closed-loop error system for
where is the parameter error signal
Stability analysis
Before describing the main theorem, the following useful Lemma can be given first:
Lemma 1 (Yang et al., 2013). If continuous functions and are boundedness, and
where is a small positive constant. Then
implies
In the following, we present the main result of our paper.
Theorem 1. Under Assumptions 1–3, the control inputs given in (13), (18)–(22) can guarantee the asymptotic convergence of the states of the closed loop systems defined by (15) and (23) in the sense that
provided that
where is a small positive constant.
Proof. To prove Theorem 1, we consider a Lyapunov function candidate
After taking the time derivative of (25) and making the appropriate substitutions from (15), (22), (23) and by Property 2, we can conclude that
From a review of the literature (Polycarpou, 1996), one may find that
where , is a constant that satisfies , and the following notation is used
By applying (27) to (26), one obtains
therefore
So, when we choose the smooth variable structure control law in (21), the inequality (29) is always valid.
From (29), we have
By integrating both sides of (30), it is seen that
According to the formula (18), we obtain that is bounded, thus, , are all bounded, and is bounded as well. In view of (15), (23) and Assumption 3 ( are all bounded), we obtain that, are all bounded. Hence, are uniformly continuous.
The inequality (29) implies that
By integrating both sides of (32), again with the boundedness of and the formula (18), we have . By using the Barbalat’s lemma (Khalil, 2002), we can obtain
Taking the time derivative of , yields
Based on the fact that
and
we have is bounded.
Again with and the boundedness of , , we can conclude that is bounded. Then, is uniformly continuous. By using Barbalat’s Lemma (Khalil, 2002), we have . Noting that the third equation of system (15), we can obtain
Due to the assumption on in Theorem 1 and the conclusion of Lemma 1, it yields
Furthermore, by using the fact that tends to zero, we have
Applying the extended Barbalat’s Lemma (Khalil, 2002) to the fourth equation of system (15), yields
The result can be used in conjunction with (38); we have
According to the nonsingularity of the matrix
we can obtain the conclusion
Therefore, we have proved that tend to zero and is bounded.
Remark 5. The proposed adaptive robust algorithm can guarantee the asymptotical stability of the system. The bounded disturbance can be completely suppressed by using a smoothed sliding mode control law (21) taking into account the boundary layer (18), the chattering problem is overcome.
Simulation and experiment results
Simulation results
For the mobile robot system considered here, according to (Fierro and Lewis, 1995), the dynamic equation parameters of (4) can be given
where m is the mass of the mobile robot and I being its inertia moment around the vertical axis at point P.
According to the transformation of the section on problem formulation, we have
The robot regressor and the inertia parameter vector p can be selected as , .
The simulation is implemented for the controllers defined in (13) and (20). The corresponding closed loop systems are written by (15) and (23). Take , , rad, kg, , m, m. The desired velocities are chosen as m/s, rad/s. The reference trajectory starts from , and the actual robot initial posture is taken as . The parameters of the controller are chosen as , , , and the gain . The external disturbance vector is taken as , and the boundary layer is .
The simulation is implemented and the results are shown in Figures 2–7, respectively. From Figures 2–4, we can see that the posture errors and velocity errors tend to zero asymptotically. From Figure 5, the estimate of the parameter is bounded. Figure 6 demonstrates the good tracking performance of actual robot with respect to the desired trajectory. As shown in Figure 7, the control inputs and are tend to zero as well, and the common chattering problem is overcome. The effectiveness of the proposed controller is verified by the simulation results.
The error states respect to time.
The error states respect to time.
The velocity errors .
The estimated parameters .
The tracking trajectory of the robot with respect to the desired robot.
The torques acted on the wheels.
In the simulation, as long as the controller parameters are chosen positive, , the errors are convergent. Good positive gains will be chosen in the range 0.1 ~ 20, the positive gains can be chosen in the range 1–100, outside this range, the speed of convergence will be slower and the simulation time will be longer. When one of is chosen negative, the convergence of the errors could not be guaranteed. Generally, there is little effect caused by the change of initial value of the tracking error.
Experiment results
In this section, an experiment is proposed to illustrate the theoretical results. As is displayed by Figure 8, the experimental setup is composed by 1) a pinhole camera fixed to the ceiling, and 2) a type (2,0) MT-R mobile robot. Two pieces of red rectangular marks are pasted on the top of the mobile robot. The larger mark is denoted by Goal B, and is used to describe the position of the mobile robot. It is supposed that the centre of Goal B can represent the mass centre of the mobile robot. The smaller rectangular mark is used to calculate the orientation of the mobile robot, and can be denoted by Goal C.
Experimental set-up.
In the experiment, the reference forward velocity and reference angular velocity are denoted by and , respectively; they are obtained by using the coordinates of goal B and goal C, respectively. The bounds of and are based on the maximum velocity of the mobile robot and the processing time of the upper computer, and it mainly limited to the processing time of the upper computer. The forward velocity and angular velocity control input of the actual robot are given by the controller (13) and conducted appropriate saturated processing.
The initial kinematic errors are taken as , the controller parameters are chosen as , m/s, rad/s, the diameter of two standard wheels is m, the distance between two motorized standard wheels is 0.4 m, and the constant torque is 25.5 Nm.
Experimental results are shown in Figures 9–12. As can be seen from Figures 9 and 10, with the proposed controller, the position of the mobile robot is capable of converging to the desired trajectory after a transient process of 700 frames. In Figure 11, a peak of the angle error appeared between 1250 and 1350 frames. This is because when the robot moved into the third quadrant, the change of position as well as the lighting effect resulted in some missing and discontinued images. When the robot across this area, its orientation gradually coincides with the desired trajectory. It can be illustrated in Figure 12 that, the tracking error of position is smaller than five pixels, and the tracking error of orientation is smaller than , indicating that performances of the proposed trajectory tracking controller are satisfactory.
The position error respect to time.
The position error respect to time.
The position error respect to time.
The tracking trajectory of the robot with respect to the desired robot.
Conclusions
A new adaptive variable structure torque controller has been proposed for WMR with unknown camera parameters, dynamic inertial parameters, and bounded disturbances. The global asymptotic tracking of the actual robot with respect to the reference robot has been achieved by using the designed control input. The closed-loop system stability and estimated error boundedness were proved by Lyapunov stability theory. Simulation and experiment results were presented to illustrate the performance of the proposed controller. Due to the limitation of laboratory equipment, the experiment of kinematic tracking control was implemented only, the dynamic system experiment results will be given in the future.
Footnotes
Conflict of Interest Statement
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This paper was supported by the Natural Science Foundation (grant numbers 61503205 and 61374040), the Open Research Project of the State Key Laboratory of Industrial Control Technology, Zhejiang University, China (grant number ICT1501), and the Ningbo Science and Technology Plan Project (grant number 2014C50052).
References
1.
AstolfiA (1996) Discontinuous control of nonholonomic systmes. Systems & Control Letters27(1): 37–45.
2.
BrockettR (1983) Asymptotic stability and feedback stabilization. In: BrockettRWMillmanRSSussmanHJ (eds) Differential Geometric Control Theory. Boston, MA: Birkhäuser, pp.181–191.
3.
CampionGBastinGD’Andréa-NovelB (1996) Structural properties and classification of kinematic and dynamic models of wheeled mobile robots. IEEE Transaction on Robotics and Automation22(1): 47–62.
4.
ChenJDixonWEDawsonDMet al. (2006) Homography-Based visual servo tracking control of a wheeled mobile robot. IEEE Transactions on Robotics22(2): 407–416.
5.
ChenHWangCLLiangZYet al. (2014) Robust practical stabilization of nonholonomic mobile robots based on visual servoing feedback with inputs saturation. Asian Journal of Control16(3): 692–702.
6.
DongWJ (2012) Tracking control of multiple-wheeled mobile robots with limited information of a desired trajectory. IEEE Transactions on Robotics28(1): 262–268.
7.
FangYCLiuXZhangXB (2012) Adaptive active visual servoing of nonholonomic mobile robots. IEEE Transactions on Industrial Electronics59(1): 486–497.
8.
FierroRLewisFL (1995) Control of a nonholonomic mobile robot: backstepping kinematics into dynamics. In Proceedings of the 34th Conference on Decision and Control, New Orleans, LA, December 1995, pp.3805–3810.
9.
HuYGeSSSuCY (2004) Stabilization of uncertain nonholonomic systems via time-varying sliding mode control. IEEE Transactions on Automatic Control49(5): 757–763.
10.
JiangZPNijmeijerH (1999) A recursive technique for tracking control of nonholonomic systems in chained form. IEEE Transactions on Automatic Control44(2): 265–279.
11.
KhalilHK (2002) Nonlinear Systems (3rd edn). Upper Saddle River, NJ: Prentice-Hall.
12.
LiangXWWangHSChenWDet al. (2015) Adaptive image-based trajectory tracking control of wheeled mobile robots with an uncalibrated fixed camera. IEEE Transactions on Control Systems Technology23(6): 2266–2282.
13.
LiuYHWangHSWangCLet al. (2006) Uncalibrated visual servoing of robots using a depth-independent interaction matrix. IEEE Transactions on Robotics22(4): 804–817.
14.
PolycarpouMM (1996) Stable adaptive neural control scheme for nonlinear systems. IEEE Transactions on Automatic Control41(3): 447–451.
15.
SamsonC (2005) Time-varying feedback stabilization of a car-like wheeled mobile robots. International Journal of Robotics Research12(1): 55–66.
16.
TianYPLiSH (2002) Exponential stabilization of nonholonomic dynamic systems by smooth time-varying control. Automatica38(7): 1139–1146.
17.
WangYLangHde SilvaCW (2010) A hybrid visual servo controller for robust grasping by wheeled mobile robots. IEEE/ASME Transactions on Mechatronics15(5): 757–769.
18.
WangCLMeiYCLiangZYet al. (2010) Dynamic feedback tracking control of non-holonomic mobile robots with unknown camera parameters. Transactions of the Institute of Measurement and Control32(2): 155–169.
19.
WangYNMiaoZQZhongHet al. (2015) Simultaneous stabilization and tracking of nonholonomic mobile robots: a lyapunov-based approach. IEEE Transactions on Control Systems Technology23(4): 1440–1450.
20.
YangFWangCLJingGZ (2013) Adaptive tracking control for dynamic nonholonomic mobile robots with uncalibrated visual parameters. International Journal of Adaptive Control and Signal Processing27(8): 688–700.