In this paper, an on-board binocular visual navigation system based on unmanned aerial vehicles platform is designed for autonomous aerial refueling. The hardware configuration of the entire platform is introduced. Vision algorithms including target tracking, feature extraction, and pose estimation are employed for measuring the relation between two unmanned aerial vehicles. Two situations are considered under long and short distances to make this procedure flexible. Four pose estimation algorithms are implemented and compared in this research. A series of experiments are conducted to verify the feasibility and effectiveness of aerial refueling on the unmanned aerial vehicle platform.
Goetzendorf-GrabowskiTRodzewiczM. Design of UAV for photogrammetric mission in Antarctic area. Proc IMechE, Part G: J Aerospace Engineering2017; 231: 1660–1675.
2.
SerraPCunhaRHamelT. Landing of a quadrotor on a moving target using dynamic image-based visual servo control. IEEE Trans Robot2016; 32: 1524–1535.
3.
LiuDNHouZXGuoZet al.Optimal patterns of dynamic soaring with a small unmanned aerial vehicle. Proc IMechE, Part G: J Aerospace Engineering2017; 231: 1593–1608.
4.
WangYWangDB. Tight formation control of multiple unmanned aerial vehicles through an adaptive control method. Sci China Inf Sci2017; 60: 070207–070207.
5.
NicotraMMNaldiRGaroneE. Nonlinear control of a tethered UAV: The taut cable case. Automatica2017; 78: 174–184.
6.
DuanHBZhangQF. Visual measurement in simulation environment for vision-based UAV autonomous aerial refueling. IEEE Trans Instrum Meas2015; 64: 2468–2480.
7.
FravoliniMLCampaGNapolitanoMR. Evaluation of machine vision algorithms for autonomous aerial refueling for unmanned aerial vehicles. J Aerosp Comput Inf Commun2007; 4: 968–985.
8.
ThomasPRBhandariUBullockSet al.Advances in air to air refueling. Prog Aerosp Sci2014; 71: 14–35.
9.
WilliamsonWRGlennGJDangVTet al.Sensor fusion applied to autonomous aerial refueling. J Guid Control Dyn2009; 32: 262–275.
10.
LiuZJLiuJKHeW. Dynamic modeling and vibration control of a flexible aerial refueling hose. Aerosp Sci Technol2016; 55: 92–102.
11.
NicholsJWSunLBeardRWet al.Aerial rendezvous of small unmanned aircraft using a passive towed cable system. J Guid Control Dyn2014; 37: 1131–1142.
12.
MammarellaMCampaGNapolitanoMR. Machine vision/GPS integration using EKF for the UAV aerial refueling problem. IEEE Trans Syst Man Cybern C Appl Rev2008; 38: 791–801.
13.
TandaleMDBowersRValasekJ. Trajectory tracking controller for vision-based probe and drogue autonomous aerial refueling. J Guid Control Dyn2006; 29: 846–857.
14.
DoebblerJSpaethTValasekJ. Boom and receptacle autonomous air refueling using visual snake optical sensor. J Guid Control Dyn2007; 30: 1753–1769.
15.
MartínezCRichardsonTThomasPet al.A vision-based strategy for autonomous aerial refueling tasks. Rob Autom Syst2013; 61: 876–895.
16.
Mati R, Pollini L and Lunghi A. Vision-based autonomous probe and drogue aerial refueling. In: 14th Mediterranean conference on control and automation, Ancona, Italy, 2006, pp.1–6.
17.
Wilson DB, Göktoğan AH and Sukkarieh S. Experimental validation of a drogue estimation algorithm for autonomous aerial refueling. In: IEEE international conference on robotics and automation, Washington, USA, 2015, pp.5318–5323.
18.
Dibley RP, Allen MJ and Nabaa N. Autonomous airborne refueling demonstration phase I flight-test results. In: AIAA atmospheric flight mechanics conference and exhibit, Hilton Head, USA, 2007, pp.113–130.
19.
Ro K, Kuk T and Kamman JW. Active control of aerial refueling hose-drogue systems. In: AIAA guidance, navigation, and control conference, Toronto, Canada, 2010, pp.2–5.
20.
Duan HB and Luo QN. Integrated localization system for autonomous unmanned aerial vehicle formation flight. In: IEEE international conference on control and automation, Kathmandu, Nepal, 2016, pp.395–400.
21.
Deng YM, Xian N and Duan HB. A binocular vision-based measuring system for UAVs autonomous aerial refueling. In: IEEE international conference on control and automation, Kathmandu, Nepal, 2016, pp.221–226.
22.
HenriquesJFCaseiroRMartinsP. High-speed tracking with kernelized correlation filters. IEEE Trans Pattern Anal Mach Intell2015; 37: 583–596.
23.
FlusserJSukT. Pattern recognition by affine moment invariants. Pattern Recog1993; 26: 167–174.
24.
LuCPHagerGDMjolsnessE. Fast and globally convergent pose estimation from video images. IEEE Trans Pattern Anal Mach Intell2000; 22: 610–622.
25.
HaralickRMJooHLeeCNet al.Pose estimation from corresponding point data. IEEE Trans Syst Man Cybern1989; 19: 1426–1446.
26.
Moreno-Noguer, Lepetit V and Fua P. Accurate non-iterative o(n) solution to the PnP problem. In: IEEE 11th international conference on computer vision, Rio de Janeiro, Brazil, 2007, pp.1–8.
27.
LiSQXuCXieM. A robust O(n) solution to the perspective-n-point problem. IEEE Trans Pattern Anal Mach Intell2012; 34: 1444–1450.
28.
LiHDuanHB. Verification of monocular and binocular pose estimation algorithms in vision-based UAVs autonomous aerial refueling system. Sci China Technol Sci2016; 59: 1730–1738.
