Abstract
This paper revisits the state vector of an autonomous underwater vehicle (AUV) dynamics coupled with the underwater Markovian stochasticity in the ‘non-linear filtering’ context. The underwater stochasticity is attributed to atmospheric turbulence, planetary interactions, sea surface conditions and astronomical phenomena. In this paper, we adopt the Itô process, a homogeneous Markov process, to describe the AUV state vector evolution equation. This paper accounts for the process noise as well as observation noise correction terms by considering the underwater filtering model. The non-linear filtering of the paper is achieved using the Kolmogorov backward equation and the evolution of the conditional characteristic function. The non-linear filtering equation is the cornerstone formalism of stochastic optimal control systems. Most notably, this paper introduces the non-linear filtering theory into an underwater vehicle stochastic system by constructing a lemma and a theorem for the underwater vehicle stochastic differential equation that were not available in the literature.
Keywords
Introduction
Mumford argues the idea of the dawning of age of stochasticity. Stochastic processes are the reality. Accounting them into dynamical systems refines algorithmic procedures. Notable applications of stochastic processes can be found in mathematical finance, communications and theoretical biology, including autonomous systems. The famous papers of Mumford (2000) and Sinai (1981) are useful in this regard. They suggested that stochastic methods will change the shape of modern research. The noise equations of the underwater vehicle involve the multi-dimensional state vector as well as construction of the stochastic differential equations (SDEs) (Jazwinski, 1970; Poznyak, 2009) in lieu of ordinary differential equations. This seems to be one of the reasons why stability, estimation and control of underwater vehicles with noise processes are not available in the literature in greater detail. Non-linear filtering in combination with control signal achieves the closeness of the estimated trajectory with the actual and controlled state trajectories.
Here, we explain succinctly the non-linear filtering historic account, as the non-linear filtering is the cornerstone formalism of the paper. The Wiener filter is a signal estimation method and the Wiener filter transfer function is irrational. In 1960, Kalman sowed the seed of the filtering of dynamic systems, where he considered the linear SDE coupled with linear observation equation (Anderson and Moore, 1991). Furthermore, the notion of non-linear Kalman filtering was introduced. A remarkable paper on non-linear filtering can be traced back to a pioneering work of 1967 by HJ Kushner. That is popularly known the Kushner–Stratonovich equation, see Pugachev and Sinitsyn (1987). That is also known as the posterior density. An alternative interpretation to the Kushner–Stratonovich is the FKK filtering of Fujisaki et al. (1972). Realization of higher-order filtering on a single complex chip is still a potential research problem.
In this paper, we construct two filtering models of autonomous underwater vehicle (AUV) dynamics. The filtering model accounts for the SDE of the state vector coupled with noisy observation equation. This paper is an extension of a recently published paper, Sharma and Hirpara (2014), in the following senses: (i) this paper revisits the stochastic underwater vehicle dynamics in the continuous-discrete non-linear filtering sense. On the other hand, the Fokker–Planck setting and multi-dimensional stochastic differential rules were the major ingredients to analyse the stochasticity of the AUV dynamics in Sharma and Hirpara (2014). (ii) This paper accounts for the contributions of the process noise correction term as well as the observation noise correction term in the non-linear filtering equations of the AUV dynamics. On the other hand, the observation noise correction term is ignored in Sharma and Hirpara (2014). Secondly, this paper can be regarded as a step towards resolving an open problem stated in Aguiar and Hespanha (2003: 1993) as well as extending the work of Aguiar and Pascoal (2007) in stochastic perspectives. Filtering theory plays a central role in navigation of AUVs. Zhao et al. (2014) developed a particle filter for fault diagnosis and robust navigation of underwater robots. Allotta et al. (2016) developed a new AUV navigation system exploiting unscented Kalman filter. Rigatos et al. (2017) worked on AUV control and navigation via differential flatness theory and derivative-free non-linear Kalman filtering. Alzahrani (2018) developed an AUV navigation system using acoustic and inertial sensors. To understand underactuated AUV non-linear finite-time tracking control based on command filter and disturbance observer see Xu et al. (2019). In Demirbaş (2007, 2010), ‘non-linear discrete-time systems’ were the subject of investigations from the prediction viewpoint. On the other hand, the ‘non-linear continuous-time system’ coupled with discrete observation equation is the subject of investigations.
The major ingredients of this paper are the famous Kolmogorov backward equation as well as the evolution of conditional characteristic function of the underwater vehicle SDE. The complexity associated with non-linear filtering for the ‘continuous state-discrete measurement system’ is chiefly attributed to two factors. First, the continuous-discrete filtering algorithm, a two-stage estimation procedure, encompasses the prediction algorithm not accounting for observation terms. The filtering algorithm at the discrete-time instant accounts for observation correction terms. As a result of these, the continuous-discrete filtering involves two different sets of conditional mean and conditional variance evolution equations. On the other hand, the non-linear filtering for the ‘continuous state-continuous measurement system’ involves one set of conditional mean and conditional variance evolution equations.
Second, deriving the non-linear filtering equations under ‘nearly’ Gaussian assumptions requires replacing the higher-order conditional moment with conditional variance terms (Jazwinski, 1970: 336). The relationship involves the concept of the conditional characteristic function as well as greater permutation terms resulting in lengthy expressions. On the other hand, non-linear filtering for the continuous state-continuous measurement is a one-stage procedure. Perhaps these are the reasons that non-linear continuous-discrete filtering algorithms for potential control problems are relatively much less explored in contrast to non-linear continuous filtering algorithms.
The underwater vehicle filtering
The deterministic AUV model is available in well-known books and seminal papers, for example Aguiar and Pascoal (2007) and Fossen (1994).
where
or
where the term
After accounting for stochastic correction terms in the external forces and the moments of external forces in the white noise setting, we find the following time-varying non-linear Itô SDE in the formal setting (Sharma and Hirpara, 2014):
where
The term
The Inertial Measurement Unit is the preliminary sensor system of underwater vehicles. It is one of the units of the Inertial Navigation System of underwater vehicles. In recent trends of measurement systems, naval dynamists can measure linear and angular velocities with the Photonics Inertial Navigation System; for more detail see Marani and Yuh (2014). In non-linear filtering sense, observations or measurements can be continuous or discrete, and that depends on the measuring instruments. If available observations are continuous, that combines continuous dynamics and continuous measurements. On the other hand, if available observations are discrete, the combination becomes a continuous-discrete filtering model of underwater vehicles. This paper considers two sets of discrete observation equations. The first set of observation equations includes linear velocity measurements of the AUV. The second set of observation equations includes angular velocity measurements. In general, the non-linear discrete observation equation is
The terms
The second set of observation equations can be formalized by taking angular velocity measurements. Thus,
Equation (2) in combination with equation (4) becomes a filtering model of the underwater vehicle. Equation (2) coupled with equation (5) becomes the second filtering model. Thus, this paper develops the non-linear filtering of the underwater vehicle SDE by considering two filtering models resulting from available discrete measurements on linear and angular velocities. The main theoretical results of the paper are summarized in the form of a Lemma and a Theorem as well as their proof.
where the stochastic process
The evolution of the conditional characteristic function evolution is
After combining equation (8) with equations (2) and (3), we get the conditional characteristic function evolution of the underwater SDE. As a result of this, the conditional characteristic function evolution of the underwater vehicle SDE is
Here, we take a pause and explain the method for deriving the above expression. The above is the consequence of a multi-dimensional stochastic differential rule. Thanks to a Theorem (3.3) of Revuz and Yor (1999: 147), we arrive at the stochastic evolution of the scalar function
After the action of the expectation operator on the stochastic evolution, we arrive at
The above can be recast in the Kolmogorov backward operator setting as
where the term
Note that the notations 〈〉, 〈,〉 are different in the sense that the former denotes the expectation operator and the latter denotes the inner product. For greater detail see the Appendix of the paper. The right-hand side of equation (10) denotes the inner product. The term
QED
Furthermore, the conditional mean equation of the AUV filtering at the observation instant for the measurement system of equation (4) is
where the subscript
The conditional mean equation of the AUV filtering at the observation instant for the measurement system of equation (5) is
where the subscript
Note that equation (4) is the first measurement system and equation (5) is the second measurement system. We state the filtering equations for the both measurement systems.
Suppose
After introducing the state vector of equation (2) into equation (14) component wise, we get equation (11) of the Theorem. This completes the proof of the first part of the Theorem of the paper.
QED
The second part of the proof of the Theorem, conditional mean equation at the observation instant, exploits the results stated in Jazwinski (1970: 344). The proof of the second part is straightforward. A simple calculation of the variance matrix arises that is attributed to the discrete linear observation equation; see equations (4) and (5) of the paper. We omit the detail.
It is important to note that the structure of the filtering equation is judged on the basis of measurement systems. This paper adopts two measurement systems, see equations (4) and (5). Thus, we find two different conditional mean equations at the observation instant, i.e. equations (12) and (13) of the Theorem of the paper.
Remark 1: Equation (11), the conditional mean equation, can be alternatively expressed as the evolution equation, i.e.
where the conditional variance matrix
Since the input argument of the vector
Remark 2: Equation (12) describes the conditional mean equation at the observation instant. The conditional mean equation for the AUV filtering at the observation instant can be expressed alternatively as
and the conditional variance equation becomes
The above expressions embed two notations
The Taylor series expansion of the system non-linearity, diffusion coefficient and measurement non-linearity around the conditional mean is a mathematical technique to achieve filtering in stochastic processes. The Carleman realization is a celebrated bilinearization method for the non-linear state equation. However, the Carleman realization (Kowalski and Steeb, 1991; Rugh, 1981) to filtering equations introduces formidable complexity. The complexity is attributed to the action of the conditional expectation operator in addition to the power series expansion in the Kronecker product setting.
Note that the AUV filtering is a two-stage estimation that comprises a system of equations, equations (11) and (12) for the first measurement system of equation (4) and equations (11) and (13) for the second measurement system of equation (5). On the other hand, the AUV estimation of Sharma and Hirpara (2014) is a one-stage that comprises equation (11) of this paper. Thus, the AUV filtering of the paper also accounting for discrete observations is an extended and a refined version of the recently published results in Sharma and Hirpara (2014).
Remark 3: Here, we wish to make a sensitivity remark for non-linear filtering. As the filtering involves the process noise and observation noise correction terms, the closed-form expression of the conditional variance
Graphical notations: In Figures (1) to (18) of the paper, the solid line trajectory denotes the filtered trajectories of the components of the state vector. The dotted line trajectory denotes the true perturbed state trajectories of the components of the state vector.

The true and estimated states: first component.

The true and estimated states: second component.

The true and estimated states: third component.

The true and estimated states: fourth component.

The true and estimated states: fifth component.

The true and estimated states: sixth component.

The true and estimated states: first component.

The true and estimated states: second component.

The true and estimated states: third component.

The true and estimated states: fourth component.

The true and estimated states: fifth component.

The true and estimated states: sixth component.

The true and estimated states: first component.

The true and estimated states: second component.

The true and estimated states: third component.

The true and estimated states: fourth component.

The true and estimated states: fifth component.

The true and estimated states: sixth component.
Numerical experimentations
Here, we demonstrate simulations of underwater vehicle non-linear filtering. This accounts for the underwater vehicle–ocean current stochastic interaction as well as noisy measurements on the linear as well as angular velocities. Two different sets of initial conditions, stochastic autonomous system parameters and process noise and observation perturbations are exploited to accomplish numerical experimentations. For the numerical testing of non-linear linear filtering of this paper, we adopt the method of Germani et al. (2002) for numerical studies. In Germani et al. (2002), filtering for bilinear stochastic differential system was achieved by contrasting the filtering trajectory with the true perturbed state trajectory. For the numerical simulation of the AUV filtering, we consider two different measurement systems, equations (4) and (5) of the paper. This allows the efficacy of the AUV filtering under a variety of conditions. Thus, consider the following set of system parameters, initial states (Sharma and Hirpara, 2014; Singh et al., 2009; Smith, 2008) for the numerical simulation of filtering equations (11) and (12) of this paper in Table 1.
AUV system parameters.
A set of the diffusion parameter vector is
The diffusion parameter decides the process noise intensity. The diffusion coefficient is a consequence of the process noise coefficient matrix that can be regarded as stochastic correction term in the conditional variance evolution.
As this paper is chiefly about AUV non-linear filtering, we choose the observation noise variance matrix
The other finite values of the components of the observation noise variance matrix
This suggests that the filtering trajectories follow the true perturbed state trajectories. The root mean square calculation of stochastic systems is appealing for linear scalar cases, where the closed-form expression of the state is possible. On the other hand, as this paper accounts for a vector non-linear case, where the closed-form expression is not possible, we adopt the evolution of conditional variance setting. The conditional evolution equation setting is standard and popular in filtering (Jazwinski, 1970: 178) and accounts for process noise correction terms as well as observation noise correction terms.
For the given set of system parameters, the process and observation noise intensities, the AUV conditional variances are of the order
The AUV conditional variance (the observation noise variance
Further, we achieve the AUV filtering simulations by considering the relatively larger observation variance. The observation noise variance matrix for the second case is
The filtering trajectories and true perturbed state trajectories, Figures (7–12), can be argued similar to the first filtering model. The linear velocity observation case of Figures (7–12) denotes observation correction term contributions to the filtering asymptotically vanish. The predicted estimate becomes the filtered estimate and the filtered-true state difference increases (Sharma, 2009). Figures (7–12) justify this.
We consider the third case of the AUV filtering simulation by considering the measurement system of equation (5). This considers measurements on the angular velocity vector. Note that the observation noise variance matrix
The angular velocity observation case of Figures (13–18) denotes observables are greatly masked with noise. The contribution of observation correction terms involving the term
Conclusion
In this paper, we achieve non-linear filtering of the AUV dynamics coupled with the ocean current stochasticity. This paper adopts the Itô process to account for the ocean current stochasticity. The non-linear filtering of the paper is a two-stage estimation procedure that comprises two sets of equations. The first set is a consequence of the Kolmogorov backward equation and the evolution of conditional characteristic function of the vector Itô process. The second is a consequence of Bayesian statistics.
Most notably, this paper can be regarded as a first paper that resolves an open problem recommended in Aguiar and Hespanha (2003: 1993). The open problem is ‘how to account for ocean stochasticity in the AUV dynamics as well as analyse them in non-linear filtering perspective’. The non-linear filtering equations coupled with the control signal for the underwater vehicle SDE becomes the stochastic optimal control of the underwater vehicle. This paper attempts the first part. The second part deserves investigation. The second part can be addressed by exploiting the HJB equation, a second-order non-linear partial differential equation, for the Itô SDE.
Another achievement of the paper is to introduce the notions of non-linear filtering into autonomous systems by considering a specific case involving ‘mathematical rigour’.
After investigations into the AUV filtering, the following problem merits resolution. After testing the observability, we design an observer. Second, the stochastic version of the observer is the stochastic filter that this paper intends to achieve. The closed-form observability matrix for the linear time-invariant case is convenient. The closed-form exact observability matrix for the non-linear time-invariant case is formidable. It is important to state that the AUV dynamics is non-linear and stochastic, the closed-form expression of the AUV observability matrix is an open problem.
Footnotes
Appendix
Here, we explain briefly the Kolmogorov–Fokker–Planck equation (KFPE) and the Kolmogorov Backward Equation (KBE) for Markov processes. Notably, the KFPE is also known as the KFE, the Kolmogorov Forward Equation. The operator associated with the KFE is the Kolmogorov forward operator and the operator associated with the KBE is the Kolmogorov backward operator. The cornerstone relation is
where the notation
An appealing property of the Kolmogorov backward operator is that it has adjoint property. The adjoint of the backward operator is the forward operator. Here, we explain briefly the usefulness of the KBE that turns to the usefulness of the Kolmogorov backward operator. The Kolmogorov backward operator becomes the differential generator for the stability of stochastic differential systems. Furthermore, the Kolmogorov backward operator arises in the filtering evolution equation. In the stochastic control, the Kolmogorov backward operator arises in the HJB equation of the Itô process as well. This unfolds the beauty, power and universality of the Kolmogorov equations in dynamical systems and stochastic control. The Kolmogorov backward operator has found its applications in ‘estimation theory’ and ‘stability’ of Itô SDEs.
Acknowledgements
The authors express their gratitude to the anonymous reviewers and Associate Editor for fine comments on the paper that have led to improvement in the paper as well as made the paper error-less.
Declaration of conflicting interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
