Gradient-based iterative algorithm for solving the generalized coupled Sylvester-transpose and conjugate matrix equations over reflexive (anti-reflexive) matrices
Available accessResearch articleFirst published online February, 2014
Gradient-based iterative algorithm for solving the generalized coupled Sylvester-transpose and conjugate matrix equations over reflexive (anti-reflexive) matrices
Linear matrix equations play an important role in many areas, such as control theory, system theory, stability theory and some other fields of pure and applied mathematics. In the present paper, we consider the generalized coupled Sylvester-transpose and conjugate matrix equations
where is a group of unknown matrices and for ,
in which , , , , , , , and are given matrices with suitable dimensions defined over complex number field. By using the hierarchical identification principle, an iterative algorithm is proposed for solving the above coupled linear matrix equations over the group of reflexive (anti-reflexive) matrices. Meanwhile, sufficient conditions are established which guarantee the convergence of the presented algorithm. Finally, some numerical examples are given to demonstrate the validity of our theoretical results and the efficiency of the algorithm for solving the mentioned coupled linear matrix equations.
In this paper, the following notation is utilized. We use to denote the trace, the transpose, the conjugate transposed, the conjugate of the matrix , respectively. Moreover, represents the set of all complex matrices. The set of all symmetric orthogonal matrices, also known as reflection matrices, in is represented by , i.e. if and only if P = PH = P−1.
Definition 1.1 (Chen, 1998). Consider two arbitrary given matrices . The matrix is called a reflexive matrix, with respect to and , if . The set of all reflexive matrices, with respect to and , is denoted by
Definition 1.2 (Chen, 1998). Consider two arbitrary given matrices . The matrix is called an anti-reflexive matrix, with respect to and , if . The set of all anti-reflexive matrices, with respect to and , is denoted by
In various research works, the hierarchical identification principle has been exploited to present different algorithms for specific problems. The idea has been originally utilized by Ding and Chen (2005a–e). For example, Ding and Chen (2005a) have obtained the lifted state-space models for general dual-rate systems with different updating and sampling periods. Furthermore, based on a hierarchical identification principle, estimation algorithms have been presented to identify the canonical lifted models based on the given dual-rate input–output data in which the causality constraints of the lifted systems have been taken into account. In another paper, Ding and Chen (2005b) have expanded a hierarchical least squares iterative (HLSI) algorithm and a hierarchical least squares (HLS) algorithm, invoking a hierarchical identification principle, for multivariable discrete-time systems described by transfer matrices. In an alternative paper, Ding and Chen (2005c) have propounded a hierarchical gradient iterative algorithm and a hierarchical stochastic gradient algorithm and established that the parameter estimation errors given by the algorithms converge to zero for any initial values under persistent excitation. Some of the recently published works, related to this subject, include Ding et al. (2011), Han et al. (2010), Liu et al. (2012), Wang et al. (2012) and Zhang et al. (2011).
The gradient-based iterative algorithm is a different common approach for solving linear matrix equations (for further details see Ding and Chen (2005d, 2006) and Ding et al. (2008, 2010)Ding and Chen (2005e) have presented a family of iterative methods for solving the coupled matrix equations by using hierarchical identification principle and the star product. More precisely, Ding et al. (2008) have considered the solution of and . Dehghan and Hajarian (2011b) have proposed two algorithms for solving the following the matrix equation
over reflexive and anti-reflexive matrices.
In an alternative paper, Dehghan and Hajarian (2012a) have employed the idea of the Gradient-based iterative method to construct two iterative algorithms for computing the generalized bisymmetric and skew-symmetric solutions of the linear matrix equation
Moreover, Song et al. (2011) have considered the following coupled Sylvester-transpose matrix equations
where , , , , , , , are given matrices and are the matrices to be determined.
More recently, a gradient-based iterative method has been proposed for solving the following coupled linear matrix equations
In addition, Dehghan and Hajarian (2012c) have presented a gradient-based iterative method for solving the generalized coupled Sylvester matrix equations which contain (coupled) Sylvester and Lyapunov matrix equations as special cases.
For simplicity, we use the following linear operator
such that
where and .
In the present work, we will construct a gradient-based algorithm for solving the following coupled linear matrix equations
over the group of reflexive (anti-reflexive) matrices. Evidently, the coupled linear matrix equations (1.5) are extremely general and include many investigated linear matrix equations such as the generalized (coupled) Sylvester and Lyapunov matrix equations, (1.1), (1.2), (1.3) and (1.4).
Problem reformulation
We will focus on the following problems and construct an iterative algorithm for obtaining the solutions of these problems.
Problem 1. Assume that the matrices , , , , , , , , and are given. Find the reflexive matrix group such that and satisfy (1.5) where .
Problem 2. Assume that the matrices , , , , , , , , and are given. Find the anti-reflexive matrix group such that and satisfy (1.5) where .
The reminder of this paper is organized as follows. In Section 2, we recall some definitions and theorems which are used for presenting our main theoretical results. In Section 3, first, we investigate the solvability of Problems 1 and 2. Then, an algorithm is proposed for solving these problems. Convergence analysis of the algorithm is also discussed. In order to illustrate the validity and applicability of our presented results, we give some numerical examples in Section 4. Finally, the paper is ended with a brief conclusion in Section 5.
Preliminaries
In this section, we review some necessary principles and definitions which are utilized throughout this work.
Definition 2.1. Suppose that and where for . We define the inner product as follows:
Remark 2.2. For , for , the norm of is defined by
Assume that and defined over complex (real) number field, the Kronecker product of the matrices and is defined as the matrix The “” operator transforms a matrix of size to a vector of size by stacking the columns of . In this paper, the following relation is utilized (Bernstein, 2009):
Lemma 2.3. Let be an arbitrary matrix. Then
where is uniquely determined by the integers and .
where is uniquely determined by the integers and .
Some properties of the matrix are given as follows (Li et al., 2010b):
For two arbitrary integers and , has the following explicit form
where each for and , is an matrix with the element at position being one and the others being zero.
For two arbitrary integers and , is the unitary matrix, i.e.
For two arbitrary integers and , .
Main results
This section consists of two parts. In the first part, the solvability of Problems 1 and 2 is discussed. In the second part, we give an iterative algorithm for solving the coupled linear matrix equations (1.5) over reflexive (anti-reflexive) matrices. In addition, sufficient conditions are established which guarantee the convergence of the proposed algorithm.
Solvability of the Problems 1 and 2
By some straightforward computations, we can prove the following lemmas.
Lemma 3.1. Problem 1 is solvable if and only if the system of matrix equations
are consistent, where is defined such that in which the matrices are given for .
Proof. Without loss of generality, we may assume that . Suppose that the matrix group is satisfied in Equation (3.1). Therefore,
Now, we define the matrix group such that
Evidently, is a group of reflexive matrices, i.e. for It is easy to verify that for
which shows that the matrix group is the solution of Problem 1.
Conversely, let the matrix group be the solution of Problem 1. That is
and is satisfied in Equation (1.5). Hence, the proof can be concluded immediately from the fact that for □
Analogous to the strategy employed in the proof of Lemma 3.1, we may establish the following lemma.
Lemma 3.2. Problem 2 is solvable if and only if the system of matrix equations
are consistent, where is defined such that in which the matrices are given for .
Assume that the matrices and are defined as follows:
and
Let us assume that
It is not difficult to see that Equations (3.1) and (3.2) are equivalent to the following to the following linear systems, respectively,
and
Now, we can conclude the following theorems from Lemmas 3.1 and 3.2.
Theorem 3.3. Problem 1 has a unique solution if and only if and has full column rank. The unique reflexive solution group of Problem (1) can be calculated as follows:
where is derived such that
Theorem 3.4. Problem 2 has a unique solution if and only if and has full column rank. The unique reflexive solution group of Problem 2 can be calculated as follows:
where is derived such that
Proposed algorithm
In this section, by developing the idea of gradient based iterative method, we propose an iterative algorithm to compute the reflexive and anti-reflexive solutions of Equation (1.5).
Before presenting the algorithm, for , we define the linear operators as follows
such that , and
for .
Algorithm 1 (Proposed algorithm for Problems 1 and 2).
Step 1. Input the matrices , , , , , , , , , , for and .
Step 2. Set for computing the solution of Problem 1, and for Problem 2. Choose a tolerance .
Step 3. If , select the initial reflexive group of matrices
Otherwise select the initial anti-reflexive group of matrices
Step 4. Set . For compute
Step 5. Determine the integer values , for and such that if , for all , set , where for . Otherwise, set .
Step 6. For Do:
If , set
Otherwise
If , set
Otherwise
If , set
Otherwise
If , set
Otherwise
Step 7. For calculate Set
Step 8. Compute where
Step 9. If then Stop; otherwise, set and go to Step 6.
Theorem 3.5. Suppose that the matrix equation (1.5) has unique reflexive solution group If the parameter satisfies the inequality
such that where,
Then the iterative solution group, computed by Algorithm 1 (with ), converges for any initial reflexive matrix group
Proof. Without loss of generality, we may assume that for and . For we set
It is not difficult to see that
For the matrix groups , , and , we define
and the matrix group is defined such that for .
It is obvious that . Therefore,
From Algorithm 1, with , it is known that is a reflexive matrix group, i.e. where the matrices are given and . For given arbitrary matrices , it is not difficult to see that . In addition, is a group of reflexive matrices, i.e. for . Therefore,
In the above relations, we set . Similarly, we can see that
and,
Assume that
By some straightforward computations, we get
As satisfies in (3.4), by some straightforward computations, we have:
Therefore,
which shows that
From the convergence theorem of series, we conclude that
Hence,
or, equivalently,
From Theorem 3.3, we can conclude the result immediately.□
With the same strategy as employed in the proof of Theorem 3.5, we may establish the following theorem.
Theorem 3.6. Suppose that the matrix equation (1.5) has unique anti-reflexive solution group If the parameter satisfies the inequality
such that where
Then the iterative solution group, computed by Algorithm 1 (with ), converges for any initial anti-reflexive matrix group
Numerical experiments
In this section, we present two numerical examples to show the effectiveness of the proposed algorithm. All of the numerical experiments presented in this section were computed in double precision with some Matlab codes on a Pentium 4 PC, with a 3.06 GHz CPU and 1.00 GB of RAM.
Example 4.1. We consider the following matrix equation
where
and
The exact solution of (4.1) is
which is -reflexive, where
Here, we mention that .
We apply Algorithm 1 with to solve Problem 1 corresponding to system (4.1). The initial guess was taken to be the zero matrix and the stopping criterion
was used, where is the residual of (4.1) at th iteration. For and the method converges in 53, 73 and 92 iterations, respectively. For , the computed solution is
which is in good agreement with the exact solution. In Figure 1 the convergence history of the method is displayed.
Plot of versus for the -reflexive solution of (4.1).
We now consider (4.1) with the right-hand side
The exact solution of the system is
which is in where and are defined by (4.2). All of the other assumptions are as before. Applying Algorithm 1 to the matrix equation with , the method converges in 82, 101 and 154 iterations for and , respectively. For the computed solution is
We observe that the method has provided a good approximate solution for the system. The convergence history is displayed in Figure (2).
Plot of versus for the -anti-reflexive solution of (4.1).
Example 4.2. In this example, we consider the system of matrix equations
where
and
The exact solution of Equation (4.3) is the matrix group where
Here, where and are as in previous example and , where
We apply Algorithm (1) with for solving system (4.3). The initial guess was taken to be the zero matrix group and the stopping criterion
was used, where is the residual of the th equation of (4.3) at iteration . For , and the method converges in 79, 110 and 181 iterations, respectively. For the computed solution is , where
As seen the computed solution is in good agreement with the exact solution. In Figure 3 the convergence history of the method is displayed.
Plot of versus for the -reflexive of (4.3).
We now change the right-hand side of (4.3) to
In this case, the exact solution of the system is , where
We have , for . All of the assumptions are as before. Algorithm 1 with converges in 180, 223 and 336 iterations for , and , respectively. For the computed solution by Algorithm (1) is where
The convergence history of the method is shown in Figure 4.
Plot of versus for the -anti-reflexive of (4.3).
Based on our numerical results, analogous to Xie et al. (2009), it seems that that larger may lead to a faster convergence rate. Using the matrix (introduced by Equation (3.3)) and a similar approach to that examined by Wang and Liao (2012), we may obtain the optimum parameter . Nevertheless, determining the optimum parameter depends on computing the largest and smallest eigenvalues of which are expensive to calculate in general situations.
Conclusion
This paper has been devoted for finding the reflexive (anti-reflexive) solution group of a general class of complex coupled linear matrix equations. To this end, using a hierarchical identification principle, an iterative algorithm has been constructed. We have established that under certain conditions, the proposed algorithm converges to the reflexive (anti-reflexive) solution group of the mentioned coupled linear matrix equations for any initial reflexive (anti-reflexive) solution group. In order to illustrate the feasibility and effectiveness of the presented algorithm, some numerical experiments have been given.
Footnotes
Acknowledgements
The authors would like to thank three anonymous referees for their helpful comments and recommendations which helped to improve the quality of the paper.
Funding
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
References
1.
BeikFPASalkuyehDK (2011) On the global Krylov subspace methods for solving general coupled matrix equation. Computers and Mathematics with Applications62: 605–4613.
2.
BernsteinDS. Matrix Mathematics: Theory, Facts, and Formulas, 2nd edn.Princeton, NJ: Princeton University Press.
3.
BouhamidiAJbilouK (2008) A note on the numerical approximate solutions for generalized Sylvester matrix equations with applications. Applied Mathematics and Computation206: 687–694.
4.
ChangX-WWangJ-S (1993) The symmetric solution of the matrix equations AX + YA = C, AXAT + BYBT = C and (ATXA, BTXB) = (C, D). Linear Algebra and its Applications179: 171–189.
5.
ChenH-C (1998) Generalized reflexive matrices: special properties and applications. SIAM Journal on Matrix Analysis and Applications19: 140–153.
6.
ChenJLChenXH (2002) Special Matrices. Tsinghua University Press (in Chinese).
7.
DehghanMHajarianM (2008) An iterative algorithm for solving a pair of matrix equation AYB = E, CYD = F over generalized centro-symmetric matrices. Computers and Mathematics with Applications56: 3246–3260.
8.
DehghanMHajarianM (2010) The general coupled matrix equations over generalized bisymmetric matrices. Linear Algebra and its Applications432: 1531–1552.
9.
DehghanMHajarianM (2011a) Analysis of an iterative algorithm to solve the generalized coupled Sylvester matrix equations. Applied Mathematical Modelling35: 3285–3300.
10.
DehghanMHajarianM (2011b) Solving the generalized Sylvester matrix equation over reflexive and anti-reflexive matrices. International Journal of Control, Automation, and Systems9: 118–124.
11.
DehghanMHajarianM (2012a) The generalised Sylvester matrix equations over the generalised bisymmetric and skew-symmetric matrices. International Journal of Systems Science43: 1580–1590.
12.
DehghanMHajarianM (2012b) Two iterative algorithms for solving coupled matrix equations over reflexive and anti-reflexive matrices. Computational and Applied Mathematics31: 353–371.
13.
DehghanMHajarianM (2012c) Construction of an iterative method for solving generalized coupled Sylvester matrix equations. Transactions of the Institute of Measurement and Control. DOI: 10.1177/0142331212465105.
14.
DingFChenT (2005a) Hierarchical identification of lifted state-space models for general dual-rate systems. IEEE Transactions on Circuits and Systems–I: Regular Papers52: 1179–1187.
DingFChenT (2005c) Hierarchical least squares identification methods for multivariable systems. IEEE Transactions on Automatic Control50: 397–402.
17.
DingFChenT (2005d) Gradient based iterative algorithms for solving a class of matrix equations. IEEE Transactions on Automatic Control50: 1216–1221.
18.
DingFChenT (2005e) Iterative least squares solutions of coupled Sylvester matrix equations. Systems Control Letters54: 95–107.
19.
DingFChenT (2006) On iterative solutions of general coupled matrix equations. SIAM Journal of Control Optimization44: 2269–2284.
20.
DingJDingFLiuXPLiuG (2011) Hierarchical least squares identification for linear SISO systems with dual-rate sampled-data. IEEE Transactions on Automatic Control56: 2677–2683.
21.
DingFLiuPXDingJ (2008) Iterative solutions of the generalized Sylvester matrix equations by using the hierarchical identification principle. Applied Mathematics and Computation197: 41–50.
22.
DingJLiuYJDingF (201) Iterative solutions to matrix equations of the form AiXBi = Fi. Computers and Mathematics with Applications59: 3500–3507.
23.
HajarianMDehghanM (2011) The generalized centro-symmetric and least squares generalized centro-symmetric solutions of the matrix equation AYB + CYTD = E. Mathematical Methods in the Applied Sciences34: 1562–1579.
24.
HanHQXieLDingFLiuX (2010) Hierarchical least squares based iterative identification for multivariable systems with moving average noises. Mathematical and Computer Modelling51: 1213–1220.
25.
HuangGXYingFGuaK (2008) An iterative method for skew-symmetric solution and the optimal approximate solution of the matrix equation AXB = C. Journal of Computational and Applied Mathematics212: 231–244.
26.
JbilouKRiquetAJ (2006) Projection methods for large Lyapunov matrix equations. Linear Algebra and its Applications415: 344–358.
27.
LiF-LHuX-YZhangL (2008) The generalized anti-reflexive solutions for a class of matrix equation (BX = C,XD = E). Computational and Applied Mathematics27: 31–46.
28.
LiJ-FHuX-YDuanX-FZhangL (2010a) Iterative method for mirror-symmetric solution of matrix equation AXB + CYD = E. Bulletin of the Iranian Mathematical Society36: 35–55.
29.
LiZ-YWangYZhouBDuanG-R (2010b) Least squares solution with the minimum-norm to general matrix equations via iteration. Applied Mathematics and Computation215: 3547–3562.
30.
LiangMLYouCHDaiLF (2007) An efficient algorithm for the generalized centro-symmetric solution of the matrix equation AXB = C. Numerical Algorithms44: 173–184.
31.
LiuYJDingFShiY (2012) Least squares estimation for a class of non-uniformly sampled systems based on the hierarchical identification principle. Circuits, Systems and Signal Processing31: 1985–2000.
32.
SalkuyehDKToutounianF (2006) New approaches for solving large Sylvester equations. Applied Mathematics and Computation173: 9–18.
WangXWuW (2011) A finite iterative algorithm for solving the generalized (P, Q)− reflexive solution of the linear systems of matrix equations. Mathematical and Computer Modelling54: 2117–2131.
35.
WangDQDingRDongXZ (2012) Iterative parameter estimation for a class of multivariable systems based on the hierarchical identification principle and the gradient search. Circuits Systems and Signal Processing31: 2167–2177.
36.
WangXLiaoD (2012) The optimal convergence factor of the gradient based iterative algorithm for linear matrix equations. Filomat26: 607–613.
WuAGLvLDuanG-R (2011b) Iterative algorithms for solving a class of complex conjugate and transpose matrix equations. Applied Mathematics and Computation217: 8343–8353.
39.
XieLDingJDingFGradient based iterative solutions for general linear matrix equations. Computers and Mathematics with Applications58: 1441–1448.
40.
XieLLiuYJYangHZ (2010) Gradient based and least squares based iterative algorithms for matrix equations AXB + CXTD = F. Applied Mathematics and Computation217: 2191–2199.
41.
ZhangJJ (2011) A note on the iterative solutions of general coupled matrix equation. Applied Mathematics and Computation217 (2011) 9380–9386.
42.
ZhangZNDingFLiuXG (2011) Hierarchical gradient based iterative parameter estimation algorithm for multivariable output error moving average systems. Computers and Mathematics with Applications61: 672–682.
43.
ZhouBDuanGR (2008) On the generalized Sylvester mapping and matrix equation. Systems Control Letters57: 200–208.