Abstract
With the advent of the information age, people have higher requirements for basic algorithms. Meta-heuristic algorithms have received wide attention as a high-level strategy to study and generate fully optimized solutions to data-driven optimization problems. Using the advantage of equilibrium optimizer (EO) with better balance mode, combined with the strategy of memetic algorithm, different proportion of temperature is introduced in different stages. That is, EO and thermal exchange optimization (TEO) are fused to obtain a new highly balanced optimizer (HEO). While keeping the guiding strategy and memory mode unchanged of EO, the accuracy of optimization is greatly improved. 14 well-known benchmark functions and 7 selective algorithms were used for HEO evaluation comparison experiments. On the basis of the fitness function curve, the optimal solution and other experimental data are tested statistically. The experimental results show that the improved algorithm has high accuracy and stability, but at the cost of running a little more time. Application testing of complex engineering problems is also one of the main purposes of algorithm design. In this paper, three typical engineering design problems (three truss, welded beam and rolling bearing design) are tested and the experimental results show that this algorithm has certain competitiveness and superiority in classical engineering design.
Keywords
Introduction
Algorithm refers to an accurate and complete description of the solution plan and a series of clear instructions to solve the problem which represents the strategy mechanism of using systematic methods to describe the solution. “Dichotomy” and “Newton iterative method” belong to approximate iterative method. Iterative algorithm is a basic method to solve problems by computer. In recent years, the iterative algorithm has attracted much attention because of the meta-heuristic optimization algorithm. Meta-heuristic algorithm is a basic method, independent of the existence of the problem. With its wide applicability, particle swarm optimization (PSO) [1], flower pollination algorithm (FPA) [2], whale optimization algorithm (WOA) [3] and other algorithms have been proposed successively. Most meta-heuristic algorithms are inspired by biological habits and physical phenomena in reality. Because the mathematical modeling of these phenomena is relatively simple, the introduction of meta-heuristic algorithm gradually enters the climax.
The pure meta-heuristic algorithm usually requires the author to have a deep understanding of a certain phenomenon or a certain concept so as to obtain a perfect mathematical modeling. This makes creation not so easy. At the same time, it is found that the advantages of an algorithm may have some defects, so people think of improving the pure algorithm for a certain problem. For example, chaos initialization [4] improved initialization, Levy flight strategy [5] improved particle step size, and Opposition-based Learning (OBL) strategy [6] enhanced optimal solution accuracy. The hybrid algorithm can also be regarded as an improvement of the algorithm, which combines the two algorithms to make up for each other’s shortcomings, so as to achieve the effect that one plus one is greater than two. The application of hybrid algorithm is also very extensive: hybrid gravitational search with multiverse optimization algorithm (GSA-MVO) is used to solve the threshold segmentation problem of color images [7], hybrid whale optimization with simulated annealing algorithm (WOA-SA) can be effectively applied to the problem of feature extraction [8], hybrid flower pollination with clonal selection algorithm (FPA-CSA) is applied to the estimation of photovoltaic parameters [9]. This paper mixes two algorithms based on physical concepts, equilibrium optimizer (EO) [10] and thermal exchange optimization (TEO) [11], and obtains a hybrid algorithm High equilibrium optimizer (HEO).
EO is the most recent algorithm released in November 2019. The inspiration came from a simple hybrid dynamic mass balance optimizer. TEO algorithm was proposed in 2017. Due to its effectiveness and wide applicability, it has also obtained some subsequent promotion and application. Such as improving TEO through Levy flight and other strategies and applying it to multi-threshold segmentation of color images [12]. Mixed with SOA, and use three-dimensional pulse-coupled neural network to process oil image segmentation [13].
The balance of exploration and development in EO has been better prepared. If you want to improve, the most effective way is to improve the accuracy of the different stages. In this regard, the incorporation of temperature changes with different weights in the two stages of quality acceptance and output can be considered as a reasonable approach. Combined with the memetic algorithm strategy which has attracted much attention in recent years, this makes the combination of EO and TEO possible. Through 14 basic functions and 3 practical engineering problems, the effectiveness of the improved algorithm is tested, and finally a conclusion is drawn.
The rest of this paper is structured as follows: In Section 2 describes the EO algorithm briefly; In Section 3, a brief description of TEO and the improved HEO algorithm is made; In Section 4 the experimental results of the test function are introduced and discussed; And the research aspects of solving practical engineering problems with different benchmarks are discussed and analyzed in Section 5; Finally, this paper summarizes the work and describes the perspective of future development.
Related works
With the advent of industry 4.0, the industrial network physical system has been widely concerned. Meta-heuristic algorithm, as the underlying algorithm, is also playing a role in the transition from theoretical breakthrough to practical technology in this core interdisciplinary research field of industry and academia [14, 15]. The innovation of meta-heuristic algorithm is increasing, and the application prospect is becoming more and more extensive. Taking the traditional and representative PSO algorithm as an example, by using it to optimize the parameters of LSSVM and combine it with fuzzy information granulation to realize the function of predicting the change range and trend of freight volume. Which provides a new method for the study of logistics system performance [16]. There are also multi-objective heuristic optimization algorithm is used to solve the controller optimization problem in intelligent control [17]. As an engineering application of similar work in this paper, the hybrid heuristic algorithm GA-IPA (Genetic algorithm and Interior point algorithms) is applied to the calculation of axisymmetric viscoelastic heat transport performance [18].
As can be seen from the literature review, scholars and experts have never stopped exploring. The NFL says there is no single algorithm that effectively solves all optimization problems [19]. This prompted us to try to come up with a new algorithm.
Equilibrium optimizer
A newly proposed dynamic mass balance optimizer EO inspired by a simple well-mixed dynamic mass balance optimizer on a control body, where the mass balance equation is used to describe the concentration of non-active components in the control body as a function of its various source and sink mechanisms. The mass balance equation can be expressed as follows.
where C0 and t0 shows the initial start time and concentration. F is the exponential term which can help EO balance the exploration and exploitation stages.
where Iter and Max _ iter present the current and the maximum number of iterations, respectively. a1, a2 are the constant value which equals 2 and 1, respectively. r is a random vector in [0,1].
The Generation rate G is presented as follows:
Algorithm 1: Pseudocode of EO
A new optimization algorithm based on Newton’s cooling law was proposed in 2017. The basic idea is that the heat loss rate of an object is proportional to the temperature difference of its surroundings.
In the model, some objects are defined as cooling objects, while others represent the environment. The formula for temperature updates between different objects is defined as:
The update formula can be expressed as
The value of β of each object is obtained by Equation 16, and the value of β varies to determine the transformation of the temperature.
Compare the parameters Pro and rand to determine if you need to change the components of each cooling object. If rand < Pro, regenerate a particle by the following formula. This mechanism is used to avoid the algorithm falling into local optimum.
Where, Tj,max and Tj,min are the lower and upper bounds of the jth variable.
Algorithm 2: Pseudocode of TEO
Effective algorithm fusion can make the two or more algorithms of fusion show better performance. The existing fusion methods can be divided into probability fusion, multi-population and memetic algorithm. References [20, 21] and [8] are used as examples, respectively. In this paper an embedded hybrid optimization algorithm is proposed, which is involved in memetic algorithm. The novel algorithm can achieve a high precision solution than the two mixed algorithms.
EO and TEO are belong to the optimization algorithm based on the physical principle. The main purpose of EO algorithm is to balance the mass of the object into the output with time. In order to make the balance optimizer balance system more perfect, it can be considered that the mass input and output are also mixed with the change in heat. Which can be called HEO. In this paper, the combination of EO algorithm and TEO improves the search precision and retain the diversity of population especially in subsequent iterations. EO has made adequate preparations for balancing exploration and exploitation, and TEO here is more like a perfect factor to improve the accuracy of EO in both exploration and exploitation.
Therefore, the pseudocode of HEO algorithm can be expressed as flow.
Algorithm 3: Pseudocode of HEO
It is well known that there is heat transfer in the process of mass exchange. You can think of heat as always going from high mass to low mass. In the early stage of mass conversion, heat transfer dominates, and in the late stage, mass conversion dominates. Throughout the conversion phase, generation probability GP represents the probability of participation in the update of the control concentration based on the generation rate. It plays a very important regulatory role. When GP = 1, no generation rate term is involved in the optimization process. This state emphasizes high exploration capability and often leads to inaccurate solutions. When GP = 0, the generation rate term always participates in the process, increasing the locally optimal stagnation probability. Therefore, different proportions of temperature conversion factors are suitable for the two ranges [0,0.5] and [0.5,1]. As a rule of thumb, GP = 0.5 provides a good balance between the exploration and development phases. Furthermore, the flowchart of HEO algorithm is shown in Fig. 1.

The flowchart of HEO algorithm.
In this section, in order to study the numerical efficiency performance of the proposed HEO algorithm, a set of 14 unconstrained functions are taken from the classic benchmark functions CEC2005 (Suganthan et al., May 2005). Which can be divided into two main types: Unimodal (UM) functions: These functions are used to assess the solution precision and the convergence rate of the proposed algorithm. Which can be used to validate the exploitation (hardening) capabilities of different optimizers. As shown in Table 4 is (F1-F7). Multi-modal (MM) functions: These functions can be used to verify the potential of the algorithm to exploration (diversify) and avoid falling into local optimum which are from F8 to F14.
The functional composition, dimension, range limitation and optimal position of functions has been given in the table. It is noteworthy that Dim represents the number of variables designed for mathematical functions.
Experimental setup
All the experimental series were carried out on MATLAB R2017b (The Math Works Inc., Natick, MA, USA), and the computer was configured as Intel(R) Pentium (R) CPU G4560 @3.50 GHz (Intel, Santa Clara, CA, USA), using Microsoft Windows 7 system (Microsoft, Redmond, WA, USA).
Comparison of each algorithm’s performance
In order to verify the performance of the proposed algorithm, the proposed HEO is compared with 7 other state of the art optimization algorithms according to the test function results. As the basic algorithm, EO and TEO are necessary to give the comparison results. GSA, MVO and SCA are the representatives in the meta-heuristic algorithm based on physical principles. SHO and GWO lead the population renewal pattern similar to EO. The details of the comparison algorithm are as Table 2, where the parameter values and references are given. The population size N is set to 30 and the number of iterations Max _ iter is set to 500 for fair comparison. Meanwhile, all experiments are conducted 30 times.
Benchmark functions
Benchmark functions
Parameters of the algorithms
Comparative results on benchmark functions
Computation time
To data visualization, facilitate comparison and analysis, eight of the algorithm convergence curve as shown in Table 6. Mathematical statistics were made for the 30 optimal results obtained by each algorithm, and corresponding box graphs were generated. Due to space limitation, functions 1, 4 and 7 from UM function and 10, 13 from MM function are selected. According to the convergence curve, HEO is superior to other methods in most cases, and can maintain population diversity to some extent in the late period of renewal. HEO has advantages in both exploration and development, and it is likely to find a better solution in the exploration stage. EO is roughly second in each set of experiments, and sometimes gets a better optimal solution than HEO. GSA is probably because it’s an earlier algorithm, and it’s not perfect enough so every set of experiments is the worst, but its contribution to optimization cannot be denied.
The STD values of benchmark functions
The convergence curve and Boxplot
The running time in Table 4 can also be seen by the convergence curve. The shortest running time data has been marked in bold. According to the data results, TEO has the fastest running time among many algorithms and shows the fastest convergence in the curve. It is clear that HEO and EO time rank relatively low, both in the same order of magnitude. This indicates that the mixing of EO and TEO has been largely improved with less time sacrificed, which also benefits from the fast convergence of TEO.
In order to further evaluate the stability of the algorithm, the boxplot is selected on the graph, which is given after the corresponding convergence curve, and the lower box represents the excellent stability. HEO is always at the bottom and rarely fluctuates. STD values of 30 fitness function values are selected numerically, as shown in Table 5. Generally, the smaller the value of STD is, the better the stability is. HEO contains the largest number of minimum values, accounting for approximately 50%. The combination and correspondence of the two can prove the stability of HEO. SCA, SHO, and GSA are not very stable to some extent.
In order to prove that there are significant differences between algorithms. Wilcoxon rank sum test was further tested by non-parametric statistics [27], assuming a significance level of 5%. A more detailed description of the Wilcoxon rank-sum test can be found in literature. The experimental results are given in Table 7. A p value greater than 0.05 indicates no significant difference between the two groups, while a p value less than 0.05 indicates significant difference. All of the 90 cases achieved good results, indicating that HEO was significantly different from the other 7 algorithms.
P-values of the Wilcoxon rank-sum test over 30 runs (p > 0.05 has been in bold)
The effectiveness of a good algorithm lies in its application. HEO has shown certain advantages in different types of functions in the previous section. Next, three engineering problems were selected for further testing. They are: welded beam design problem, three-bar truss design problem, rolling element bearing problem. For the sake of simplicity, all problems are implemented in MATLAB through the barrier penalty function. The results obtained by HEO and the corresponding results of different algorithms are listed in the table at the end of each engineering problem. The HEO runs independently for each project 30 times, with a selected remora population of 30 and an iteration of 500. Finally, make a corresponding evaluation for different issues.
Welded beam design problem
As it named, this problem deals with designing a welded beam to minimize the fabrication cost [28]. The minimization process is subject to some constraints such as shear stress, bending stress in the beam, buckling load on the bar, end deflection of the beam, and side constraints. This optimum design has four parameters: thickness of weld (h), length of the clamped bar (l), height of the bar (t), and thickness of the bar (b) as shown in Fig. 2. The mathematical formulation is also illustrated as follows:

Schematic of the welded beam (Above: Engineering drawing, Below: 3D).
This problem has also tested and the results are shown in the Table 8. It is shown that the proposed algorithm can find the lowest cost design. Thus, it is reasonable to think that the proposed algorithm is feasible in solving such problems.
Comparison results of tensions/compression spring design
As one of the most researched work cases [28], it is often used by various algorithms for testing. This task is also a minimization problem, mainly to find the minimum of the total weight of the structure. Figure 3 illustrates the shape of the truss and the associated forces on the structure. The figure contains two parameters: Area of strip 1 = Area of strip 3, and Area of strip 2. This problem can be mathematically described as follows:

Schematic of the Three-bar truss design (Left: 3D, Right: Engineering drawing).
Table 9 shows the detailed results of other algorithms and proposed HEO. Based on the results in Table 9, HEO is significantly better than other optimizers, and HEO is observed to be exceptionally competitive.
Comparison results of the welded beam design
Different from the previous problems, this engineering problem is the maximum value of the dynamic bearing capacity of the solution target [29]. A total of 10 variables are included, a schematic of which is shown in Fig. 4. The test case is expressed as follows:

Schematic of the pressure vessel [3].
This test results has shown in the following Table 10. As it represents, the proposed algorithm can reach the lowest cost design. Therefore, it is hopefully that the proposed algorithm is suitable for such problems.
Comparison results of the pressure vessel design
An algorithm combined with EO and TEO is put forward which called HEO. The good balance in EO combined with the high accuracy and rapidity of TEO improves the optimization accuracy of HEO in both exploration and exploitation stages. It can also be seen from the convergence curve that the ability of population renewal is also improved in the late iteration. The stability and accuracy have been improved, and the robustness of the algorithm has been strengthened. According to the evaluation of the experiment, HEO is better than EO and TEO. Accuracy has improved significantly, even better than algorithms that have similar bootstrap strategies, such as GWO and SHO. HEO algorithm has strong stability and feasibility, and even has strong competitiveness in engineering problems. The success of fusion also proves the effectiveness of memetic algorithm strategy. Substance exchange and heat transfer are actually a continuous process, but this paper uses the idea of leaders in weight ratio, so an adaptive weight ratio can be designed in the future to achieve a more suitable balance. And the algorithm can also be applied to other fields, such as image segmentation feature selection and multi-objective problem.
Footnotes
Acknowledgment
This work was supported under Educational research project for young and middle-aged teachers of Fujian Provincial Department of Education, Guiding project of Sanming science and technology plan, Sanming University introduces high-level talents to start scientific research projects (20YG14).
