Abstract
In this article, we employ a Bayesian framework to estimate parameter and model uncertainty for shape memory alloy bending actuators. The Bayesian framework provides parameter densities, instead of ordinary least-squares optimal point estimates. Bayes’ rule relates a posterior parameter density to a prior density and likelihood. However, the posterior density is difficult to calculate directly for high-dimensional parameter spaces. Markov chain Monte Carlo methods overcome this difficulty indirectly by creating a Markov chain whose stationary density is the posterior. In this article, we utilize the Delayed Rejection Adaptive Metropolis algorithm for estimating parameter uncertainty. The shape memory alloy bending actuator is modeled using the homogenized energy framework, a computationally efficient and accurate model for various transductive materials. The model is summarized, and techniques for estimating the heat transfer parameters are presented. An algorithmic approach to quantifying uncertainty is useful for numerous reasons. The anticipated use is to quantify uncertainty for robust control algorithms. Robust control is an area of considerable research for smart materials such as shape memory alloy; however, the source of uncertainty is rarely quantified. The methods employed here would greatly aid in the design of robust controllers.
Introduction
Shape memory alloys (SMAs) are unique actuators that are gaining increased utilization in prototypes such as robotic catheters (Crews and Buckner, 2012; Veeramani et al., 2008), robotic hands (Laurentis and Mavroidis, 2002), jet chevrons (Hartl et al., 2010a, 2010b), and underwater vessels (Garner et al., 2000). SMA actuators are capable of recovering large strains (approximately 5%) upon heating. However, the design, optimization, and control of SMA devices are complicated by the material’s nonlinear, hysteretic dependence on stress and temperature.
This complex behavior has motivated significant research in the area of robust control, such as sliding mode (or variable structure) control (Ashrafiuon and Jala, 2009; Elahinia and Ashrafiuon, 2002; Elahinia et al., 2005; Esfahani and Elahinia, 2010; Hannen et al., 2011; Shaw et al., 2011; Song et al., 2003; Song and Quinn, 2004; Tai and Ahn, 2011) and
In this article, we present a computationally efficient model for a SMA bending actuator that utilizes the homogenized energy model (HEM). Furthermore, we provide a systematic approach to quantifying uncertainty in the model parameters and model output using Markov chain Monte Carlo (MCMC) methods. The Bayesian framework is based on Bayes’ rule, which relates the posterior density of model parameters to a prior density and the likelihood of those parameters (Gelman et al., 2004). However, the posterior density is difficult to calculate for high-dimensional parameter spaces. MCMC methods overcome this difficulty by creating a Markov chain whose stationary density is the posterior density. Here, we use the Delayed Rejection Adaptive Metropolis (DRAM) algorithm (Haario et al., 2006). The advantage of this approach (and all Bayesian methods) is that we obtain densities for model parameters, instead of optimal point estimates as provided in ordinary least-squares (OLS) estimation. It is possible to estimate parameter densities using OLS approaches and the delta method; however, the approach assumes that the distributions are Gaussian. MCMC methods are able to estimate arbitrary densities.
An algorithmic approach to quantifying uncertainty is useful for numerous reasons. As noted, the anticipated use for SMA actuators (in particular the bending actuator under consideration) is to quantify model uncertainty for control algorithms. Robust control requires some measure of model uncertainty in order to guarantee stability or optimality. For example, sliding mode control requires bounds on model uncertainty in order to ensure the attractiveness of the sliding surface (Khalil, 2002). Utilizing an algorithmic approach to parameter uncertainty quantification would greatly aid in the design of these controllers. Additionally, the results can be used to produce bounds on model output for comparison to experimental data and for model prediction with quantified uncertainties.
The remainder of this article is organized as follows: The model of a flexible structure actuated by a single SMA tendon is presented first. The HEM is used, which has been applied to numerous transductive materials (Crews et al., 2012b; Hu et al., 2011, 2012, in press; Smith, 2005; Smith et al., 2003, 2005a, 2005b, 2006). Next, data-driven techniques for estimating model parameters are summarized. The approach to quantify uncertainty is described, including optimization of model parameters and the MCMC method used here. The experimental setup is briefly described. Finally, the results are presented, including parameter densities and correlations and the forward propagation of model uncertainty.
HEM of a single-tendon SMA bending actuator
The system consists of a flexible structure actuated by a single-SMA tendon, as shown in Figure 1(a). The SMA tendon (actuator) is held a fixed distance from the neutral axis of the flexible structure using rapid-prototyped collets. The SMA actuator is prestrained before it is attached to the axially stiff, laterally compliant flexible backbone. Therefore, a moment is created as the SMA tendon contracts due to Joule heating and the structure bends (Figure 1(b)). Similar robotic systems include catheters and smart inhalers (Furst et al., 2010; Furst and Seelecke, 2011). A mesoscopic free energy model of a catheter was introduced in the study by Veeramani et al. (2008), with further studies by Crews (2011) and Crews and Buckner (2012).

(a) Flexible structure actuated by single SMA tendon and (b) time-lapse photograph of robotic system.
System model
As detailed in the studies by Crews (2011) and Crews and Buckner (2012), the bending angle
where
where
The SMA strain
The SMA strain depends on the stress
by assuming that the relative stress
and
are linear combinations of log-normal and normal densities. The kernels
and
The density coefficients
The mesoscopic (or local) strain
where
The evolution of the phase fractions is governed by the coupled differential equations
and the conservation relation
Substituting equation (8) into equation (7) yields
The transition rates
where
The integral (equation (4)) is discretized using four-point Gaussian quadrature on 20 equal intervals, yielding
where
where
The
where
The ODEs (equation (9)) are discretized and solved using an implicit Euler scheme. For discretized time
where
Note that in equation (13), the transition rates depend on
where
The stress
Equation (12) can be solved using Cramer’s rule, which gives
where
The computational efficiency of the model can be increased by storing four-dimensional (4D) arrays
During implementation, the indices
where componentwise multiplication (

Homogenized energy model for single-tendon SMA bending actuators.
Data-driven techniques for estimating model parameters
The model contains numerous parameters that can be estimated using experimental data. Accurate initial parameter estimates greatly reduce the computation time required during the optimization step. Furthermore, accurate initial estimates may help the optimization algorithms avoid local minima. The majority of the SMA model parameters are estimated using constant–temperature tensile test data (Crews et al., 2012b). Other parameters such as
To estimate the heat transfer model parameters, a step voltage is applied to the SMA actuator (Figure 2(a)) until a steady-state bending angle is reached (Figure 2(b)). The voltage is then set to 0 and the decay in the bending angle is measured. To estimate the convection coefficient

Data used to estimate heat transfer model parameters: (a) input voltage, (b) measured bending angle, and (c) assumed temperature profile.
Since the applied voltage is 0 during this period, the temperature decays according to
neglecting the latent heat. Substituting equation (16) into equation (17) and using equal time steps
Finally, solving for
After determining
where
Model parameters and estimation techniques.
SMA: shape memory alloy.

Stress–strain response of a SMA actuator attached to a flexible structure (load line) with equilibrium stress
A complete list of the model parameters and estimation techniques is provided in Table 1.
Uncertainty quantification framework
Numerous techniques exist to estimate uncertainty in model parameters. Frequentist approaches involve multiple measurements or samples of experimental data. However, collecting large sets of data can be expensive and time consuming. Alternatively, one could fit statistical moments (such as mean and variance) between model and experimental data (Swiler et al., 2008). Here, we employ a Bayesian framework using MCMC methods (Chib and Greenberg, 1995; Green and Mira, 2001; Haario et al., 2001, 2006). First, we fit the model parameters to experimental data using OLS approaches. Then, we use the OLS results to initialize the DRAM algorithm developed by Haario et al. (2006) and available in the study by Laine (2007).
OLS fit of model parameters
The optimization algorithm minimizes the sum of squared error (SSE)
between the experimental data
where
Model parameters and associated bounds.
Here, we are including all the SMA model parameters in the optimization routine. Alternatively, one could optimize the SMA model parameters (such as
MCMC methods
Bayes’ rule
relates a posterior density
MCMC methods avoid the computationally intensive integral in equation (23) by creating a Markov chain whose stationary density is the posterior density
The standard Metropolis–Hastings algorithm proposes new parameters
where
In the special case where
Assuming Gaussian model errors, the likelihood is given by
where
The measurement error
where
and the resulting posterior density is
Therefore, the measurement error
or its equivalent representation
where the parameter
For the SMA bending actuator, the intervals correspond to the bounds listed in Table 2 and used in the OLS estimation.
The Metropolis algorithm uses a Gaussian proposal
where
based on the previous parameter chains
where
as a diagonal matrix based on the magnitude of the OLS optimal parameters. The DRAM algorithm provided in the study by Laine (2007) utilizes equation (30) as the default initial covariance, and heuristically, we have found that equation (30) works well as the initial proposal covariance.
In the standard Metropolis–Hastings and AM algorithms, if
otherwise
However, with DR, if
which ensures that Markov chain’s stationary density is the posterior density. The DR can be iterated any number of stages, with the ith stage having proposal
Here, we are using a second-stage DR. If
and the proposal
is only based on the last accepted values
where
and
The adaptation mechanism (equation (28)) serves as a global adaptive strategy and updates the proposal function accordingly. The DR step provides local adaptation by scaling the proposal when a step leads to rejection. As detailed in the study by Haario et al. (2006), the two strategies complement each other and may lead to faster convergence than the Metropolis algorithm or either strategy used alone. Adaptation helps correct initial proposals where the covariance is too small. However, if the initial covariance is too large, adaptation may proceed slowly. DR helps by scaling down the proposal with each rejected step. A summary of the DRAM algorithm (Haario et al., 2006) for the SMA bending actuator is presented in Algorithm 2.

DRAM algorithm for the SMA bending actuator (Haario et al., 2006).
Results
A prototype of a SMA-actuated flexible structure, as shown in Figure 4, was constructed to gather experimental data. The system consists of a 0.127 mm diameter FLEXINOL SMA actuator (Dynalloy, Inc., Tustin, CA) and a 0.5 mm diameter superelastic Nitinol beam. The bending angle is measured using a trakSTAR three-dimensional (3D) magnetic tracking system (Ascension Technology Corporation, Burlington, VT). Complete details of the experiment are provided in the study by Hannen et al. (2011).

Experimental setup of an SMA-actuated structure.
An input voltage consisting of a sinusoidal function, ramp input, and step input of different magnitudes is used to collect the experimental data, as shown in Figure 5(a). This input quantifies the major loop and various minor loops for the SMA actuator. The resulting measured bending angle is shown in Figure 5(b). The data are first used to fit the model parameters using OLS methods. In this case, we use MATLAB’s lsqnonlin function, which uses either a trust–region–reflective algorithm (Coleman and Li, 1994) or the Levenberg–Marquardt algorithm (Marquardt, 1963). The OLS optimal parameters are then used to initialize the DRAM algorithm. However, out of the 16 model parameters fit using OLS methods, only six are sampled with the DRAM algorithm:

Input voltage used for experimental data.
The DRAM algorithm uses an adaptation interval
The DRAM parameter chains are shown in Figure 6. After 50,000 iterations, the sample chains did not appear to be well mixed; therefore, the algorithm was run for an additional 50,000 iterations. As shown in Figure 6, the chains are fully burned-in and well mixed in the final 50,000 iterations. Only the final 50,000 iterations are used to calculate parameter densities and means.

Parameter chains for (a)
Comparisons between the experimental data and the model output using different parameters are shown in Figure 7. Model fits using the initial parameter estimates are shown in Figure 7(a). A comparison between the OLS fit model and measured bending angle is shown in Figure 7(b). The DRAM mean values are used in Figure 7(c). The initial parameter estimates have a SSE of 448.70, the OLS parameters have a SSE of 4.14, and the DRAM mean values have a SSE of 3.78, which demonstrate an additional advantage of MCMC algorithms. In addition to providing parameter densities, MCMC methods theoretically provide globally optimized values. In practice, one may not know whether the global optimum has been reached. One disadvantage of MCMC methods is the extra computational time. A simulation using the input voltage in Figure 5(a) takes about 0.6 s (approximately 0.5 ms per time step). OLS optimization time is measured on the order of tens of minutes, whereas the MCMC method requires approximately a day for 50,000 iterations.

Bending angle comparison between model and experimental data for (a) initial parameter estimates, (b) ordinary least-squares estimates, and (c) mean DRAM values.
The initial parameter estimates and parameters estimated only with the OLS method are listed in Table 3. Initial, OLS, and DRAM mean values for the parameters that are also sampled by the DRAM algorithm are provided in Table 4. The majority of the OLS and DRAM parameter values are close to the initial estimates, with the exception of the heat transfer parameters.
Comparison between initial estimates of model parameters and ordinary least-squares estimates.
Comparison between initial estimates of model parameters, ordinary least-squares estimates, and DRAM values.
DRAM: Delayed Rejection Adaptive Metropolis.
Parameter densities are calculated using kernel density estimation (KDE) software (Botev, 2007). The densities are shown in Figure 8. One of the advantages of MCMC methods over other uncertainty quantification approaches such as the delta method is that non-Gaussian densities can be identified and estimated. For example, the densities on

Kernel density estimates of parameter posterior densities: (a)
In addition to providing a global optimum and parameter densities, the DRAM results can also be used to identify correlation in model parameters, as shown in Figure 9. The results indicate that the heat transfer parameters are highly correlated (Figure 9(f), (m) and (n)), and that

Correlation plots showing pairwise joint densities.
The DRAM chains are resampled to propagate the model uncertainty and calculate credible intervals on the model output for input data not used during model validation. The codes available in the study by Laine (2007) provide functions to resample the chains. The resampled chains produce prediction limits, and the measurement noise is added to predictions to produce observation limits. The 95% observation limits for the SMA actuator are shown in Figure 10. As shown in Figure 10, the majority of the experimental data lies within the bounds. Some data still lies outside of the bounds, especially at small bending angles. The results may be degraded by the fact that the residuals for the SMA bending actuator are not independent and identically distributed (i.i.d). Modeling measurement and model error with an autoregressive model may overcome this limitation and lead to better predictions; however, further investigation is necessary.

Comparison between experimental data and forward propagation of parameter uncertainty showing 95% observation intervals for (a) sinusoidal input and (b) step input.
The forward propagation of model uncertainty reveals that output uncertainty is largest at steady-state values. For example, the step inputs after 120 s have large uncertainty bounds, as large as 15% of the measured bending angle. Propagation of model uncertainty allows one to determine whether the model accurately quantifies the experimental observations. Additionally, the parameter chains can be sampled to make predictions with quantified uncertainty.
Conclusion
In this article, we employed a model of SMA bending actuators that utilize the homogenized energy framework. We then demonstrated the suitability of the DRAM algorithm for estimating parameter uncertainty. The adaptation in the DRAM algorithm efficiently identifies the ideal proposal for sampling the parameter space. We found the method to be better (converge faster) than the standard Metropolis algorithm. The methods presented here provide parameter densities, instead of single optimal values. Furthermore, the homogenized energy framework has been applied to numerous smart materials, and the Bayesian techniques can easily be adapted to those models and materials.
The MCMC methods provide a number of advantages to traditional OLS estimation of model parameters. The main purpose is to identify model and parameter uncertainties. However, the MCMC algorithms can serve as a global optimizer, whereas OLS approaches are sensitive to local minima. The estimation techniques presented here and in the study by Crews et al. (2012b) also aid in fitting model parameters, as initial points may greatly affect the results. MCMC algorithms can also be used to identify correlation between model parameters, which may be important for model reduction techniques.
As smart materials gain increased utilization in robotic applications, we believe the methods presented here will be instrumental for robust control frameworks. The advantages of robust control are well known; however, often robust control research is presented without any indication of how model and parameter uncertainty are quantified. Often, controller gains are simply chosen and tuned. The Bayesian approach to parameter uncertainty would greatly aid in the development of robust controllers. Future study will focus on the feasibility of the approach in the development of robust controllers, and the parameter densities will be used to derive bounds on model uncertainty.
Footnotes
Acknowledgements
The authors would like to thank Dr Greg Buckner and Jennifer Hannen for providing the experimental data used in this article.
Funding
This research was supported in part by the Air Force Office of Scientific Research through the grant AFOSR FA9550-11-10152.
