Professional Documents
Culture Documents
Quach Cuong Chi1 , Brian Bole2 , Edward Hogge3 , Sixto Vazquez1 , Matthew Daigle4 , José Celaya5 , Adam Weber1 , Kai
Goebel4
1
NASA Langley Research Center, Hampton, VA 23681
cquach@nasa.gov, sixto.l.vazquez@nasa.gov, adam.k.weber@nasa.gov
2
Department of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, 30332
bbole3@gatech.edu
3
Northrop Grumman Technical Services , Hampton, VA 23681
edward.f.hogge@nasa.gov
4
NASA Ames Research Center, Moffett Field, CA 94035
matthew.j.daigle@nasa.gov, kai.goebel@nasa.gov
5
SGT, Inc., NASA Ames Research Center, Moffett Field, CA 94035
jose.r.celaya@nasa.gov
1
Annual Conference of the Prognostics and Health Management Society 2013
2. BACKGROUND
Electric propulsion has long been used in cars and small
UAVs. Recently, improvements in battery storage capacity
have made it possible for general aviation vehicle manufac-
turers to consider battery-powered solutions as well. With
recent urgency to address environmental concerns, vehicle
manufacturers are increasingly investing in electric alterna-
tives (Harrup & Davis, 2010). Further, electric propulsion
provides a number of operational and control advantages: re-
duced noise, no emissions, more responsive thrust, and re-
duced part count, to name a few. Use of battery-powered
propulsion systems in manned and unmanned aircraft alike
will require more sophisticated means of estimating available
battery charge during operation. The estimation of remaining
charge is not easily determined during usage and, in addition, Figure 1. Useful charge available from new vs. old battery
each battery’s charge storage capacity degrades over its life
span.
known to degrade over the battery’s life, the underlying bat-
As a result, operators of electrically-propelled aircraft are left tery model must be tuned such that EOD predictions account
making conservative estimates of mission time. And, if a sig- for the life cycle degradation of the batteries.
nificant change to the mission is required during flight, no
simple method exists to determine actual versus required bat- 2.2. Challenges in Online Computation of Battery SOC
tery charge. In other words, an operator currently must have
a reliable way to answer the following questions: 1) What In conventional liquid fuel systems, the remaining fuel level
is the required charge to complete the new mission?, and 2) can be reliably measured and thus the remaining operating
What is the actual charge left in the batteries? time can be obtained using vehicle and motor performance
characteristics. This is because the volume of the tank is con-
2.1. Battery Health Management Approaches stant over the vehicle’s lifespan. To the contrary, charge ca-
pacity in batteries can diminish over recharge cycles, and, de-
The main objective of BHM research is to create prognos- pending on the chemistry used, over time as well. Part of the
tic algorithms that provide accurate estimates of battery stor- challenge of predicting the current battery SOC is determin-
age capacity during flight planning and accurate indication ing the maximum capacity of constituent cells, which repre-
of remaining charge during flight. Battery system models sents the initial condition of the discharge curve. As batteries
for electric aircraft have been developed based on previous age and experience an increasing number of recharge cycles,
laboratory and field experiments by (Saha, Goebel, Poll, & their maximum capacities diminish. Figure 1 illustrates this
Christophersen, 2009; Saha et al., 2011) and by (Daigle, Sax- typical life cycle degradation for three batteries used in sev-
ena, & Goebel, 2012). The work reported here covers testing eral flight experiments.
and adapting the battery prognostic model to the flight envi-
ronment of a real electric vehicle. For this research, the charge capacity for a battery is the
charge it can supply between its maximum rated voltage and
The applied approach is to develop and implement onboard the point when voltage drops precipitously under load. The
BHM which monitors usage of the motor batteries and which precipitous drop is figuratively called the ”knee point”.
runs estimation and prediction algorithms to: 1) determine
the SOC, which expresses the remaining battery charge in a 3. P ROTOTYPE E LECTRIC V EHICLE D ESCRIPTION
relative percentage; 2) predict the EOD, which is the total fly-
ing time; and 3) estimate the Remaining Useful Life (RUL), A 33% scaled Edge-540T, with electric propulsion, is used for
which is the remaining flying time from the present instant. this BHM research and development, as shown in Figure 2.
The SOC is intended to be much like the fuel gauge in a con- It is 98 inches long with a 100 inch wing span and weighs
ventional liquid fueled system. The RUL and EOD both de- 47.4 lbs., has 1881 in2 of wing area with an average wing
scribe similar information, which is to provide the operator load of 0.025 psi.
some notion of how much operating time is remaining. The The power system consists of two outrunner brushless DC
difference is that the EOD predicts the total flying time rel- electric motors mounted in tandem to drive a 26-inch pro-
ative to the start of the flight, whereas the RUL predicts the peller. The motor assembly turns the propeller up to
remaining flying time relative to the current time. Because 6000 RPM to develop about 37 pounds of thrust. Its airspeed
the charge storage capacity and other battery parameters are ranges from a stall of 12 m/s to a dash of about 40 m/s (23-77
2
Annual Conference of the Prognostics and Health Management Society 2013
76.594
M1 M2 Propeller
+ 5S2P + 76.593
Longitude (deg)
VB1 LiPo -
- 76.592
+ 5S2P + ESC ESC
VB2 1 2 76.591
LiPo -
- 76.59
i1,2
+ 5S2P + 76.589
VB3 LiPo -
- Throttle 76.588
+ 37.016 37.018 37.02 37.022 37.024 37.026
5S2P + Latitude (deg)
VB4 LiPo - i3,4
- Figure 5. Ground track of flight
3
Annual Conference of the Prognostics and Health Management Society 2013
a. RPM' 100
b. Servo'Pos'(7)'
Throttle (%)
c. StaNc/Diff.'Pressure'
d. Alpha/Beta'
AirData/ServoPos' a. CG'Accelerometers' 50
Signal'CondiNoning' b. Motor'Current'
c. Event'Marker'
0
a. Motor'BaQ.'Volts'(4)'
b. Motor'BaQ.'Current'(4)' Analog'I/O'(2)' 6000
c. Motor'BaQ.'Temp.'(4)' (Motor'current,'Air'data,…)'
Propeller RPM
BaQery'Signals'Card' Analog'I/O'(1)' 4000
(BHM,Accel,…)'
PC/104'ISA'Bus'
2000
DC/DC'converter'
AHRS'–'VN100'
AHRS' 0
Gyro,'Mag.,'Accels'
Processor'
Storage' 4000 M1 Batt Pwr
4
Annual Conference of the Prognostics and Health Management Society 2013
80 Rs Rcp
I B1,B2 i
60 I B3,B4
Current (A)
40
Cb Cs Ccp
20 Rp V
21 B1 V Measured
B2 V Measured
Battery Pwr (W)
19
5
Annual Conference of the Prognostics and Health Management Society 2013
Voltage (V)
Cmax 2.85 × 104 C Rcp0
CCb0 19.4 F Rcp1 8.45
CCb1 1576 F Rcp2 −61.9 19
CCb2 41.7 F Ccp0 2689 F
CCb3 −203 F Ccp1 −2285 F 18
Rs 2.77 × 10−2 Ccp2 −0.73 F
17
057 322 550 692 885 1045 1232 1435
Battery SOC is defined as: Time (s)
qmax − qb Figure 10. Modeled and measured voltages of batteries B1
SOC = 1 − (1)
Cmax and B3 for a sample flight loading profile
where qb is the charge stored in the battery, qmax is the max-
imum charge that the battery can hold, and Cmax is the max-
Figure 10 shows the predicted and measured voltage profiles
imum charge that can be drawn from the battery. The term
for batteries B1 and B3 using the recorded battery current
coulombic efficiency is used to refer to the portion of stored
profiles shown in Figure 8. The close match between ob-
charge that is recoverable during the discharge of the battery.
served battery voltages and open-loop predictions made using
There are some mechanisms including resting the battery that
the given loading profile provides a measure of validation for
can unlock some of its lost capacity, however, the overall
the fitted battery models.
trend is inevitably downward.
Cb , Ccp and Rcp are parameterized as: 4.2. Estimation
Cb = CCb0 + CCb1 · SOC + CCb2 · SOC2 + CCb3 · SOC3 (2) The identified battery model may be used to implement an ob-
server for the internal battery states based on sampled voltage
Ccp = Ccp0 + Ccp1 · exp (Ccp2 (SOC)) (3) and current data. The unscented Kalman filter (UKF) (Julier
Rcp = Rcp0 + Rcp1 · exp (Rcp2 (SOC)) (4) & Uhlmann, 1997, 2004) and the particle filter (Arulampalam
et al., 2002), are two flexible tools for preforming closed-loop
where CCb0 , CCb1 , CCb2 , CCb3 , Rcp0 , Rcp1 , and Rcp2 updates of the probabilistic belief in system state estimates
are empirical coefficients that are tuned based on observed based on stochastic (and possibly nonlinear) models of sys-
current-voltage battery data over a range of SOC. tem dynamics. Both approaches operate by drawing samples
The current and voltage dynamics of the equivalent circuit from probability distributions that are estimated for all of the
model are defined as: uncertain parameters in the system state estimate and system
T dynamics model.
xB = qb qcp qCs
(5)
Particle filters use a discrete set of weighted samples, called
− Cb1Rp 1 1 particles to represent the belief in current system state esti-
Ccp Rp Cs Rp i
mates. Particles are sampled stochastically. The number of
ẋB = Cb1Rp − Ccp R1p Rcp Cs1Rp x B
+ i +ξ (6)
particles used and the methods used to assign weights and
1 1 1 i
Cb Rp Ccp Rp Cs Rp resample particles are design choices that will determine the
computational overhead of this approach.
h i
yB = Vp = C1b C1cp C1s · xB (7)
The UKF assumes a general nonlinear form of the state and
where qb , qcp , and qcs represent the charge stored in Cb , Ccp ,
output equations, and efficiently propagates model and state
and Ccs respectively, and the voltage drop across the battery
uncertainties without the need to calculate Jacobians (unlike
terminals is equal to the sum of the voltage drops across each
the extended Kalman filter). The UKF is restricted to additive
of the three capacitors.
Gaussian noise random processes; however use of the un-
The fitting of equivalent circuit RC parameters to the ob- scented transform, a deterministic sampling method, allows
served current-voltage response of the Edge-540T powertrain random variables with non-Gaussian distributions to be in-
batteries is described in (Bole et al., 2013). The identified corporated using a minimal set of weighted samples, called
parameter values for the batteries used in the sample flight sigma points (Julier & Uhlmann, 1997). The number of sigma
described in Section 3.3 are given in Table 1. points is only linear in the dimension of the random variable,
6
Annual Conference of the Prognostics and Health Management Society 2013
100
B1 SOC 5000 Net Bat PWR Measured
Net Bat PWR Predicted
P1!
60 3000 P3!
1000
20
0
0 57 322 550 692 885 1232 1435
057 322 550 692 885 1045 1232 1435 Time (s)
Time (s)
Figure 12. Measured and predicted net battery power con-
Figure 11. Estimated SOC for batteries B1 and B3 over flight sumption over sample flight. The six phases of the sample
flight are annotated P1-P6
7
Annual Conference of the Prognostics and Health Management Society 2013
is added to future load estimates, denoted by the green band GT (1±α)GT Median B1 Median B3
in Figure 12, to account for unmodeled system dynamics.
2000
Given a state estimate, the prediction step proceeds by simu-
lating that state estimate through time up until the EOD point,
incorporating assumed future loading. For both the particle 1500
RUL (s)
filter and UKF, the state estimate is represented by a set of
weighted samples. The distribution of future loading, i.e., 1000
the battery power demand, is assumed to be constant over
each leg of the flight. The constant demand over each leg
500
of the flight is assumed to be drawn from a uniform distri-
bution ranging ±30% from the mean battery load estimate.
Here, we use the unscented transform to sample from the fu- 2000
ture loading distribution and obtain sigma points that cover
the distribution, as described in (Daigle et al., 2012).
1500
EOD (s)
The equivalent circuit battery model is initialized for EOD
prediction by taking a sample from the battery state estimate.
The battery model is then simulated until EOD, using a bat- 1000
tery load input that is drawn from the estimated distribution
of possible future battery power demands. Just three sigma
points are required to represent the uniformly distributed fu- 500
57 322 550 692
ture battery loading demands. For a uniform distribution Time (s)
with the value used for the free parameter in the unscented
transform yields the three points as the mean of the distribu- Figure 13. RUL and EOD predictions with future input trajec-
tion and its two endpoints, thus naturally capturing the input tories drawn from a uniform distribution using the unscented
transform.
bounds. The belief distribution for current system states is
represented using nine samples from the UKF. The EOD be-
lief estimate is then constructed by generating EOD estimates
for all combinations of the nine samples representing battery tions are shown at 60 s intervals. Here, we see that while the
state estimates, and the three samples of future battery load estimated RUL and EOD distributions seem to be converg-
(9 · 3 = 27 samples). This is much more efficient than when ing to the true RUL and EOD as the flight progresses, there
using the much greater number of samples from the particle is a consistent over-estimation of EOD for battery B1 and a
filter. consistent under-estimation of EOD for battery B3 over the
sample flight.
5. A SSESSMENT The EOD estimation bias apparent in Figure 13 is explained
Figure 13 shows upper and lower bounds of RUL and EOD by the fact that the battery demand modeling used assumes a
predictions for batteries B1 and B3, obtained using UKF for constant split of power between the two tandem mounted pro-
state estimation and the unscented transform for sample point peller motors. However, as was shown in Figures 7 and 10,
identification. Although these projections are computed for the power split between motors M1 and M2 is seen to change
all four batteries during the flight, only batteries B1 and B3 abruptly near the end of discharge.
are shown in these graphs to avoid clutter. The figure shows Although the RUL estimates for B3 are seen to be slightly
the median, and range of the probability distribution calcu- conservative, the estimates are fairly stable over the flight,
lated from the three simulated sigma points. RUL and EOD and the estimated RUL probability density functions are seen
predictions are shown against the ground truth measurement to mostly fall within the 30% relative accuracy cone shown
of RUL and EOD obtained by fully discharging the batter- for the sample flight. This result is a considerable improve-
ies at flight loads on the ground. The ground truth measure- ment on previous particle filter based implementations of bat-
ments for EOD and RUL are shown as dashed lines in the tery EOD prognostics, that used the average of battery current
figure. The ground truth RUL measurement is calculated by over a finite window to estimate the future battery loading
subtracting the current time from the EOD time, which was over a flight (Saha et al., 2011, 2009; Saha & Goebel, 2008;
estimated to occur at 1217 seconds in Section 4.3 if the UAV M. E. Orchard et al., 2012). Not only are the predictions more
had continued to fly at approximately the same speed as it was accurate, but they are more stable as well.
going in step 4 of the flight plan. An accuracy cone defined
by α = 0.3 is also shown for reference purposes. Predic- Figure 14 shows the mean RUL and EOD predictions ob-
tained using a particle filter algorithm described in (Saha et
8
Annual Conference of the Prognostics and Health Management Society 2013
ACKNOWLEDGMENT
The project support by NASA’s AvSafe/SSAT and
OCT/ACLO are respectfully acknowledged.
EOD (s)
R EFERENCES
Arulampalam, M. S., Maskell, S., Gordon, N., & Clapp,
T. (2002). A tutorial on particle filters for on-
line nonlinear/non-Gaussian Bayesian tracking. IEEE
Transactions on Signal Processing, 50(2), 174–188.
Bole, B., Teubert, C., Chi, Q. C., Edward, H., Vazquez, S.,
Goebel, K., & Vachtsevanos, G. (2013). SIL/HIL
Time (s) replication of electric aircraft powertrain dynamics and
inner-loop control for V&V of system health manage-
Figure 14. RUL and EOD predictions using particle filtering
with future load estimated using a 100 second window of past ment routines. In Annual conference of the prognostics
current data and health management society.
Dai, H., Wei, X., & Sun, Z. (2006). Online soc estimation
of high-power Lithium-Ion batteries used on HEVs. In
al., 2009), with a 100 s moving average used to project future IEEE international conference on vehicular electronics
battery current draw. Observe that the high current draw dur- and safety.
ing takeoff does not reflect in reduced RUL until 57 s later; Daigle, M., & Goebel, K. (2013, May). Model-based prog-
likewise, when the 75% constant throttle segment is started nostics with concurrent damage progression processes.
at the 57 s mark, the RUL does not stabilize until about 50 s IEEE Transactions on Systems, Man, and Cybernetics:
later; and again at the 322 s throttle change. This effect is Systems, 43(4), 535-546.
most pronounced on the throttle transition from the ground Daigle, M., Saxena, A., & Goebel, K. (2012). An efficient
motor off to the ground discharge at 885 sec. This 50 s hys- deterministic approach to model-based prediction un-
teresis could be reduced by reducing the width of the 100 s certainty. In Annual conference of the prognostics and
sliding window but at the expense of getting more jittery RUL health management society.
projections which makes for a more unnerving operator ex- Harrup, P., & Davis, S. (2010). 21st century technology
perience. With a small window, the RUL predictions tend to propels electric aircraft into the “blue yonder”. Power
fluctuate because when the load over the window is higher Electronics Technology, 36, 16-21.
than what the load will be in the future, RUL is underpre- Hogge, E. F., Quach, C. C., & Hill, B. L. (2011). A data
dicted, and when the load over the window is lower than the system for a rapid evaluation class of subscale aerial
future load, RUL is overpredicted. vehicle. NASA/TM-2011-217145.
Julier, S. J., & Uhlmann, J. K. (1997). A new exten-
6. C ONCLUSIONS sion of the Kalman filter to nonlinear systems. In
This paper described the application and assessment of bat- Proceedings of the 11th international symposium on
tery charge depletion prognostics onboard an unmanned all- aerospace/defense sensing, simulation, and controls
electric subscale vehicle. The paper also described a sam- (pp. 182–193).
ple flight test during which a preplanned flight plan is au- Julier, S. J., & Uhlmann, J. K. (2004, March). Unscented
tonomously flown by the aircraft. Predictions of available filtering and nonlinear estimation. Proceedings of the
flight time remaining where generated based on measure- IEEE, 92(3), 401–422.
ments of the battery state of charge and knowledge of a flight Luo, J., Pattipati, K. R., Qiao, L., & Chigusa, S. (2008,
plan. After a predetermined time the aircraft was landed and September). Model-based prognostic techniques ap-
the propeller was spun at flight speeds to obtain a measure- plied to a suspension system. IEEE Transactions on
9
Annual Conference of the Prognostics and Health Management Society 2013
Systems, Man and Cybernetics, Part A: Systems and the use of risk management and stochastic optimization tech-
Humans, 38(5), 1156 -1168. niques for optimal adaptation of active component load al-
Orchard, M., Tobar, F., & Vachtsevanos, G. (2009, De- locations in robotic and aviation applications. In a previous
cember). Outer feedback correction loops in particle project, Brian worked with the Georgia Tech EcoCar team to
filtering-based prognostic algorithms: Statistical per- develop an energy management controller for optimizing the
formance comparison. Studies in Informatics and Con- fuel economy of a charge sustaining hybrid electric vehicle.
trol, 18(4), 295-304.
Edward Hogge received a B.S. in Physics from the College
Orchard, M. E., Cerda, M. A., Olivares, B. E., & Silva, J. F.
of William and Mary in 1977. He has provided engineer-
(2012). Sequential Monte Carlo methods for discharge
ing services to the government and currently is employed by
time prognosis in Lithium-Ion batteries. International
Northrop Grumman Technical Services. He has recently been
Journal of Prognostics and Health Management, 3, 1-
supporting aviation safety research through the implementa-
12.
tion of electronic systems for subscale remotely piloted air-
Pang, S., Farrell, J., Du, J., & Barth, M. (2001). Battery state- craft and through commercial aircraft simulation. He is a
of-charge estimation. In American control conference. member of the American Institute of Aeronautics and Astro-
Saha, B., & Goebel, K. (2008). Uncertainty management for nautics.
diagnostics and prognostics of batteries using Bayesian
techniques. In IEEE aerospace conference. Sixto Vazquez Mr. Vazquez obtained
Saha, B., & Goebel, K. (2009, September). Modeling Li-ion MSEE from Old Dominion University in
battery capacity depletion in a particle filtering frame- 1990 and BSEE from the University of
work. In Proceedings of the annual conference of the Puerto Rico in 1983. He has developed real-
prognostics and health management society 2009. time 3D graphical simulations to aid in the
Saha, B., Goebel, K., Poll, S., & Christophersen, J. (2009). visualization and analysis of complex sen-
Prognostics methods for battery health monitoring us- sory data. Has developed techniques to in-
ing a Bayesian framework. IEEE Transactions on In- teractively process, analyze, and integrate
strumentation and Measurement, 58(2), 291-296. sensory data from multiple complex, state-of-the-art sensing
Saha, B., Koshimoto, E., Quach, C. C., Hogge, E. F., Strom, technologies, i.e. FMCW Coherent Laser Radar range mea-
T. H., Hill, B. L., . . . Goebel, K. (2011). Battery suring system, Bragg grating Fiber Optic Strain Sensing sys-
health management system for electric UAVs. In IEEE tem, etc., into simulation. In recent years, Mr. Vazquez has
aerospace conference. developed software for the ardupilot and associated ground
Zhang, H., & Chow, M.-Y. (2010). Comprehensive dy- station.
namic battery modeling for PHEV applications. In Matthew Daigle received the B.S. degree in Computer Sci-
IEEE power and energy society general meeting. ence and Computer and Systems Engineering from Rensse-
laer Polytechnic Institute, Troy, NY, in 2004, and the M.S.
B IOGRAPHIES and Ph.D. degrees in Computer Science from Vanderbilt Uni-
Quach Cuong Chi got his M.S. from the versity, Nashville, TN, in 2006 and 2008, respectively. From
School of Physics and Computer Sciences September 2004 to May 2008, he was a Graduate Research
at Christopher Newport University in 1997. Assistant with the Institute for Software Integrated Systems
He is a staff researcher in the Safety Critical and Department of Electrical Engineering and Computer Sci-
Avionics Systems Branch at NASA Lang- ence, Vanderbilt University, Nashville, TN. From June 2008
ley Research Center. His research areas in- to December 2011, he was an Associate Scientist with the
clude development and testing of software University of California, Santa Cruz, at NASA Ames Re-
for airframe diagnosis and strategic flight search Center. Since January 2012, he has been with NASA
path conflict detection. Ames Research Center as a Research Computer Scientist.
His current research interests include physics-based model-
Brian M. Bole graduated from the FSU- ing, model-based diagnosis and prognosis, simulation, and
FAMU School of Engineering in 2008 with hybrid systems.
a B.S. in Electrical and Computer Engineer-
ing and a B.S. in Applied Math. Brian re- Dr. José R. Celaya is a research scientist
ceived a M.S. degree in Electrical Engineer- with SGT Inc. at the Prognostics Center of
ing from the Georgia Institute of Technol- Excellence, NASA Ames Research Center.
ogy in 2011, and he is currently pursuing He received a Ph.D. degree in Decision Sci-
a Ph.D. Brian’s research interests include: ences and Engineering Systems in 2008, a
analysis of stochastic processes, risk analysis, and optimiza- M. E. degree in Operations Research and
tion of stochastic systems. Brian is currently investigating Statistics in 2008, a M. S. degree in Elec-
10
Annual Conference of the Prognostics and Health Management Society 2013
trical Engineering in 2003, all from Rensselaer Polytechnic the M.S. and Ph.D. from the University of
Institute, Troy New York; and a B. S. in Cybernetics Engi- California at Berkeley in 1993 and 1996, re-
neering in 2001 from CETYS University, México. spectively. Dr. Goebel is a senior scientist
at NASA Ames Research Center where he
Adam K. Weber is presently pursuing his
leads the Diagnostics & Prognostics groups
B.S.E. in Aerospace Engineering at the Uni-
in the Intelligent Systems division. In addition, he directs
versity of Michigan, and is expected to grad-
the Prognostics Center of Excellence and he is the Associate
uate in December 2014. He is an intern in
Principal Investigator for Prognostics of NASAs Integrated
the Safety Critical Avionics Systems Branch
Vehicle Health Management Program. He worked at General
at NASA Langley Research Center under
Electrics Corporate Research Center in Niskayuna, NY from
the mentorship of Cuong Quach and Sixto
1997 to 2006 as a senior research scientist. He has carried
Vazquez for a second year in a row. His re-
out applied research in the areas of artificial intelligence, soft
search has included aiding in performance analysis and vali-
computing, and information fusion. His research interest lies
dation of a battery health management system and character-
in advancing these techniques for real time monitoring, di-
izing lithium polymer batteries.
agnostics, and prognostics. He holds eleven patents and has
Kai Goebel received the degree of Diplom- published more than 100 papers in the area of systems health
Ingenieur from the Technische Universitt management.
Mnchen, Germany in 1990. He received
11