Skip to main content
SpringerLink
Log in

The early design reliability prediction method

  • Original Paper
  • Published:
Research in Engineering Design Aims and scope Submit manuscript

Abstract

This research contributes to the ongoing effort toward predicting and improving reliability in early engineering design, specifically during conceptual design. Increasing the rigor of predicting reliability during early design allows the designer to improve the decision-making process. Current reliability prediction methods cannot accurately capture uncertainty during conceptual design. The uncertainty of reliability predictions in early design can be significant, and, as a result, must be utilized in decision-making. To address these limitations, this paper presents the early design reliability prediction method (EDRPM) to calculate function and component failure rate distributions, which capture the parameter uncertainty. If required, these distributions can be converted into reliability values. A new technique, Frequency Weighting, is developed and applied to a Hierarchical Bayesian model to account for the number of times that a component has historically solved a function. This addition is necessary to accurately model the structure of the function-to-component relationship for capturing uncertainty. A case study using the advanced diagnostics and prognostic testbed electrical power system is presented to show the usefulness of EDRPM in facilitating decision-making during conceptual design.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  • Alvarado C, Davis R (2007) Dynamically constructed Bayes nets for multi-domain sketch understanding. In: ACM SIGGRAPH 2007—international conference on computer graphics and interactive techniques, San Diego, CA, USA, August 5, 2007–August 9, 2007

  • Arora J (2004) Introduction to optimum design, 2nd edn. Academic Press, Waltham

    Google Scholar 

  • Baun WO (2007) Method for the early development of a bayesian prior time-to-failure distribution for an evolutionary product design. In: ASME international mechanical engineering congress and exposition, vol 14, Seattle, WA, United states, November 11, 2007–November 15, 2007, pp 23–31

  • Benayoun R, Roy B, Sussman N (1966) Manual de reference du programme electre, note de synthese et formation. In: Direction Scientifique SEMA, vol 25. France, Paris

  • Besharati B, Azarm S, Farhang-Mehr A (2002) A customer-based expected utility metric for product design selection. In: ASME 2002 international design engineering technical conferences and computers and information in engineering conference, vol 2, Montreal, QC, Canada, September 29, 2002–October 2, 2002, pp 421–428

  • Blanchard BS, Fabrycky WJ, Fabrycky WJ (1990) Systems engineering and analysis, vol 4. Prentice Hall, Englewood Cliffs

    Google Scholar 

  • Byrne DM, Taguchi S (1986) The taguchi approach to parameter design. ASQC 40:168–177

    Google Scholar 

  • Carriaga CC, Schlund SS (2000) Selection of best channel design alternative for watercourse master plan. In: Joint conference on water resource engineering and water resources planning and management, vol 104, Minneapolis, MN, USA, July 30, 2000 –August 2, 2000, pp 1–10

  • Chen J, Hubbard SS, Williams KH, Orozco AF, Kemna A (2012) Estimating the spatiotemporal distribution of geochemical parameters associated with biostimulation using spectral induced polarization data and hierarchical bayesian models. Water Resour Res 48:5

    Google Scholar 

  • Chen J, DeWitt DJ, Naughton JF (2002) Design and evaluation of alternative selection placement strategies in optimizing continuous queries. In: 18th international conference on data engineering, San Jose, CA, USA, February 26, 2002–March 1, 2002, pp 345–356

  • Cook H, Wu A (2001) On the valuation of goods and selection of the best design alternative. Res Eng Des Theory Appl Concurr Eng 13(1):42–54

    Google Scholar 

  • De Alba E, Mendoza M et al (2007) Bayesian forecasting methods for short time series. Int J Appl Forecast 8:41–44

    Google Scholar 

  • Denson W, Crowell W, Clark A, Jaworski P (1994) Nonelectric parts reliability data 1995

  • Gelman A, Carlin JB, Stern HS, Dunson DB, Vehtari A, Rubin DB (2014) Bayesian data analysis, vol 2. CRC Press, Boca Raton

    MATH  Google Scholar 

  • Haimes YY (2012) Modeling complex systems of systems with phantom system models. Syst Eng 15(3):333–346 (Autumn 2012)

    Article  MathSciNet  Google Scholar 

  • Hazelrigg GA (2003) Validation of engineering design alternative selection methods. Eng Optim 32(2):103–120

    Article  Google Scholar 

  • Holt CC (2004) Forecasting trends and seasonal by exponentially weighted averages. Int J Forecast 20(1):5–10

    Article  Google Scholar 

  • Hoyle C, Tumer IY, Kurtoglu T, Chen W (2011) Multi-stage uncertainty quantification for verifying the correctness of complex system designs. In: International design engineering technical conferences

  • Huang S, Renals S (2010) Hierarchical bayesian language models for conversational speech recognition. IEEE Trans Audio Speech Lang Process 18(8):1941–1954

    Article  Google Scholar 

  • Johnson VE, Moosman A, Cotter P (2005) A hierarchical model for estimating the early reliability of complex systems. IEEE Trans Reliabil 54(2):224–231

    Article  Google Scholar 

  • Kallache M, Maksimovich E, Michelangeli P-A, Naveau P (2010) Multimodel combination by a Bayesian hierarchical model: assessment of ice accumulation over the oceanic arctic region. J Clim 23(20):5421–5436

    Article  Google Scholar 

  • Kuball S, May J, Hughes G (1999) Building a system failure rate estimator by identifying component failure rates. In: 1999 10th international symposium on software reliability engineering. Boca Raton, FL, USA, pp 32–41

  • Kurtoglu T, Campbell MI, Arnold CB, Stone RB, Mcadams DA (2009) A component taxonomy as a framework for computational design synthesis. J Comput Inf Sci Eng 9(1):011007

    Article  Google Scholar 

  • Kurtoglu T, Tumer IY, Jensen DC (2010) A functional failure reasoning methodology for evaluation of conceptual system architectures. Res Eng Des 21(4):209–234

    Article  Google Scholar 

  • Kurtoglu T, Narasimhan S, Poll S, Garcia D, Wright S (2009) Benchmarking diagnostic algorithms on an electrical power system testbed. In: International conference on prognostics and health management, September 17, 2009

  • Maes MA, Dann M, Faber MH (2008) Hierarchical Bayes analysis of rare events using high-dispersion Poisson mixtures. In: 27th international conference on offshore mechanics and arctic engineering, vol 2, Berlin, Germany, June 9, 2008–June 13, 2008, pp 233–240

  • Maniya KD, Bhatt MG (2011) An alternative multiple attribute decision making methodology for solving optimal facility layout design selection problems. Comput Ind Eng 61(3):542–549

    Article  Google Scholar 

  • Matsumoto T, Saito M, Nakajima Y, Sugi J, Hamagishi H (1999) Reconstruction and prediction of nonlinear dynamical systems: a hierarchical Bayes approach with neural nets. IEEE Int Conf Acoust Speech Signal Process 2(1):1061–1064

    MATH  Google Scholar 

  • Matsumoto T, Nakajima Y, Hamagishi H, Sugi J, Saito M (1998) From data to nonlinear dynamics: a hierarchical Bayes approach with neural nets. In: 8th IEEE workshop on neural networks for signal processing VIII, Cambridge, England, August 31, 1998–September 2, 1998, pp 333–342

  • Messac A (1996) Physical programming: effective optimization for computational design. AIAA J 34(1):149–158

    Article  MATH  Google Scholar 

  • Miller DW, Starr MK (1969) Executive decisions and operations research. Prentice-Hall, Madison

    Google Scholar 

  • Natrella M (2010) Nist/sematech e-handbook of statistical methods

  • O’Halloran BM, Stone RB, Tumer IY (2011) Early design stage reliability analysis using function-flow failure rates. In: ASME 2011 international design engineering technical conferences and computers and information in engineering conference, American Society of Mechanical Engineers, pp 455–464

  • Peng W, Xiao Z, Wang Y, Huang H-Z, Liu Y (2011) A combined bayesian framework for satellite reliability estimation. In: 2011 international conference on quality, reliability, risk, maintenance, and safety engineering, Xi’an, China, June 17, 2011–June 19, 2011, pp 13–21

  • Saaty TL (1990) An exposition of the ahp in reply to the paper ’remarks on the analytic hierarchy process. Manag Sci 36(3):259–268

    Article  Google Scholar 

  • Sato C, Yoneyama M (2008) Hierarchical bayesian model concerned uncertainty in number of failure events for component failure rates. In: 16th international conference on nuclear engineering, vol 4, Orlando, FL, United states, May 11, 2008–May 15, 2008, pp 627–632

  • Schenkelberg F (2012) Effective reliability program traits and management. In: Reliability and maintainability symposium

  • Schulz I, Bot-SchuLz R (2010) Bayes’ theorem as basis for alternative selection in product design. Konstruktion 1(11–12):63–66

    Google Scholar 

  • Stone RB, Wood KL (2000) Development of a functional basis for design. J Mech Des 122(4):359–370

    Article  Google Scholar 

  • Taguchi G (1986) Introduction to quality engineering: designing quality into products and processes. The Organization, Michigan

    Google Scholar 

  • Taranto C, Mauro ND, Esposito F (2011) rslda: a Bayesian hierarchical model for relational learning. In: 2nd international conference on data and knowledge engineering, Milan, Italy, September 6, 2011–September 6, 2011, pp 68–74

  • Tobias JL (2001) Forecasting output growth rates and median output growth rates: a hierarchical bayesian approach. J Forecast 20(5):297–314

    Article  Google Scholar 

  • Tont G, Vladareanu L, Munteanu MS, Tont DG (2010) Hierarchical Bayesian reliability analysis of complex dynamical systems. In: 9th WSEAS international conference on applications of electrical engineering, Penang, Malaysia, March 23, 2010–March 25, 2010, pp 181–186

  • Tzeng G-H, Huang J-J (2011) Multiple attribute decision making: methods and applications. CRC Press, Boca Raton

    Book  MATH  Google Scholar 

  • Walters A, Cai Q (2008) Investigating the use of holt-winters time series model for forecasting population at the state and sub-state levels

  • Weber RG, Condoor SS (1998) Conceptual design using a synergistically compatible morphological matrix. In: Frontiers in education conference, 1998. FIE’98. 28th Annual, vol. 1. IEEE, pp 171–176

  • Xu H, Xing L, Robidoux R (2009) Drbd: dynamic reliability block diagrams for system reliability modelling. Int J Comput Appl 31(2):132–141

    Google Scholar 

  • Yadava OP, Singha N, Goelb PS, Itabashi-Campbell R (2003) A framework for reliability prediction during product development process incorporating engineering judgments. Qual Eng 15(4):649–662

    Article  Google Scholar 

  • Yan Z, Haimes YY (2012) Cross-classified hierarchical bayesian models for risk-based analysis of complex systems under sparse data. Reliabil Eng Syst Saf 95(7):764–776 July 2010

    Article  Google Scholar 

  • Yuan T, Ramadan S, Bae SJ (2011) Yield prediction for integrated circuits manufacturing through hierarchical bayesian modeling of spatial defects. IEEE Trans Reliabil 60(4):729–741

    Article  Google Scholar 

  • Zavadskas EK, Vaidogas ER (2009) Multiattribute selection from alternative designs of infrastructure components for accidental situations. Comput Aided Civ Infrastruct Eng 24(5):346–358

    Article  Google Scholar 

  • Zhang Z, Chu X (2009) A new integrated decision-making approach for design alternative selection for supporting complex product development. Int J Comput Integrat Manuf 22(3):179–198

    Article  Google Scholar 

  • Zhang Y, Koren J (2007) Efficient Bayesian hierarchical user modeling for recommendation system. In: 30th annual international ACM SIGIR conference on research and development in information retrieval, Amsterdam, The Netherlands, July 23, 2007–July 27, 2007, pp 47–54

Download references

Acknowledgements

This research was funded in part by NSF Grant CMMI-0927745, DARPA (Subaward to FA8650-10-C-7079 with Palo Alto Research Center), and the Naval Postgraduate School (NPS) (Grant no. B77D4 / 4477452). The opinions, findings, conclusions, and recommendations expressed are those of the authors and do not necessarily reflect the views of the sponsors.

Author information

Authors and Affiliations

  1. Naval Postgraduate School, Monterey, CA, USA

    Bryan M. O’Halloran

  2. Oregon State University, Corvallis, OR, USA

    Christopher Hoyle, Irem Y. Tumer & Robert B. Stone

Authors
  1. Bryan M. O’Halloran
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christopher Hoyle
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Irem Y. Tumer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Robert B. Stone
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bryan M. O’Halloran.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

O’Halloran, B.M., Hoyle, C., Tumer, I.Y. et al. The early design reliability prediction method. Res Eng Design 30, 489–508 (2019). https://doi.org/10.1007/s00163-019-00314-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00163-019-00314-8

Keywords

Search

Navigation