Skip to main content
SpringerLink
Log in

Metabolic rate estimation method using image deep learning

  • Research Article
  • Building Thermal, Lighting, and Acoustics Modeling
  • Published:
Building Simulation Aims and scope Submit manuscript

Abstract

Thermal comfort is an important factor in evaluating indoor environmental quality. However, accurately evaluating thermal comfort conditions is challenging owing to the lack of suitable methods for measuring individual factors such as the metabolic rate (M value). In this study, a M value evaluation method was developed using deep learning. The metabolic equivalent of task was measured for eight typical indoor tasks based on the ASHRAE Standard 55 (lying down, sitting, cooking, walking, eating, house cleaning, folding clothes, and handling 50 kg books) in 31 subjects (males: 16; and females: 15); the measurements were analyzed in terms of gender and body mass index (BMI). The experimental results were assessed using the reliability of the measured data, the M value difference in terms of gender and BMI, and the measurement accuracy. We developed a M value self-evaluation model using artificial intelligence, which achieved an average coefficient of variation (CV) of 12%. A third-party evaluation model was used to evaluate the M value of one subject based on the learning data acquired from the other 30 subjects; this model yielded a low CV of 54%. For high-activity tasks, males generally had higher M values than females, and the higher the BMI was, the higher was the M value. Contrarily, for low-activity tasks, the lower the BMI was, the higher was the M value. The breakthrough M value evaluation method presented herein is expected to improve thermal comfort control.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abobakr A, Hossny M, Nahavandi S (2016). Body joints regression using deep convolutional neural networks. In: Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary.

  • Ainsworth BE, Haskell WL, Leon AS, Jacobs JD Jr, Montoye HJ, et al. (1993). Compendium of physical activities: Classification of energy costs of human physical activities. Medicine and Science in Sports and Exercise, 25(1): 71–80.

    Google Scholar 

  • ASHRAE (2002). ASHRAE Guideline 14-2002: Measurement of Energy and Demand Savings. Atlanta: American Society of Heating, Refrigerating, and Air-Conditioning Engineers.

    Google Scholar 

  • ASHRAE (2010). ASHRAE Standard 62.1-2010: Ventilation for Acceptable Indoor Air Quality. Atlanta: American Society of Heating, Refrigerating and Air-Conditioning Engineers.

    Google Scholar 

  • ASHRAE (2017). ASHRAE Standard 55: Thermal Environmental Conditions for Human Occupancy. Atlanta: American Society of Heating, Refrigerating, and Air Conditioning Engineers.

    Google Scholar 

  • Bae C, Chun C (2009). Research on seasonal indoor thermal environment and residents’ control behavior of cooling and heating systems in Korea. Building and Environment, 44: 2300–2307.

    Google Scholar 

  • Bottou L (2010). Large-scale machine learning with stochastic gradient descent. In: Proceedings of COMPSTAT’2010, Paris, France.

  • Calvaresi A, Arnesano M, Pietroni F, Revel GM (2018). Measuring metabolic rate to improve comfort management in buildings. Environmental Engineering and Management Journal, 17: 2287–2296.

    Google Scholar 

  • Calvino F, La Gennusa M, Rizzo G, Scaccianoce GJE (2004). The control of indoor thermal comfort conditions: Introducing a fuzzy adaptive controller. Energy and Buildings, 36(2): 97–102.

    Google Scholar 

  • Chaudhuri T, Soh YC, Li H, Xie L (2019). A feedforward neural network based indoor-climate control framework for thermal comfort and energy saving in buildings. Applied Energy, 248: 44–53.

    Google Scholar 

  • Chen X, Wang Q, Srebric J (2015). Model predictive control for indoor thermal comfort and energy optimization using occupant feedback. Energy and Buildings, 102: 357–369.

    Google Scholar 

  • Choi J, Aziz A, Loftness V (2010). Investigation on the impacts of different genders and ages on satisfaction with thermal environments in office buildings. Building and Environment, 45: 1529–1535.

    Google Scholar 

  • Choi JH, Loftness V, Aziz A (2012). Post-occupancy evaluation of 20 office buildings as basis for future IEQ standards and guidelines. Energy and Buildings, 46: 167–175.

    Google Scholar 

  • Clarke R, Coladarci T, Minium E (1999). Elements of Statistical Reasoning. Hoboken, NJ, USA: John Wiley & Sons.

    Google Scholar 

  • Cosma AC, Simha R (2019). Machine learning method for real-time non-invasive prediction of individual thermal preference in transient conditions. Building and Environment, 148: 372–383.

    Google Scholar 

  • d’Ambrosio Alfano FR, Palella BI, Riccio G (2011). The role of measurement accuracy on the thermal environment assessment by means of PMV index. Building and Environment, 46: 1361–1369.

    Google Scholar 

  • Dai C, Zhang H, Arens E, Lian Z (2017). Machine learning approaches to predict thermal demands using skin temperatures: Steady-state conditions. Building and Environment, 114: 1–10.

    Google Scholar 

  • Dalal N, Triggs B (2005). Histograms of oriented gradients for human detection. In: Proceedings of the International Conference on Computer Vision & Pattern Recognition (CVPR’05), San Diego, CA, USA.

  • Deng J, Dong W, Socher R, Li L, Li K, et al. (2009). ImageNet: A large-scale hierarchical image database. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.

  • Deurenberg P, Weststrate JA, Seidell JC (1991). Body mass index as a measure of body fatness: Age- and sex-specific prediction formulas. British Journal of Nutrition, 65: 105–114.

    Google Scholar 

  • Diaz KM, Krupka DJ, Chang MJ, Peacock J, Ma Y, et al. (2015). Fitbif: An accurate and reliable device for wireless physical activity tracking. International Journal of Cardiology, 185: 138–140.

    Google Scholar 

  • El-Amrawy F, Nounou MI (2015). Are currently available wearable devices for activity tracking and heart rate monitoring accurate, precise, and medically beneficial? Healthcare Informatics Research, 21: 315.

    Google Scholar 

  • Fan C, Xiao F, Zhao Y (2017). A short-term building cooling load prediction method using deep learning algorithms. Applied Energy, 195: 222–233.

    Google Scholar 

  • Fanger PO (1970). Thermal Comfort: Analysis and Applications in Environmental Engineering. Copenhagen, Denmark: Danish Technical Press.

    Google Scholar 

  • Ferguson T, Rowlands AV, Olds T, Maher C (2015). The validity of consumer-level, activity monitors in healthy adults worn in free-living conditions: A cross-sectional study. International Journal of Behavioral Nutrition and Physical Activity, 12: 42.

    Google Scholar 

  • Fitabase (2017). 500 Fitbit Studies, Activity Logs, New Projects & More! Available at https://www.fitabase.com/research-library.

  • Gan M, Wang C, Zhu C (2016). Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings. Mechanical Systems and Signal Processing, 72–73: 92–104.

    Google Scholar 

  • Giedraityte L, Holmér I, Gavhed D (2001). Validation of methods for determination of metabolic rate in the Edholm scale and ISO 8996. International Journal of Occupational Safety and Ergonomics, 7: 135–148.

    Google Scholar 

  • Hasan MH, Alsaleem F, Rafaie M (2016). Sensitivity study for the PMV thermal comfort model and the use of wearable devices biometric data for metabolic rate estimation. Building and Environment, 110: 173–183.

    Google Scholar 

  • He K, Zhang X, Ren S, Sun J (2016). Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.

  • Ioffe S, Szegedy CJ (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd International Conference on Machine Learning, Lille, France.

  • Irshad K, Khan AI, Irfan SA, Alam MM, Almalawi A, et al. (2020). utilizing artificial neural network for prediction of occupants thermal comfort: A case study of a test room fitted with a thermoelectric air-conditioning system. IEEE Access, 8: 99709–99728.

    Google Scholar 

  • ISO (2004). ISO 8996: 2004. Ergonomics of the Thermal Environment—Determination of Metabolic Rate. International Organization for Standardization. Available at http://www.iso.org/standard/34251.html.

  • Kang S, Ou D, Mak CM (2017). The impact of indoor environmental quality on work productivity in university open-plan research offices. Building and Environment, 124: 78–89.

    Google Scholar 

  • Krizhevsky A, Sutskever I, Hinton GE (2012). ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on Neural Information Processing Systems, Siem Reap, Cambodia.

  • Lee K, Schiavon S (2014). Influence of three dynamic predictive clothing insulation models on building energy use, HVAC sizing and thermal comfort. Energies, 7: 1917–1934.

    Google Scholar 

  • Lee J-G, Jun S, Cho Y-W, Lee H, Kim GB, et al. (2017). Deep learning in medical imaging: General overview. Korean Journal of Radiology, 18: 570.

    Google Scholar 

  • Lee K, Choi H, Choi JH, Kim T (2019). Development of a data-driven predictive model of clothing thermal insulation estimation by using advanced computational approaches. Sustainability, 11: 5702.

    Google Scholar 

  • Lee K, Choi H, Kim H, Kim DD, Kim T (2020). Assessment of a real-time prediction method for high clothing thermal insulation using a thermoregulation model and an infrared camera. Atmosphere, 11: 106.

    Google Scholar 

  • Liu S, Schiavon S, Das HP, Jin M, Spanos CJ (2019). Personal thermal comfort models with wearable sensors. Building and Environment, 162: 106281.

    Google Scholar 

  • Long CM, Suh HH, Catalano PJ, Koutrakis P (2001). Using time- and size-resolved particulate data to quantify indoor penetration and deposition behavior. Environmental Science & Technology, 35: 2089–2099.

    Google Scholar 

  • Lowe DG (1999). Object recognition from local scale-invariant features. In: Proceedings of the 7the IEEE International Conference on Computer Vision, Kerkyra, Greece.

  • Luo M, Wang Z, Ke K, Cao B, Zhai Y, et al. (2018). Human metabolic rate and thermal comfort in buildings: The problem and challenge. Building and Environment, 131: 44–52.

    Google Scholar 

  • Lv Y, Duan Y, Kang W, Li Z, Wang F (2015). Traffic flow prediction with big data: A deep learning approach. IEEE Transactions on Intelligent Transportation Systems, 16: 865–873.

    Google Scholar 

  • Metzmacher H, Wölki D, Schmidt C, Frisch J, van Treeck C (2018). Real-time human skin temperature analysis using thermal image recognition for thermal comfort assessment. Energy and Buildings, 158: 1063–1078.

    Google Scholar 

  • Miura J, Demura M, Nishi K, Oishi S (2019). Thermal comfort measurement using thermal-depth images for robotic monitoring. Pattern Recognition Letters, https://doi.org/10.1016/j.patrec.2019.02.014.

  • Moon JW, Kim JJ (2010). ANN-based thermal control models for residential buildings. Building and Environment, 45: 1612–1625.

    Google Scholar 

  • Na H, Choi J-H, Kim H, Kim T (2019). Development of a human metabolic rate prediction model based on the use of Kinect-camera generated visual data-driven approaches. Building and Environment, 160: 106216.

    Google Scholar 

  • Ngarambe J, Yun GY, Santamouris M (2020). The use of artificial intelligence (AI) methods in the prediction of thermal comfort in buildings: Energy implications of AI-based thermal comfort controls. Energy and Buildings, 211: 109807.

    Google Scholar 

  • Nieman DC, Trone GA, Austin MD (2003). A new handheld device for measuring resting metabolic rate and oxygen consumption. Journal of the American Dietetic Association, 103: 588–593.

    Google Scholar 

  • Nieman DC, Austin MD, Benezra L, Pearce S, McInnis T, et al. (2006). Validation of Cosmed’s FitMate™ in measuring oxygen consumption and estimating resting metabolic rate. Research in Sports Medicine, 14: 89–96.

    Google Scholar 

  • Ning H, Wang Z, Ji Y (2016). Thermal history and adaptation: Does a long-term indoor thermal exposure impact human thermal adaptability? Applied Energy, 183: 22–30.

    Google Scholar 

  • Olesen BW, Parsons KC (2002). Introduction to thermal comfort standards and to the proposed new version of EN ISO 7730. Energy and Buildings, 34: 537–548.

    Google Scholar 

  • Park BR, Choi EJ, Choi YJ, Moon JW (2020). Accuracy analysis of DNN-based pose-categorization model and activity-decision algorithm. Energies, 13: 839.

    Google Scholar 

  • Patsadu O, Nukoolkit C, Watanapa B (2012). Human gesture recognition using Kinect camera. In: Proceedings of the 9th International Conference on Computer Science and Software Engineering (JCSSE), Bangkok, Thailand.

  • Polson NG, Sokolov VO (2017). Deep learning for short-term traffic flow prediction. Transportation Research Part C: Emerging Technologies, 79: 1–17.

    Google Scholar 

  • Ravussin E, Burnand B, Schutz Y, Jéquier E (1982). Twenty-four-hour energy expenditure and resting metabolic rate in obese, moderately obese, and control subjects. The American Journal of Clinical Nutrition, 35: 566–573.

    Google Scholar 

  • Ruiz I, Sprowls M, Deng Y, Kulick D, Destaillats H, et al. (2018). Assessing metabolic rate and indoor air quality with passive environmental sensors. Journal of Breath Research, 12: 036012.

    Google Scholar 

  • Schofield WN (1985). Predicting basal metabolic rate, new standards and review of previous work. Human Nutrition Clinical Nutrition, 39: 5–41.

    Google Scholar 

  • Shotton J, Fitzgibbon A, Cook M, Sharp T, Finocchio M, et al. (2011). Real-time human pose recognition in parts from single depth images. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.

  • Simonyan K, Zisserman AJ (2014). Very deep convolutional networks for large-scale image recognition. In: Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA.

  • Staudenmayer J, Pober D, Crouter S, Bassett D, Freedson P (2009). An artificial neural network to estimate physical activity energy expenditure and identify physical activity type from an accelerometer. Journal of Applied Physiology, 107: 1300–1307.

    Google Scholar 

  • Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, et al. (2015). Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.

  • Vakalopoulou M, Karantzalos K, Komodakis N, Paragios N (2015). Building detection in very high resolution multispectral data with deep learning features. In: Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy.

  • Wang R, Blackburn G, Desai M, Phelan D, Gillinov L, et al. (2017). Accuracy of wrist-worn heart rate monitors. JAMA Cardiology, 2: 104–106.

    Google Scholar 

  • Zhai Y, Li M, Gao S, Yang L, Zhang H, et al. (2018). Indirect calorimetry on the metabolic rate of sitting, standing and walking office activities. Building and Environment, 145: 77–84.

    Google Scholar 

Download references

Acknowledgements

This research was supported by the Basic Science Research Program through a National Research Foundation of Korea (NRF) grant funded by the Ministry of Science and ICT (NRF-2017R1A2B3012914) and the Korea government (MSIT, MOE) (2019M3E7A1113090). The authors express their gratitude to the Yonsei University students who participated in the experiments, especially, to the Architectural Environment Lab. members for their technical support of the experiments and data acquisition.

Author information

Authors and Affiliations

  1. Department of Architectural Engineering, Yonsei University, Seoul, 03722, R.O. Korea

    Hooseung Na, Haneul Choi & Taeyeon Kim

Authors
  1. Hooseung Na
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haneul Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Taeyeon Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Taeyeon Kim.

Electronic Supplementary Material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Na, H., Choi, H. & Kim, T. Metabolic rate estimation method using image deep learning. Build. Simul. 13, 1077–1093 (2020). https://doi.org/10.1007/s12273-020-0707-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12273-020-0707-1

Keywords

Search

Navigation