Augmenting building performance predictions during design using generative adversarial networks and immersive virtual environments

https://doi.org/10.1016/j.autcon.2020.103350Get rights and content

Highlights

  • A framework combining context-aware design-specific data with an existing building performance model (existing BPM) guided by a performance target was proposed.

  • An immersive virtual environment (IVE) simulating a building under design was used to acquire context-aware design-specific data.

  • A generative adversarial network was used to combine an existing BPM with context-aware design-specific data using a performance target as guided.

  • A case study demonstrated efficacy and reliability of the framework.

Abstract

Existing building performance models (existing BPMs) often lack the capability for addressing human-building interactions in future buildings or buildings under design because they are mainly derived using data in existing buildings. The limitation may contribute to discrepancies between simulated and actual building performance. In a previous study, the authors discussed a framework using an artificial neural network (ANN)-based greedy algorithm which combines context-aware design-specific data obtained from immersive virtual environments (IVEs) with an existing BPM to enhance the simulations of human-building interactions in new designs. Although the framework has revealed the potential to improve simulations, it cannot determine the appropriate combination between context-aware design-specific data and the existing BPM.

In this paper, the authors present a new computational framework (the GAN-based framework) to determine an appropriate combination based on a given performance target to achieve. Generative adversarial networks (GANs) are used to combine data of an existing BPM and context-aware design-specific data using a performance target as a guide to produce an augmented BPM. The effectiveness and the reliability of the GAN-based framework were validated using an IVE of a single occupancy office. Thirty people participated in an experiment on the simulation of artificial lighting switch uses using the IVE. Their light switch uses data under different work area illuminance were collected and analyzed. The building performance models (BPMs) proposed by Hunt and Da Silva were selected as the existing BPM and the performance target respectively. The data of each participant was used to generate an augmented BPM using the GAN-based framework and an updated BPM using the previous framework (i.e., ANN-based greedy algorithm framework). The thirty pairs of the augmented and updated BPMs were compared. Specifically, the errors measured between the updated BPMs and the performance target (E1) and the errors measured between the augmented BPMs and the performance target (E2) were analyzed using t-tests (α = 0.05). In 22 out of 30 cases, the performance of the augmented BPMs was significantly better than the updated BPMs, and in four cases, the performance of the two was similar. Only in four other cases, the performance of the updated BPMs was better. The results confirmed the efficacy of the framework. However, future research is needed to study the performance target and uncertainties associated with IVE experiments to better understand and control the reliability of the framework.

Introduction

The design stage of a building project is a critical step to make decisions and establish directions for engineering building components, affecting the characteristics, functions, and performance of a building. To optimally translate design goals and objectives into the performance of a building, designers and engineers usually apply building performance models (BPMs) during the design stage such as simulations of building energy consumptions and human-building interactions to understand, investigate, and predict building performance, as well as support decision-making. Nevertheless, the application of BPMs cannot eliminate the significant performance discrepancies between the simulated and the actual performances that have been widely reported [[1], [2], [3]]. For example, studies have reported as much as 150% of differences between predicted and the actual performance of a building [4].

Many factors influence the simulations of building performance, especially human-building interactions such as occupant responses to building contexts and occupant habitual behaviors [5]. Human-building interactions are highly context-depended and sensitive to several contexts [6,7] in which contexts are described by situational factors that are not directly included in a model or simulation [8]. These situational factors are often assumed to remain constant across different applications of the model or simulation. For instance, “context” may be physical or natural factors (e.g., building characteristics, building surrounding and environmental factors, and climate conditions), and socio-technical factors (e.g., participant's cultural background, racial/ethnicity, and tasks to perform), which may not be included as variables in a BPM. However, such factors can have an impact on analysis using the BPM during the design of a specific space, whose situational factors may be different from what the BPM has assumed and cannot be treated as constant across different applications. In such cases, these situational factors in relation to any BPM need to be identified, analyzed, and integrated in building performance analyses. Often, BPMs are developed using data obtained from existing buildings, where the contexts of which differs from the contexts of a building under design. Applying such BPMs to understand, investigate, and predict human-building interactions in a building under design may contribute to the discrepancy between predicted and actual performance. Therefore, being able to address human-building interactions responding to specific contexts in new designs (e.g., the context embodied) can potentially enhance the accuracy of BPMs leading to reductions of the discrepancy between predicted and actual performance of a building.

Immersive virtual environments (IVEs) have demonstrated their potential in simulations and data collections in many disciplinary areas, especially engineering fields such as emergency evacuations [9,10], building designs [11], and human-building interactions [[12], [13], [14]]. IVEs provide several advantages over other data collection methods such as sensing, field studies, and surveys. For instance, IVEs can replicate certain context for buildings under design, especially when the contexts cannot be possibly, cost-effectively, or safely replicated in reality. Additionally, IVEs allow users to fully handle experimental conditions, and customize experimental models as desired. Human-building interactions in buildings under design may not be directly observed and analyzed. As a result, the application of IVEs can be an alternative for generating and examining the context-aware design-specific data of a new design. Following Sowa's definition of context [8], “context-aware” refers to the capability of a method, simulation, or model to address the impact of identified contextual factors in analysis. Therefore, by using the method, simulation or model, users are able to consider human-building interactions responding to contexts of a specific design. For example, in the application discussed in the paper, the context-aware design specific data of the proposed computation framework included contextual factors such as types of office task and locations of light switch.

To improve the accuracy of existing building performance models (existing BPMs), the authors have offered a framework for customizing existing BPMs to address contextual factors of a building under design. The framework using an artificial neural network (ANN)-based greedy algorithm has been developed to combine an existing BPM with context-aware design-specific data obtained from IVE experiments [15]. The framework has shown the potential to enhance the prediction accuracy of an existing BPM. However, its major limitation is that it lacks the capability to determine the appropriate combination of an existing BPM and context-aware design-specific data in a principled way rather than through trial and error, that can entail excess resource and time consumption. Hence, the principal goal of this study is to improve the capability of the framework to be able to determine the appropriate combination without trial and error. The new computational framework applies generative adversarial networks (GANs) to combine an existing BPM with context-aware design-specific data obtained from IVE experiments, and uses a performance target as a guide during computation to determine the appropriate mix without trial and error. The GAN-based framework produces an augmented building performance model (an augmented BPM) representing the appropriate combination that satisfies the performance target.

In the following, the authors first discuss comparison of the GAN-based framework and the ANN-based greedy algorithm framework, and then provide the research objective followed by an expression of the GAN-based framework and the explanation of applying the framework on a single-occupancy office to validate the framework. The design and administration of the IVE experiment are explained in detail. Finally, results, discussions, and limitations of the study, as well as conclusions and directions of future work are provided.

Section snippets

Comparison of the GAN-based framework and the ANN-based greedy algorithm framework

This section discusses major differences and relationships between the GAN-based framework and the ANN-based greedy algorithm framework. In parametric approaches (e.g., Gaussian mixture model), mixture models mix datasets derived from assumed probability distribution functions such as normal, binomial, and exponential [16]. Often, datasets do not fully comply with assigned distributions leading to the generation of inaccurate mixture models. Consequently, the ANN-based greedy algorithm

Research objective

The aim of this study is to create a new GAN-based framework that enables users to better perform building performance simulations during design. To achieve the goal, the objective of this study is twofold: 1) to investigate efficacy of the GAN-based framework in enhancing the prediction accuracy of BPMs, and 2) to examine the reliability of the GAN-based framework using experiments.

To determine the reliability of the framework, the authors conducted experiments on thirty college students to

Overview of the computational framework

The five main components of the GAN-based framework (Fig. 1) are: 1) an existing building performance model (an existing BPM), 2) context-aware design-specific data acquired from an IVE experiment, 3) a performance target, 4) a computation using generative adversarial network (GAN), and 5) an augmented BPM.

In general, “building performance models (BPMs)” is used to describe models of building performance at different building scales. BPMs may include performance models at a small scale such as

Application of the GAN-based framework

The application aims at understanding the efficacy and the reliability of the GAN-based framework by testing the hypothesis. The application used the lighting predictions in a single occupancy office as the studied case. An IVE configuration was created based on general recommendations of office designs [37], simulating situations related to variables of a BPM, and contextual factors (i.e., work area illuminance (lx), office tasks including reading, having a break, having a meeting, and

The context-aware design-specific data acquired from the IVE experiment

Fig. 11 presents the means and the standard deviations of the context-aware design-specific data obtained from the IVE experiment of all participants classified by the office tasks and the light switch locations. Two observations show the qualitative effectiveness of the data:

  • 1)

    The probability of switching on under low work area illuminance was higher than high work area illuminance regardless the assigned tasks and the light switch locations. This general pattern matched the previous studies [39,

Discussions

The hypothesis testing at individual level shows mixed results. In the following, discussions regarding the context-aware design-specific data, the augmented BPMs, and the results of hypothesis tests are presented.

  • The context-aware design-specific data involved variances associated with the probability of switching on (Fig. 11). As mentioned in literature (e.g., [15,69]), participants are clearly a source of the variances since different people may respond to the IVE experiment differently. In

Limitations of the study

Major limitations of the study can be discussed in the following:

  • An approach to establish a performance target is not included in the framework. An approach to map design goals and objectives of buildings into a computational target is needed.

  • As mentioned in the discussion, the most appropriate mixture may be obtained when context-aware design-specific data are relatively close to a performance target. If a target is unrealistic and context-aware design-specific data are relatively close to a

Conclusions and future work

The results of the hypothesis tests have shown that in most cases the augmented BPM has higher accuracy than the updated BPM, which suggests that the GAN-based framework is in general better in performance than the previous ANN-based greedy algorithm. However, in a few cases, the opposite is observed. Causes of the instability in performance of the framework require further research. In general, the selection of the performance target and the IVE experiments are potentially the main causes.

Declaration of competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgements

This paper was partially supported by the U.S. National Science Foundation Award #1640818. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

References (72)

  • S. Saeidi et al.

    Spatial-temporal event-driven modeling for occupant behavior studies using immersive virtual environments

    Autom. Constr.

    (2018)
  • F.W.H. Wong et al.

    Optimising design objectives using the Balanced Scorecard approach

    Des. Stud.

    (2009)
  • S. Basu et al.

    Deep neural networks for texture classification—a theoretical analysis

    Neural Netw.

    (2018)
  • C.F. Reinhart

    Lightswitch-2002: a model for manual and automated control of electric lighting and blinds

    Sol. Energy

    (2004)
  • D. Bourgeois et al.

    Adding advanced behavioural models in whole building energy simulation: a study on the total energy impact of manual and automated lighting control

    Energy and Buildings

    (2006)
  • M.N. Almarshad et al.

    A Monte Carlo simulation for two novel automatic censoring techniques of radar interfering targets in log-normal clutter

    Signal Process.

    (2008)
  • P. Cunningham et al.

    Stability problems with artificial neural networks and the ensemble solution

    Artif. Intell. Med.

    (2000)
  • D.R.G. Hunt

    The use of artificial lighting in relation to daylight levels and occupancy

    Build. Environ.

    (1979)
  • Z. Wang et al.

    Comparison of K-means and GMM methods for contextual clustering in HSM

  • R.B. Lanjewar et al.

    Implementation and comparison of speech emotion recognition system using Gaussian mixture model (GMM) and K-nearest neighbor (K-NN) techniques

    Procedia Computer Science

    (2015)
  • G.S. Morrison

    A comparison of procedures for the calculation of forensic likelihood ratios from acoustic-phonetic data: multivariate kernel density (MVKD) versus Gaussian mixture model-universal background model (GMM-UBM)

    Speech Comm.

    (2011)
  • K.Y. Lee

    Local fuzzy PCA based GMM with dimension reduction on speaker identification

    Pattern Recogn. Lett.

    (2004)
  • G.Y. Yun et al.

    Time-dependent occupant behaviour models of window control in summer

    Build. Environ.

    (2008)
  • D. Yan et al.

    The evaluation of stochastic occupant behavior models from an application-oriented perspective: using the lighting behavior model as a case study

    Energy and Buildings

    (2018)
  • Y. Zhu et al.

    Potential and challenges of immersive virtual environments for occupant energy behavior modeling and validation: a literature review

    Journal of Building Engineering

    (2018)
  • Q. Liu et al.

    Unsupervised learning using pretrained CNN and associative memory bank

  • C. van Dronkelaar et al.

    A review of the energy performance gap and its underlying causes in non-domestic buildings

    Frontiers in Mechanical Engineering

    (2016)
  • C.M. Clevenger et al.

    Demonstrating the impact of the occupant on building performance

    J. Comput. Civ. Eng.

    (2014)
  • J.F. Sowa

    Syntax, semantics, and pragmatics of contexts

  • Y. Hong et al.

    LumiSpace: A VR architectural daylighting design system

  • S. Saeidi et al.

    Measuring the effectiveness of an immersive virtual environment for the modeling and prediction of occupant behavior

  • S. Niu et al.

    A virtual reality integrated design approach to improving occupancy information integrity for closing the building energy performance gap

    Sustain. Cities Soc.

    (2015)
  • A. Lijoi et al.

    Controlling the reinforcement in Bayesian non-parametric mixture models

    Journal of the Royal Statistical Society: Series B (Statistical Methodology)

    (2007)
  • I. Goodfellow et al.

    Generative adversarial nets

  • R.E. Kalman

    A new approach to linear filtering and prediction problems

    J. Basic Eng.

    (1960)
  • M. Keller et al.

    Integrating the specification, acquisition and processing of building performance information

    Tsinghua Science and Technology

    (2008)
  • Cited by (21)

    View all citing articles on Scopus
    View full text