Abstract
The brain displays dynamical system behaviors at various levels that are functionally and cognitively relevant. Ample researches have examined how the dynamical properties of brain activity reflect the neural cognitive working mechanisms. A prevalent approach in this field is to extract the trial-averaged brain electrophysiological signals as a representation of the dynamical response of the complex neural system to external stimuli. However, the responses are intrinsically variable in latency from trial to trial. The variability compromises the accuracy of the detected dynamical response pattern based on trial-averaged approach, which may mislead subsequent modelling works. More accurate characterization of the brain’s dynamical response incorporating single trial variability information is of profound significance in deepening our understanding of neural cognitive dynamics and brain’s working principles. Various methods have been attempted to address the trial-to-trial asynchrony issue in order to achieve an improved representation of the dynamical response. We review the latest development of methodology in this area and the contribution of latency variability-based decomposition and reconstruction of dynamical response to neural cognitive researches.
This is a preview of subscription content, log in via an institution to check access.
This figure is taken from Ouyang (2020). Permission has been obtained
Figure was adapted from Ouyang et al. (2016). Permission has been obtained
Figure was adapted from Ouyang et al. (2015). Permission has been obtained
Similar content being viewed by others
References
Arazi A, Gonen-Yaacovi G, Dinstein I (2017) The magnitude of trial-by-trial neural variability is reproducible over time and across tasks in humans. Eneuro. https://doi.org/10.1523/eneuro.0292-17.2017
Bardy F, Van Dun B, Dillon H, Cowan R (2014) Least-squares (LS) deconvolution of a series of overlapping cortical auditory evoked potentials: a simulation and experimental study. J Neural Eng. https://doi.org/10.1088/1741-2560/11/4/046016
Berchicci M, Spinelli D, Di Russo F (2016) New insights into old waves. Matching stimulus- and response-locked ERPs on the same time-window. Biol Psychol 117:202–215. https://doi.org/10.1016/j.biopsycho.2016.04.007
Bluschke A, Muckschel M, Roessner V, Beste C (2020) Intact stimulus-response conflict processing in ADHD-multilevel evidence and theoretical implications. J Clin Med. https://doi.org/10.3390/jcm9010234
Bodmer B, Muckschel M, Roessner V, Beste C (2018) Neurophysiological variability masks differences in functional neuroanatomical networks and their effectiveness to modulate response inhibition between children and adults. Brain Struct Funct 223(4):1797–1810. https://doi.org/10.1007/s00429-017-1589-6
Bridwell DA, Cavanagh JF, Collins AGE, Nunez MD, Srinivasan R, Stober S, Calhoun VD (2018) Moving beyond ERP components: a selective review of approaches to integrate EEG and behavior. Front Hum Neurosci. https://doi.org/10.3389/fnhum.2018.00106
Brooks JX, Carriot J, Cullen KE (2015) Learning to expect the unexpected: rapid updating in primate cerebellum during voluntary self-motion. Nat Neurosci 18(9):1310. https://doi.org/10.1038/nn.4077
Cocchi L, Gollo LL, Zalesky A, Breakspear M (2017) Criticality in the brain: a synthesis of neurobiology, models and cognition. Prog Neurobiol 158:132–152. https://doi.org/10.1016/j.pneurobio.2017.07.002
Cole SR, Voytek B (2017) Brain oscillations and the importance of waveform shape. Trends Cognit Sci 21(2):137–149. https://doi.org/10.1016/j.tics.2016.12.008
Collins AGE, Frank MJ (2018) Within- and across-trial dynamics of human EEG reveal cooperative interplay between reinforcement learning and working memory. Proc Natl Acad Sci USA 115(10):2502–2507. https://doi.org/10.1073/pnas.1720963115
Dandekar S, Privitera C, Carney T, Klein SA (2012) Neural saccadic response estimation during natural viewing. J Neurophysiol 107(6):1776–1790. https://doi.org/10.1152/jn.00237.2011
Davis PA (1939) Effects of acoustic stimuli on the waking human brain. J Neurophysiol 2(6):494–499
De Venuto D, Annese VF, Mezzina G, Scioscia F, Ruta M, Di Sciascio E, Vincentelli AS (2018) A mobile health system for neurocognitive impairment evaluation based on P300 detection. ACM Trans Cyber Phys Syst. https://doi.org/10.1145/3140236
Deco G, Jirsa VK, Robinson PA, Breakspear M, Friston KJ (2008) The dynamic brain: from spiking neurons to neural masses and cortical fields. PLoS Comput Biol. https://doi.org/10.1371/journal.pcbi.1000092
Dhawale AK, Smith MA, Olveczky BP (2017) The role of variability in motor learning. Annu Rev Neurosci 40:479–498. https://doi.org/10.1146/annurev-neuro-072116-031548
Dong L, Li FL, Liu Q, Wen X, Lai YX, Xu P, Yao DZ (2017) MATLAB toolboxes for reference electrode standardization technique (REST) of scalp EEG. Front Neurosci. https://doi.org/10.3389/fnins.2017.00601
Faisal AA, Selen LPJ, Wolpert DM (2008) Noise in the nervous system. Nat Rev Neurosci 9(4):292–303. https://doi.org/10.1038/nrn2258
Fjaellingsdal TG, Schwenke D, Ruigendijk E, Scherbaum S, Bleichner MG (2020) Studying brain activity during word-by-word interactions using wireless EEG. PLoS ONE 15(3):e0230280. https://doi.org/10.1371/journal.pone.0230280
Frank MJ, Gagne C, Nyhus E, Masters S, Wiecki TV, Cavanagh JF, Badre D (2015) fMRI and EEG predictors of dynamic decision parameters during human reinforcement learning. J Neurosci 35(2):485–494. https://doi.org/10.1523/jneurosci.2036-14.2015
Giller F, Beste C (2019) Effects of aging on sequential cognitive flexibility are associated with fronto-parietal processing deficits. Brain Struct Funct 224(7):2343–2355. https://doi.org/10.1007/s00429-019-01910-z
Graben PB, Gerth S, Vasishth S (2008) Towards dynamical system models of language-related brain potentials. Cogn Neurodyn 2(3):229–255. https://doi.org/10.1007/s11571-008-9041-5
Hansen JC (1983) Separation of overlapping waveforms having known temporal distributions. J Neurosci Methods 9(2):127–139. https://doi.org/10.1016/0165-0270(83)90126-7
Hurley S (2001) Perception and action: alternative views. Synthese 129(1):3–40. https://doi.org/10.1023/a:1012643006930
Jung TP, Makeig S, Westerfield M, Townsend J, Courchesne E, Sejnowski TJ (2001) Analysis and visualization of single-trial event-related potentials. Hum Brain Mapp 14(3):166–185. https://doi.org/10.1002/hbm.1050
Kashyap R, Bhattacharjee S, Sommer W, Zhou CS (2019) Repetition priming effects for famous faces through dynamic causal modelling of latency-corrected event-related brain potentials. Eur J Neurosci 49(10):1330–1347. https://doi.org/10.1111/ejn.14303
Kiebel SJ, David O, Friston KJ (2006) Dynamic causal modelling of evoked responses in EEG/MEG with lead field parameterization. Neuroimage 30(4):1273–1284. https://doi.org/10.1016/j.neuroimage.2005.12.055
Kiebel SJ, Garrido MI, Moran RJ, Friston KJ (2008) Dynamic causal modelling for EEG and MEG. Cogn Neurodyn 2(2):121–136. https://doi.org/10.1007/s11571-008-9038-0
Kleimaker M, Takacs A, Conte G, Onken R, Verrel J, Baumer T et al (2020) Increased perception-action binding in Tourette syndrome. Brain 143:1934–1945. https://doi.org/10.1093/brain/awaa111
Kopp B, Steinke A, Visalli A (2020) Cognitive flexibility and N2/P3 event-related brain potentials. Sci Rep 10(1):9859. https://doi.org/10.1038/s41598-020-66781-5
Kutas M, Mccarthy G, Donchin E (1977) Augmenting mental chronometry: P300 as a measure of stimulus evaluation time. Science 197(4305):792–795. https://doi.org/10.1126/science.887923
Loughnane GM, Newman DP, Bellgrove MA, Lalor EC, Kelly SP, O’Connell RG (2016) Target selection signals influence perceptual decisions by modulating the onset and rate of evidence accumulation. Curr Biol 26(4):496–502. https://doi.org/10.1016/j.cub.2015.12.049
Makeig S, Onton J (2011) ERP features and EEG dynamics: an ICA perspective. In: Luck SJ, Kappenman ES (eds) Oxford handbook of event-related potential components. Oxford University Press, Oxford
Martin-Loeches M, Ouyang G, Rausch P, Sturmer B, Palazova M, Schacht A, Sommer W (2017) Test-retest reliability of the N400 component in a sentence-reading paradigm. Lang Cognit Neurosci 32(10):1261–1272. https://doi.org/10.1080/23273798.2017.1330485
Mendonca PRF, Vargas-Caballero M, Erdelyi F, Szabo G, Paulsen O, Robinson HPC (2016) Stochastic and deterministic dynamics of intrinsically irregular firing in cortical inhibitory interneurons. Elife. https://doi.org/10.7554/elife.16475
Meyer K, Rostami HN, Ouyang G, Debener S, Sommer W, Hildebrandt A (2019) Mechanisms of face specificity–differentiating speed and accuracy in face cognition by event-related potentials of central processing
Miller J, Ulrich R, Schwarz W (2009) Why jackknifing yields good latency estimates. Psychophysiology 46(2):300–312. https://doi.org/10.1111/j.1469-8986.2008.00761.x
Muckschel M, Roessner V, Beste C (2020) Task experience eliminates catecholaminergic effects on inhibitory control: A randomized, double-blind cross-over neurophysiological study. Eur Neuropsychopharmacol 35:89–99. https://doi.org/10.1016/j.euroneuro.2020.03.013
Murray JG, Ouyang G, Donaldson DI (2019) Compensation of trial-to-trial latency jitter reveals the parietal retrieval success effect to be both variable and thresholded in older adults. Front Aging Neurosci. https://doi.org/10.3389/fnagi.2019.00179
Opitz A, Beste C, Stock AK (2020) Using temporal EEG signal decomposition to identify specific neurophysiological correlates of distractor-response bindings proposed by the theory of event coding. Neuroimage. https://doi.org/10.1016/j.neuroimage.2020.116524
Ouyang G (2020) ReSync: correcting the trial-to-trial asynchrony of event-related brain potentials to improve neural response representation. J Neurosci Methods 339:108722. https://doi.org/10.1016/j.jneumeth.2020.108722
Ouyang G, Schacht A, Zhou CS, Sommer W (2013) Overcoming limitations of the ERP method with residue iteration decomposition (RIDE): a demonstration in go/no-go experiments. Psychophysiology 50(3):253–265. https://doi.org/10.1111/psyp.12004
Ouyang G, Sommer W, Zhou CS (2015) Updating and validating a new framework for restoring and analyzing latency-variable ERP components from single trials with residue iteration decomposition (RIDE). Psychophysiology 52(6):839–856. https://doi.org/10.1111/psyp.12411
Ouyang G, Sommer W, Zhou CS (2016) Reconstructing ERP amplitude effects after compensating for trial-to-trial latency jitter: a solution based on a novel application of residue iteration decomposition. Int J Psychophysiol 109:9–20. https://doi.org/10.1016/j.ijpsycho.2016.09.015
Ouyang G, Hildebrandt A, Sommer W, Zhou CS (2017) Exploiting the intra-subject latency variability from single-trial event-related potentials in the P3 time range: a review and comparative evaluation of methods. Neurosci Biobehav Rev 75:1–21. https://doi.org/10.1016/j.neubiorev.2017.01.023
Patterson JV, Jin Y, Gierczak M, Hetrick WP, Potkin S, Bunney WE, Sandman CA (2000) Effects of temporal variability on P50 and the gating ratio in schizophrenia: a frequency domain adaptive filter single-trial analysis. Arch Gen Psychiatry 57(1):57–64. https://doi.org/10.1001/archpsyc.57.1.57
Peng SH, Xuan B, Li P (2020) Fearful faces modulate cognitive control under varying levels of uncertainty: an event-related potential study. Brain Cogn. https://doi.org/10.1016/j.bandc.2020.105550
Pisauro MA, Fouragnan E, Retzler C, Philiastides MG (2017) Neural correlates of evidence accumulation during value-based decisions revealed via simultaneous EEG-fMRI. Nat Commun. https://doi.org/10.1038/ncomms15808
Pomalazaraez CA, Mcgillem CD (1986) Enhancement of event related potentials by iterative restoration algorithms. IEEE Trans Biomed Eng 33(12):1107–1113. https://doi.org/10.1109/tbme.1986.325687
Ratcliff R, Sederberg PB, Smith TA, Childers R (2016) A single trial analysis of EEG in recognition memory: tracking the neural correlates of memory strength. Neuropsychologia 93:128–141. https://doi.org/10.1016/j.neuropsychologia.2016.09.026
Rellecke J, Sommer W, Schacht A (2012) Does processing of emotional facial expressions depend on intention? Time-resolved evidence from event-related brain potentials. Biol Psychol 90(1):23–32. https://doi.org/10.1016/j.biopsycho.2012.02.002
Ribeiro MJ, Paiva JS, Castelo-Branco M (2016) Spontaneous fluctuations in sensory processing predict within-subject reaction time variability. Front Hum Neurosci. https://doi.org/10.3389/fnhum.2016.00200
Rostami HN, Saville CWN, Klein C, Ouyang G, Sommer W, Zhou CS, Hildebrandt A (2017) COMT genotype is differentially associated with single trial variability of ERPs as a function of memory type. Biol Psychol 127:209–219. https://doi.org/10.1016/j.biopsycho.2017.06.002
Sassenhagen J, Bornkessel-Schlesewsky I (2015) The P600 as a correlate of ventral attention network reorientation. Cortex 66:A3–A20. https://doi.org/10.1016/j.cortex.2014.12.019
Saville CWN, Feige B, Kluckert C, Bender S, Biscaldi M, Berger A et al (2015) Increased reaction time variability in attention-deficit hyperactivity disorder as a response-related phenomenon: evidence from single-trial event-related potentials. J Child Psychol Psychiatry 56(7):801–813. https://doi.org/10.1111/jcpp.12348
Schiff S, D’Avanzo C, Cona G, Goljahani A, Montagnese S, Volpato C et al (2014) Insight into the relationship between brain/behavioral speed and variability in patients with minimal hepatic encephalopathy. Clin Neurophysiol 125(2):287–297. https://doi.org/10.1016/j.clinph.2013.08.004
Smith NJ, Kutas M (2015a) Regression-based estimation of ERP waveforms: I. The rERP framework. Psychophysiology 52(2):157–168. https://doi.org/10.1111/psyp.12317
Smith NJ, Kutas M (2015b) Regression-based estimation of ERP waveforms: II. Nonlinear effects, overlap correction, and practical considerations. Psychophysiology 52(2):169–181. https://doi.org/10.1111/psyp.12320
Spencer KM, Abad EV, Donchin E (2000) On the search for the neurophysiological manifestation of recollective experience. Psychophysiology 37(4):494–506. https://doi.org/10.1111/1469-8986.3740494
Stefanics G, Heinzle J, Horvath AA, Stephan KE (2018) Visual mismatch and predictive coding: a computational single-trial ERP study. J Neurosci 38(16):4020–4030. https://doi.org/10.1523/jneurosci.3365-17.2018
Steinemann NA, O’Connell RG, Kelly SP (2018) Decisions are expedited through multiple neural adjustments spanning the sensorimotor hierarchy. Nat Commun. https://doi.org/10.1038/s41467-018-06117-0
Stokes M, Spaak E (2016) The importance of single-trial analyses in cognitive neuroscience. Trends Cognit Sci 20(7):483–486. https://doi.org/10.1016/j.tics.2016.05.008
Sturmer B, Ouyang G, Zhou CS, Boldt A, Sommer W (2013) Separating stimulus-driven and response-related LRP components with residue iteration decomposition (RIDE). Psychophysiology 50(1):70–73. https://doi.org/10.1111/j.1469-8986.2012.01479.x
Takacs A, Mückschel M, Roessner V, Beste C (2020) Decoding stimulus-response representations and their stability using EEG-based multivariate pattern analysis. Cereb Cortex Commun 1:1–12
Takeda Y, Yamanaka K, Yamamoto Y (2008) Temporal decomposition of EEG during a simple reaction time task into stimulus- and response-locked components. Neuroimage 39(2):742–754. https://doi.org/10.1016/j.neuroimage.2007.09.003
Takeda Y, Sato M, Yamanaka K, Nozaki D, Yamamoto Y (2010) A generalized method to estimate waveforms common across trials from EEGs. Neuroimage 51(2):629–641. https://doi.org/10.1016/j.neuroimage.2010.02.002
Tobimatsu S, Celesia GG (2006) Studies of human visual pathophysiology with visual evoked potentials. Clin Neurophysiol 117(7):1414–1433. https://doi.org/10.1016/j.clinph.2006.01.004
Truccolo W, Knuth KH, Shah A, Bressler SL, Schroeder CE, Ding MZ (2003) Estimation of single-trial multicomponent ERPs: differentially variable component analysis (dVCA). Biol Cybern 89(6):426–438. https://doi.org/10.1007/s00422-003-0433-7
Valt C, Sprengeler MK, Sturmer B (2020) Feedback processing in the context of social comparison. Psychophysiology. https://doi.org/10.1111/psyp.13489
Verleger R, Metzner MF, Ouyang G, Smigasiewicz K, Zhou CS (2014) Testing the stimulus-to-response bridging function of the oddball-P3 by delayed response signals and residue iteration decomposition (RIDE). Neuroimage 100:271–289. https://doi.org/10.1016/j.neuroimage.2014.06.036
Walhovd KB, Rosquist H, Fjell AM (2008) P300 amplitude age reductions are not caused by latency jitter. Psychophysiology 45(4):545–553
Wang F, Ouyang G, Zhou CS, Wang SP (2015) Re-examination of chinese semantic processing and syntactic processing: evidence from conventional ERPs and reconstructed ERPs by residue iteration decomposition (RIDE). PLoS ONE. https://doi.org/10.1371/journal.pone.0117324
Wang SJ, Ouyang G, Guang J, Zhang MS, Wong KYM, Zhou CS (2016) Stochastic oscillation in self-organized critical states of small systems: sensitive resting state in neural systems. Phys Rev Lett. https://doi.org/10.1103/physrevlett.116.018101
Wang R, Lin P, Liu MX, Wu Y, Zhou T, Zhou CS (2019) Hierarchical connectome modes and critical state jointly maximize human brain functional diversity. Phys Rev Lett. https://doi.org/10.1103/physrevlett.123.038301
Warren CV, Maraver MJ, de Luca A, Kopp B (2020) The effect of Transcutaneous auricular vagal nerve stimulation (taVNS) on P3 event-related potentials during a bayesian oddball task. Brain Sci 10(6):404
Wolff N, Chmielewski W, Buse J, Roessner V, Beste C (2019) Paradoxical response inhibition advantages in adolescent obsessive compulsive disorder result from the interplay of automatic and controlled processes. Neuroimage Clin. https://doi.org/10.1016/j.nicl.2019.101893
Wolters CH, Beckmann RF, Rienacker A, Buchner H (1999) Comparing regularized and non-regularized nonlinear dipole fit methods: a study in a simulated sulcus structure. Brain Topogr 12(1):3–18. https://doi.org/10.1023/a:1022281005608
Woody CD (1967) Characterization of an adaptive filter for the analysis of variable latency neuroelectric signals. Med Biol Eng 5(6):539–554
Wu W, Wu CH, Gao SK, Liu BL, Li YQ, Gao XR (2014) Bayesian estimation of ERP components from multicondition and multichannel EEG. Neuroimage 88:319–339. https://doi.org/10.1016/j.neuroimage.2013.11.028
Yang H, Zhao J, Gaspar CM, Chen W, Tan YF, Weng XC (2017) Selectivity of N170 for visual words in the right hemisphere: evidence from single-trial analysis. Psychophysiology 54(8):1128–1137. https://doi.org/10.1111/psyp.12867
Yao DZ (2001) A method to standardize a reference of scalp EEG recordings to a point at infinity. Physiol Meas 22(4):693–711. https://doi.org/10.1088/0967-3334/22/4/305
Yin G, Zhang J, Tian Y, Yao DZ (2009) A multi-component decomposition algorithm for event-related potentials. J Neurosci Methods 178(1):219–227. https://doi.org/10.1016/j.jneumeth.2008.11.022
Zhang J (1998) Decomposing stimulus and response component waveforms in ERP. J Neurosci Methods 80(1):49–63. https://doi.org/10.1016/s0165-0270(97)00194-5
Zhang DD, Ding HY, Wang XC, Qi CZ, Luo YJ (2015) Enhanced response inhibition in experienced fencers. Sci Rep. https://doi.org/10.1038/srep16282
Acknowledgements
This work was partially supported by the Hong Kong Research Grant Council (ECS 27603818) and the Seed Fund for Basic Research from the University of Hong Kong (Nos. 201804159003, 201811159032) to G.O., and by the Hong Kong Baptist University Research Committee Interdisciplinary Research Matching Scheme (IRMS/16-17/04) to C.S.Z.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ouyang, G., Zhou, C. Characterizing the brain’s dynamical response from scalp-level neural electrical signals: a review of methodology development. Cogn Neurodyn 14, 731–742 (2020). https://doi.org/10.1007/s11571-020-09631-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11571-020-09631-4