Skip to main content

Advertisement

SpringerLink
Log in

Victoria Symptom Validity Test: A Systematic Review and Cross-Validation Study

  • Review
  • Published:
Neuropsychology Review Aims and scope Submit manuscript

Abstract

The Victoria Symptom Validity Test (VSVT) is a performance validity test (PVT) with over two decades of empirical backing, although methodological limitations within the extant literature restrict its clinical and research generalizability. Chief among these constraints includes limited consensus on the most accurate index within the VSVT and the most appropriate cut-scores within each VSVT validity index. The current systematic review synthesizes existing VSVT validation studies and provides additional cross-validation in an independent sample using a known-groups design. We completed a systematic search of the literature, identifying 17 peer-reviewed studies for synthesis (7 simulation designs, 7 differential prevalence designs, and 3 known-groups designs). The independent cross-validation sample consisted of 200 mixed clinical neuropsychiatric patients referred for outpatient neuropsychological evaluation. Across all indices, Total item accuracy produced the strongest psychometric properties at an optimal cut-score of ≤ 40 (62% sensitivity/88% specificity). However, ROC curve analyses for all VSVT indices yielded statistically significant areas under the curve (AUCs; .73–81), suggestive of moderate classification accuracy. Cut-scores derived using the independent cross-validation sample converged with some previous findings supporting cut-scores of ≤ 22 for Easy item accuracy and ≤ 40 for Total item accuracy, although divergent findings were noted for Difficult item accuracy. Overall, VSVT validity indicators have adequate diagnostic accuracy across populations, with the current study providing additional support for its use as a psychometrically sound PVT in clinical settings. However, caution is recommended among patients with certain verified clinical conditions (e.g., dementia) and those with pronounced working memory deficits due to concerns for increased risk of false positives.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Alverson, W. A., O’Rourke, J. J., & Soble, J. R. (2019). The Word Memory Test genuine memory impairment profile discriminates genuine memory impairment from invalid performance in a mixed clinical sample with cognitive impairment. The Clinical Neuropsychologist, 33(8), 1420–1435.

    PubMed  Google Scholar 

  • Babikian, T., Boone, K. B., Lu, P., & Arnold, G. (2006). Sensitivity and specificity of various digit span scores in the detection of suspect effort. The Clinical Neuropsychologist, 20(1), 145–159.

    PubMed  Google Scholar 

  • Bailey, K. C., Soble, J. R., Bain, K. M., & Fullen, C. (2018). Embedded performance validity tests in the Hopkins Verbal Learning Test – Revised and the Brief Visuospatial Memory Test – Revised: A replication study. Archives of Clinical Neuropsychology, 33, 895–900.

    PubMed  Google Scholar 

  • Bain, K. M., Soble, J. R., Webber, T. A., Messerly, J. M., Bailey, K. C., Kirton, J. W., & McCoy, K. J. M. (2019). Cross-validation of three Advanced Clinical Solutions performance validity tests: Examining combinations of measures to maximize classification of invalid performance. Applied Neuropsychology: Adult. Advance online publication. https://doi.org/10.1080/23279095.2019.1585352

  • Boone, K. B. (2007). Assessment of feigned cognitive impairment: A neuropsychological perspective. Guildford Press.

  • Boone, K. B. (2013). Clinical practice of forensic neuropsychology. Guilford Press.

  • Boone, K. B. (2018). Assessment of neurocognitive performance validity. In J. E. Morgan & J.H. Ricker (Eds.), Textbook of clinical neuropsychology (2nd ed., pp. 39–50). Routledge.

  • Boone, K. B., Lu, P., & Herzberg, D. S. (2002a). The b Test Manual. Western Psychological Services.

  • Boone, K. B., Lu, P., & Herzberg, D. (2002b). The Dot Counting Test manual. Western Psychological Services.

  • Boone, K. B., Salazar, X., Lu, P., Warner-Chacon, K., & Razani, J. (2002). The Rey 15-Item Recognition Trial: A technique to enhance sensitivity of the Rey 15-Item Memorization Test. Journal of Clinical and Experimental Neuropsychology, 24, 561–573.

    PubMed  Google Scholar 

  • Brennan, A. M., & Gouvier, W. D. (2006). Are we honestly studying malingering? A profile and of simulated and suspected malingerers. Applied Neuropsychology, 13, 1–11.

    PubMed  Google Scholar 

  • Brooks, B. L. (2012). Victoria Symptom Validity Test performance in children and adolescents with neurological disorders. Archives of Clinical Neuropsychology, 27, 858–868.

    PubMed  Google Scholar 

  • Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., & Silver, C. H. (2005). Symptom validity assessment: Practice issues and medical necessity. Archives of Clinical Neuropsychology, 20, 419–426.

    PubMed  Google Scholar 

  • Chelune, G. J. (2017). Evidence-based practices in neuropsychology. In S. C. Bowden (Ed.), Neuropsychological assessment in the age of evidence-based practice: Diagnostic and treatment evaluations (pp. 155–181). Oxford University Press.

  • Critchfield, E., Soble, J. R., Marceaux, J. C., Bain, K. M., Bailey, K. C., Webber, T. A., ... & O’Rourke, J. J. F. (2019). Cognitive impairment does not cause performance validity failure: Analyzing performance patterns among unimpaired, impaired, and noncredible participants across six tests. The Clinical Neuropsychologist, 6, 1083–1101.

  • Dean, A. C., Victor, T. L., Boone, K. B., Philpott, L. M., & Hess, R. A. (2009). Dementia and effort test performance. The Clinical Neuropsychologist, 23, 133–152.

    PubMed  Google Scholar 

  • Denning, J. H. (2012). The efficiency and accuracy of the Test of Memory Malingering Trial 1, errors on the first 10 items of the Test of Memory Malingering, and five embedded measures in predicting invalid test performance. Archives of Clinical Neuropsychology, 27, 417–432.

    PubMed  Google Scholar 

  • Doss, R. C., Chelune, G. J., & Naugle, R. I. (1999). Victoria Symptom Validity Test: Compensation-seeking vs. non-compensation-seeking patients in a general clinical setting. Journal of Forensic Neuropsychology, 1, 5–20.

    Google Scholar 

  • Frazier, T. W., Frazier, A. R., Busch, R. M., Kerwood, M. A., & Demaree, H. A. (2008). Detection of simulated ADHD and reading disorder using symptom validity measures. Archives of Clinical Neuropsychology, 23, 501–509.

    PubMed  Google Scholar 

  • Green, P. (2003). Green’s Word Memory Test for Windows: User’s manual. Green’s Publishing.

  • Green, P. (2004). Medical Symptom Validity Test for Windows: User’s manual and program. Green’s Publishing.

  • Greve, K. W., Heinly, M. T., Bianchini, K. J., & Love, J. M. (2009). Malingering detection with the Wisconsin Card Sorting Test in mild traumatic brain injury. The Clinical Neuropsychologist, 23, 343–362.

    PubMed  Google Scholar 

  • Grote, C. L., Kooker, E. K., Garron, D. C., Nyenhuis, D. L., Smith, C. A., & Mattingly, M. L. (2000). Performance of compensation seeking and non-compensation seeking samples on the Victoria Symptom Validity Test: Cross-validation and extension of a standardization study. Journal of Clinical and Experimental Neuropsychology, 22, 709–719.

    CAS  PubMed  Google Scholar 

  • Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., & Millis, S. R. (2009). American Academy of Clinical Neuropsychology Consensus Conference Statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23, 1093–1129.

    PubMed  Google Scholar 

  • Hiscock, M., & Hiscock, C. K. (1989). Refining the forced choice method for the detection of malingering. Journal of Clinical and Experimental Neuropsychology, 11, 967–974.

    CAS  PubMed  Google Scholar 

  • Inman, T. H., Vickery, C. D., Berry, D. T. R., Lamb, D. G., Edwards, C. L., & Smith, G. T. (1998). Development and initial validation of a new procedure for evaluating adequacy of effort given during neuropsychological testing: The Letter Memory Test. Psychological Assessment, 10, 128–149.

    Google Scholar 

  • Iverson, G. L., Lange, R. T., Green, P., & Franzen, M. D. (2002). Detecting exaggeration and malingering with the Trail Making Test. The Clinical Neuropsychologist, 16(3), 398–406.

    PubMed  Google Scholar 

  • Jones, A. (2013). Victoria Symptom Validity Test: Cutoff score for psychometrically defined malingering groups in a military sample. The Clinical Neuropsychologist, 27, 1373–1394.

    PubMed  Google Scholar 

  • Kanser, R. J., Rapport, L. J., Bashem, J. R., & Hanks, R. A. (2019). Detecting malingering in traumatic brain injury: Combining response time with performance validity test accuracy. The Clinical Neuropsychologist, 33(1), 90–107.

    PubMed  Google Scholar 

  • Keary, T. A., Frazier, T. W., Belzile, C. J., Chapin, J. S., Naugle, R. I., Najm, I. M., & Busch, R. M. (2013). Working memory and intelligence are associated with Victoria Symptom Validity Test hard item performance in patients with intractable epilepsy. Journal of the International Neuropsychological Society, 19, 314–323.

    PubMed  Google Scholar 

  • Larrabee, G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17, 410–425.

    PubMed  Google Scholar 

  • Larrabee, G. J. (2008). Aggregation across multiple indicators improves the detection of malingering: Relationship to likelihood ratios. The Clinical Neuropsychologist, 22(4), 666–679.

    PubMed  Google Scholar 

  • Larrabee, G. J. (2012). Performance validity and symptom validity in neuropsychological assessment. Journal of the International Neuropsychological Society, 18(4), 625–630.

    PubMed  Google Scholar 

  • Larrabee, G. J., Millis, S. R., & Meyers, J. E. (2009). 40 plus or minus 10, a new magical number: Reply to Russell. The Clinical Neuropsychologist, 23(5), 841–849.

    PubMed  Google Scholar 

  • Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment (5th ed.). Oxford University Press.

  • Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., & Moher, D. (2009). The PRISMA Statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and Elaboration. PLoS Medicine, 6(7), e1000100.

    PubMed  PubMed Central  Google Scholar 

  • Loring, D. W., Larrabee, G. J., Lee, G. P., & Meador, K. J. (2007). Victoria Symptom Validity Test performance in a heterogenous clinical sample. The Clinical Neuropsychologist, 21(3), 522–531.

    PubMed  Google Scholar 

  • Loring, D. W., Lee, G. P., & Meador, K. J. (2005). Victoria Symptom Validity Test performance in non-litigating epilepsy surgery candidates. Journal of Clinical and Experimental Neuropsychology, 27(5), 610–617.

    PubMed  Google Scholar 

  • Macciocchi, S. N., Seel, R. T., Alderson, A., & Godsall, R. (2006). Victoria Symptom Validity Test performance in acute severe traumatic brain injury: Implications for test interpretation. Archives of Clinical Neuropsychology, 21, 395–404.

    PubMed  Google Scholar 

  • Martin, P. K., & Schroeder, R. W. (2020). Base Rates of invalid test performance across clinical non-forensic contexts and settings. Archives of Clinical Neuropsychology. Advance online publication. https://doi.org/10.1093/arclin/acaa017

  • Martin, P. K., Schroeder, R. W., & Odland, A. P. (2015). Neuropsychologists’ validity testing beliefs and practices: A survey of North American professionals. The Clinical Neuropsychologist, 29(6), 741–776.

    PubMed  Google Scholar 

  • Martin, P. K., Schroeder, R. W., Olsen, D. H., Malloy, H., Boettcher, A., Ernst, N., & Okut, H. (2020). A systematic review and meta-analysis of the Test of Memory Malingering in adults: Two decades of deception detection. The Clinical Neuropsychologist, 34, 88–119.

    PubMed  Google Scholar 

  • Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., & the PRISMA Group (2008). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA Statement. PLoS Medicine, 6, e100097

  • OCEBM Levels of Evidence Working Group (2009, March). The Oxford Levels of Evidence 2. Oxford Centre for Evidence-Based Medicine. https://www.cebm.ox.ac.uk/resources/levels-of-evidence/ocebm-levels-of-evidence

  • Ovsiew, G. P., Resch, Z. J., Nayar, K., Williams, C. P., & Soble, J. R. (2020). Not so fast! Limitations of processing speed and working memory indices as embedded performance validity tests in a mixed neuropsychiatric sample. Journal of Clinical and Experimental Neuropsychology, 42(5), 473–484.

    Article  PubMed  Google Scholar 

  • Patrick, S. D., Rapport, L. J., Kanser, R. J., Hanks, R. A., & Bashem, J. R. (2020). Performance validity assessment using response time on the Warrington Recognition Memory Test. The Clinical Neuropsychologist. Advance online publication. https://doi.org/10.1080/13854046.2020.1716997

    Google Scholar 

  • Pliskin, J. I., De-Dios-Stern, S., Resch, Z. J., Saladino, K. F., Ovsiew, G. P., Carter, D. A., & Soble, J. R. (2020). Comparing the psychometric properties of 8 embedded performance validity tests in the Rey Auditory Verbal Learning Test, Wechsler Memory Scale Logical Memory, and Brief Visuospatial Memory Test-Revised recognition trials for detecting invalid neuropsychological test performance. Assessment. Advance online publication. https://doi.org/10.1177/1073191120929093

  • Resch, Z. J., Soble, J. R., Ovsiew, G. P., Castillo, L. R., Saladino, K. F., DeDios-Stern, S., & Pliskin, N. H. (2020). Working Memory, Processing Speed, and Memory Functioning Are Minimally Predictive of Victoria Symptom Validity Test Performance. Assessment. Advance online publication. https://doi.org/10.1177/1073191120911102

  • Rogers, R. (Ed.) (2008). Clinical assessment of malingering and deception (3rd ed.). Guilford Press.

  • Schroeder, R. W., Martin, P. K., & Odland, A. P. (2016). Expert beliefs and practices regarding neuropsychological validity testing. The Clinical Neuropsychologist, 30(4), 515–535.

    PubMed  Google Scholar 

  • Schwartz, E. S., Erdodi, L., Rodriguez, N., Ghosh, J. J., Curtain, J. R., Flashman, L. A., & Roth, R. M. (2016). CVLT-II Forced Choice Recognition Trial as an embedded validity indicator: A systematic review of the evidence. Journal of the International Neuropsychological Society, 22, 851–858.

    PubMed  Google Scholar 

  • Sherman, E. M. S., Slick, D. J., & Iverson, G. L. (2020). Multidimensional malingering criteria for neuropsychological assessment: A 20-year update of the malingered neuropsychological dysfunction criteria. Archives of Clinical Neuropsychology, 35(6), 735-764.

  • Silk-Eglit, G. M., Lynch, J. K., & McCaffrey, R. J. (2016). Validation of Victoria Symptom Validity Test cutoff scores among mild traumatic brain injury litigants using a known-groups design. Archives of Clinical Neuropsychology, 31, 231–245.

    PubMed  Google Scholar 

  • Silverberg, N. D., Wertheimer, J. C., & Fichtenberg, N. L. (2007). An effort index for the Repeatable Battery for The Assessment of Neuropsychological Status (RBANS). The Clinical Neuropsychologist, 21, 841–854.

    PubMed  Google Scholar 

  • Slick, D. J., Hopp, G., Strauss, E., & Spellacy, F. J. (1996). Victoria Symptom Validity Test: Efficiency for detecting feigned memory impairment and relationship to neuropsychological tests and MMPI-2 validity scales. Journal of Clinical and Experimental Neuropsychology, 18, 911–922.

    CAS  PubMed  Google Scholar 

  • Slick, D. J., Hopp, G., Strauss, E., & Thompson, G. B. (1997). Victoria Symptom Validity Test: Professional manual. Psychological Assessment Resources.

  • Slick, D. J., Sherman, E. M., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13, 545–561.

    CAS  PubMed  Google Scholar 

  • Soble, J. R., Alverson, W. A., Phillips, J. I., Critchfield, E. A., Fullen, C., O’Rourke, J. J. F., & Marceaux, J. C. (2020). Strength in numbers or quality over quantity? Examining the importance of criterion measure selection to define validity groups in performance validity rest (PVT) research. Psychological Injury and Law, 13(1), 44–56.

    Google Scholar 

  • Soble, J. R., Bain, K. M., Bailey, K. C., Kirton, J. W., Marceaux, J. M., Critchfield, E. A., & O’Rourke, J. J. F. (2019). Evaluating the accuracy of the Wechsler Memory Scale-Fourth Edition (WMS-IV) Logical Memory Embedded Validity Index for detecting invalid test performance. Applied Neuropsychology: Adult, 26, 311-318.

  • Sollman, M. J., & Berry, D. T. R. (2011). Detection of inadequate effort on neuropsychological testing: A meta-analytic update and extension. Archives of Clinical Neuropsychology, 26, 774–789.

    PubMed  Google Scholar 

  • Strauss, E., Hultsch, D. F., Hunter, M., Slick, D. J., Patry, B., & Levy-Bencheton, J. (2000). Using intraindividual variability to detect malingering in cognitive performance. The Clinical Neuropsychologist, 14, 420–432.

    Google Scholar 

  • Strauss, E., Slick, D. J., Levy-Bencheton, J., Hunter, M., MacDonald, S. W. S., & Hultsch, D. F. (2002). Intraindividual variability as an indicator of malingering in head injury. Archives of Clinical Neuropsychology, 17, 423–444.

    PubMed  Google Scholar 

  • Strauss, G. P., Morra, L. F., Sullivan, S. K., & Gold, J. M. (2015). The role of low cognitive effort and negative symptoms in neuropsychological impairment in schizophrenia. Neuropsychology, 29(2), 282–291.

    PubMed  Google Scholar 

  • Swets, J. A. (1988). Measuring the accuracy of diagnostic systems. Science, 240, 1285–1293.

    CAS  PubMed  Google Scholar 

  • Tan, J. E., Slick, D. J., Strauss, E., & Hultsch, D. F. (2002). How’d they do it? Malingering strategies on symptom validity tests. The Clinical Neuropsychologist, 16, 495–505.

    PubMed  Google Scholar 

  • Tombaugh, T. N. (1996). Test of Memory Malingering (TOMM). Multi Health Systems.

  • Van Dyke, S. A., Millis, S. R., Axelrod, B. N., & Hanks, R. A. (2013). Assessing effort: Differentiating performance and symptom validity. The Clinical Neuropsychologist, 27(8), 1234–1246.

    PubMed  Google Scholar 

  • Victor, T. L., Boone, K. B., Serpa, J. G., Buehler, J., & Ziegler, E. A. (2009). Interpreting the meaning of multiple symptom validity test failures. The Clinical Neuropsychologist, 23(2), 297–313.

    PubMed  Google Scholar 

  • Vilar-López, R., Gómez-Río, M., Caracuel-Romero, A., Llamas-Elvira, J., & Pérez-García, M. (2008). Use of specific malingering measures in a Spanish sample. Journal of Clinical and Experimental Neuropsychology, 30(6), 710–722.

    PubMed  Google Scholar 

  • Vilar-López, R., Santiago-Ramajo, R. S., Gómez-Río, M., Verdejo-García, A., Llamas, J. M., & Pérez-García, M. (2007). Detection of malingering in a Spanish population using three specific malingering tests. Archives of Clinical Neuropsychology, 22, 379–388.

    PubMed  Google Scholar 

  • Vickery, C. D., Berry, D. T., Inman, T. H., Harris, M. J., & Orey, S. A. (2001). Detection of inadequate effort on neuropsychological testing: A meta-analytic review of selected procedures. Archives of Clinical Neuropsychology, 16, 45–73.

    CAS  PubMed  Google Scholar 

  • Webber, T. A., & Soble, J. R. (2018). Utility of various WAIS-IV Digit Span indices for identifying noncredible performance validity among cognitively impaired and unimpaired examinees. The Clinical Neuropsychologist, 32, 657–670.

    PubMed  Google Scholar 

  • Webber, T. A., Bailey, K. C., Alverson, W. A., Critchfield, E. A., Bain, K. M., Messerly, J. M., & Soble, J. R. (2018). Further validation of the Test of Memory Malingering (TOMM) Trial 1 Performance Validity Index: Examination of false positives and convergent validity. Psychological Injury and Law, 11(4), 325–335.

    Google Scholar 

  • Webber, T. A., Critchfield, E. A., & Soble, J. R. (2020). Convergent, discriminant, and concurrent validity of nonmemory-based performance validity tests. Assessment, 27(7), 1399-1415.

  • White, D. J., Korinek, D., Bernstein, M. T., Ovsiew, G. P., Resch, Z. J., & Soble, J. R. (2020). Cross-validation of non-memory-based embedded performance validity tests for detecting invalid performance among patients with and without neurocognitive impairment. Journal of Clinical and Experimental Neuropsychology, 42, 459–472.

    Article  PubMed  Google Scholar 

  • Whiting, P. F., Rutjes, A. W., Westwood, M. E., Mallett, S., Deeks, J. J., & Reitsma, J. B. (2011). QUADAS-2: A revised tool for the quality assessment of diagnostic accuracy studies. Annals of Internal Medicine, 155(8), 529–536.

Download references

Funding

The authors do not have any financial interest with the subject matter discussed in the manuscript.

Author information

Authors and Affiliations

  1. Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA

    Zachary J. Resch, Matthew T. Bernstein, Tasha Rhoads, Gabriel P. Ovsiew & Jason R. Soble

  2. Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA

    Zachary J. Resch & Tasha Rhoads

  3. Rehabilitation and Extended Care Line, Michael E. DeBakey VA Medical Center, Houston, TX, USA

    Troy A. Webber

  4. Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA

    Jason R. Soble

Authors
  1. Zachary J. Resch
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Troy A. Webber
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Matthew T. Bernstein
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tasha Rhoads
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Gabriel P. Ovsiew
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jason R. Soble
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zachary J. Resch.

Ethics declarations

Conflicts of Interest

The authors have no conflicts of interest to report.

Availability of Data and Material

All of the reviewed studies are publicly available.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Resch, Z.J., Webber, T.A., Bernstein, M.T. et al. Victoria Symptom Validity Test: A Systematic Review and Cross-Validation Study. Neuropsychol Rev 31, 331–348 (2021). https://doi.org/10.1007/s11065-021-09477-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11065-021-09477-5

Keywords

Search

Navigation