Abstract
A (local) survey on income carried out in the city of Modena in 2002, with income reference year 2001, generated four categories of units: interviewees, refusals, noncontacts, and unused reserves . In this study, all units were matched with their corresponding records in the Ministry of Finance 2001 database and the 2001 Census database. Considering all four categories, participation increased by education level and activity status, while it decreased among low or high incomes. Considering interviewees only, over- and under-reporting, as well as measurement errors, were investigated by comparing the surveyed income with fiscal income. Age and level of income were the main covariates affecting the behaviours of taxpayers.
Similar content being viewed by others
References
Abowd JM, Stinson MH (2013) Estimating measurement error in annual job earnings: a comparison of survey and administrative data. Rev Econ Stat 95(5):1451–1467
Anderson TW, Darling DA (1952) Asymptotic theory of certain “goodness-of-fit” criteria based on stochastic processes. Ann Math Stat 23(2):193–212
Baldini M, Bosi P, Silvestri P (eds) (2004) La ricchezza dell’equità. Distribuzione del reddito e condizioni di vita in un’area a elevato benessere. il Mulino, Bologna
Baldini M, Bosi P, Lalla M (2009) Tax evasion and misreporting in income tax returns and household income surveys. Politica Economica. a. XXV(3):333–348
Banca d’Italia (2004) I bilanci delle famiglie italiane nell’anno 2002, Supplementi al bollettino statistico, anno XIV, no. 12. Roma: Banca d’Italia
Bancroft G (1940) Consistency of information from records and interview. J Am Stat Assoc 35(210):377–381 (Part 1)
Bee CA, Gathright GMR, Meyer BD (2015) Bias from Unit Non-Response in the Measurement of Income in Household Surveys. Available on the site accessed 19 March 2020: https://harris.uchicago.edu/files/jsm2015_bgm_unit_non-response_in_cps.pdf
Biancotti C, D’Alessio G, Neri A (2004) Errori di misura nell’indagine sui bilanci delle famiglie italiane. Temi di discussione, no. 520. Roma: Banca d’Italia
Bingley P, Martinello A (2017) Measurement error in income and schooling and the bias of linear estimators. J Law Econ 35(4):1117–1148
Bollinger CR, Hirsch BT (2013) Is earnings nonresponse ignorable? Rev Econ Stat 95(2):407–416
Bollinger CR, Hirsch BT, Hokayem CM, Ziliak JP (2019) Trouble in the tails? what we know about earnings nonresponse 30 years after Lillard, Smith, and Welch. J Polit Econ 127(5):2143–2185
Bollinger CR., Hirsch BT, Hokayem CM, Ziliak JP (2018) The Good, The Bad and The Ugly: Measurement Error, Non-response and Administrative Mismatch in the CPS. https://www.semanticscholar.org/paper/The-Good-%2C-The-Bad-and-The-Ugly-%3A-Measurement-Error-Bollinger-Hirsch/4f183466ef6566cbec9b579aed0ce0e66c53ee55
Bound J, Kruger AB (1991) The extent of measurement error in longitudinal earnings data: do two wrongs make a right? J Law Econ 9(1):1–24
Bound J, Brown C, Mathiowetz N (2001) Measurement Error in Survey Data. In: Heckman JJ, Leamer E (eds) Handbook of Econometrics, vol 5. Elsevier, Amsterdam, pp 3705–3843
Brick JM (2013) Unit nonresponse and weighting adjustments: a critical review. J off Stat 29(3):329–353
Burton, J., Crossley, T. F., Fisher, P., Gaia, A., and Jäkle, A. (2020). Understanding and reducing income reporting error in household survey. Understanding Society Working Paper, No. 2020–01. Essex: Institute for Social and Economic Research (ISER), University of Essex. https://www.iser.essex.ac.uk/research/publications/working-papers/understanding-society/2020-01 Accessed 16 March 2020
Campanelli P, O’Muircheartaigh C (1999) Interviewers, interviewer continuity, and panel survey nonresponse. Qual Quant 33(1):59–76
Cannari L, D’Alessio G (1992) Mancate interviste e distorsione degli stimatori. Temi di discussione, no. 172. Roma: Banca d’Italia
Consolini P, Donatiello G (2013) 9. Improvements of data quality through the combined use of survey and administrative sources and micro simulation model. In Jäntti M, Törmäletho VM, Marlier E The use of registers in the context of EU-SILC: challenges and opportunities. Collection: Statistical working papers (pp. 125−71). Luxembourg: Cat. No: KS-TC-13–004-EN-N, Publication Office of the European Union. https://ec.europa.eu/eurostat/documents/3888793/5856365/KS-TC-13-004-EN.PDF Accessed 16 March 2020
D’Alessio G, Faiella I (2002) Non-response Behaviour in the Bank of Italy’s Survey of Household Income and Wealth. Temi di discussione, no. 462. Roma: Banca d’Italia
D’Aurizio L, Faiella I, Iezzi S, Neri A (2006) L’under-reporting della ricchezza finanziaria nell’indagine sui bilanci delle famiglie. Temi di discussione, no. 610. Rome: Banca d’Italia
Durrant GB, Steele F (2009) Multilevel modelling of refusal and non-contact in household surveys: evidence of six UK Government surveys. J R Stat Soc Ser A 172(Part 2):361–381
Eurostat (2009) Description of Target Variables: Cross-Sectional and Longitudinal, Document EU-SILC 065/2009, Directorate F, Unit F-3. Luxembourg: Eurostat
Gujarati ND (2004) Basic Econometrics, 4th edn. McGraw-Hill, New York
Hansen MH, Hurwitz WN (1946) The problem of non-response in sample surveys. J Am Stat Assoc 41(236):517–529
Hariri JG, Lassen DD (2017) Income and outcomes social desirability bias distorts measurements of the relationship between income and political behavior. Public Opin Q 81(2):564–576
Hüfken V (2010) Supplementary questionnaire and nonresponse-results from the German ISSP survey. Qual Quant 44(4):607–622
Hurd M, Juster FT, Smith JP (2003) Enhancing the quality of data on income. J Hum Resour 38(3):758–772
Jäntti M (2004) The effect of measurement errors, non-response, and attrition on income inequality, poverty and mobility. In: Ehling M, Rendtel U (eds) Harmonisation of panel surveys and data quality. Statistisches Bundesamt, Wiesbaden, pp 89–116
Jäntti M, Törmäletho VM (2013) 4 Survey- and register-based estimates of income distribution and poverty. In M. Jäntti, V.-M. Törmäletho, & E. Marlier, The use of registers in the context of EU-SILC: challenges and opportunities. Collection: Statistical working papers (pp. 57−71). Luxembourg: Cat. No: KS-TC-13–004-EN-N, Publication Office of the European Union. https://ec.europa.eu/eurostat/documents/3888793/5856365/KS-TC-13-004-EN.PDF Accessed 16 March 2020
Jäntti M, Törmäletho VM, Marlier E (2013) The use of registers in the context of EU-SILC: challenges and opportunities. Theme 3. Collection: Statistical working papers. Luxembourg: Cat. No: KS-TC-13–004-EN-N, Publication Office of the European Union. https://ec.europa.eu/eurostat/documents/3888793/5856365/KS-TC-13-004-EN.PDF Accessed 16 March 2020
Kapteyn A, Ypma JY (2007) Measurement error and misclassification: a comparison of survey and administrative data. J Law Econ 25(3):513–551
Korinek A, Mistiaen JA, Ravallion M (2007) An econometric method of correcting for unit nonresponse bias in surveys. J Econom 136(1):213–235
Meijer E, Ypma J (2008) A simple identification proof for a mixture of two univariate normal distributions. J Classif 25:113–123
Meijer E, Rohwedder S, Wansbeek T (2012) Measurement error in earnings data: using a mixture model approach to combine survey and register data. J Bus Econ Stat 30(2):191–201
Meyer BD, Mittag N (2019) Using linked survey and administrative data to better measure income: implications for poverty, program effectiveness, and holes in the safety net. Am Econ J Appl Econ 11(2):176–204
Moore JC, Stinson LL, Welniak EJ Jr (2000) Income measurement error in surveys: a review. J off Stat 16(4):331–361
NACE, Rev. 1.1 (2002) http://ec.europa.eu/environment/emas/pdf/general/nacecodes_en.pdf. Accessed 24 May 2016
Lalla M, Ferrari D, Frederic P (2012) Unit nonresponse errors in income surveys: A case study. Qual Quant 46(6):1769–1794
Lalla M, Cavicchioli M (2020) Nonresponse and measurement errors in income: matching individual survey data with administrative tax data, DEMB Working Papers Series. N. 170, pp. 1-36. University of Modena and Reggio Emilia – Department of Economics
Pedace R, Bates N (2000) Using administrative records to assess earnings reporting error in the survey of income and program participation. J Econ Soc Meas 26(3–4):173–192
Peracchi F (2002) The european community household panel: a review. Empir Econ 27(1):63–90
Petychev A (2012) Multiple imputation for unit nonresponse and measurement error. Public Opin Q 76(2):214–237
Wilhelm D (2019) Testing for the Presence of Measurement Error. CeMMAP Working Paper CWP 48/19. Old version: CWP 45/18.
Acknowledgements
The authors are grateful to Professors Kapteyn and Ypma for sharing useful information regarding codes. Furthermore, the authors owe special thanks to Professor Massimo Baldini, who made surveyed income data available to us, and to MA Giovanni Bigi of the statistics department of Commune of Modena, who contributed to building up the final data set using administrative archives.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Cavicchioli is also associated with RECent (Center for Economic Research) and Lalla is also associated with CAPP (Centre for the Analyses of Public Policies), both in the Department of Economics “Marco Biagi” at the same following address.
Rights and permissions
About this article
Cite this article
Cavicchioli, M., Lalla, M. Evidences from survey data and fiscal data: nonresponse and measurement errors in annual incomes. Stat Methods Appl 31, 587–615 (2022). https://doi.org/10.1007/s10260-021-00593-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10260-021-00593-3