Accessibility in the mobile development industry in Brazil: Awareness, knowledge, adoption, motivations and barriers☆
Introduction
People with disabilities may encounter several challenges in everyday activities, including the access to digital products or services that are badly designed. Considering that an estimated 15% of the world population has some type of disability (Organization and World Bank, 2011), accessibility plays an important role since it intends to promote user autonomy by removing barriers that may prevent people with disabilities to fully perceive, understand and operate digital products and services (W3C, 2018b, W3C, 2018a, ISO, 2011, ISO, 2018).
In the software development context, accessibility is a non-functional requirement and a sub-characteristic of usability according to the product quality model defined by the ISO/IEC 25010:2011 (ISO, 2011). Accessibility is defined as the capacity of a software product or service to be used by a wide range of users with different characteristics and regardless of their physical, mental, motor or cognitive skills (W3C, 2018a, ISO, 2011, ISO, 2018). Although accessibility is mostly intended to address requirements related to users with disabilities, it should be considered a key quality attribute that contributes with the overall usability and quality of any software product or service (Gay et al., 2018).
Many advances have been made over the years to promote accessibility both in the software operation and production contexts, namely assistive technologies (e.g. screen readers, voice navigation and screen magnifiers) that can enhance user capabilities; the conception of accessibility standards and guidelines (e.g. W3C’s Web Content Accessibility Guidelines) to drive the implementation of accessible software systems; tool support for developing and evaluating the accessibility of software products (Silva et al., 2018); and specific legislation devised by many countries to enforce accessibility-related policies to make sure people with disabilities are not excluded (Lazar, 2019).
Web accessibility is perhaps the most notable case of digital accessibility since the WWW (World Wide Web) has been the most popular platform on which public or private companies share information and offer many of their services. However, mobile accessibility has also been on the spotlight recently, specially due to the increasing shift towards mobile platforms and the challenging nature of mobile devices when it comes to user interaction: small screens, large amount of possible hardware and software configurations, complex user interaction (e.g. gestures) and so forth.
Many studies have been conducted to investigate whether mobile applications developed and used in different contexts take accessibility requirements into account to be accessible to people with disabilities. Unfortunately, most studies have found a general lack of accessibility in mobile applications of different categories, sizes, complexities and popularity (Serra et al., 2015a, Eler et al., 2018, Yan and Ramachandran, 2019, Vendome et al., 2019, Alshayban et al., 2020, Acosta-Vargas et al., 2020). One question that arises in this context is “why do designers and developers not implement accessible products given that accessibility is an important quality attribute and many accessibility-related resources are available (e.g. assistive technology, guidelines, legislation and tools)?”.
This same phenomenon has also been noticed with web applications and some studies have been conducted to understand the accessibility awareness of people involved in web development and possible reasons for the general lack of accessibility (Lazar et al., 2004, Freire et al., 2008, Oliveira and Eler, 2017, Inal et al., 2019, Barzilai-Nahon et al., 2008, Putnam et al., 2012). Most studies reported the lack of awareness of people involved in the development process and several reasons why accessibility is not generally adopted in web application development, such as tight deadlines, lack of proper training, lack of proper tools, and so forth. Even though such type of investigation with respect to Web accessibility has been already explored, studies with people involved in mobile application development are still scarce.
Therefore, we set up a study to understand whether accessibility is addressed in mobile development projects. Specifically, we want to characterize the mobile application development industry with respect to the awareness and knowledge on digital accessibility of the people involved in the development process; to which extent accessibility practices and tools are adopted; the motivations that drive the development of accessible products; and the barriers that usually prevent accessibility to be properly addressed. As the mobile development industry worldwide is vast, we focused on a particular group, the Brazilian mobile development industry, to be able to collect data from a representative sample of the population. Brazil is the fifth most populous country and the 9th largest economy in the world. Furthermore, according to a study conducted by the Brazilian Association of Software Companies (ABES, 2018), Brazil is the 9th largest software market worldwide.
This paper presents and discusses the results of our study that was conducted based on the survey research method. For this investigation, we designed a Web-based questionnaire comprising 19 questions to collect data from people involved in mobile application development in Brazil. Participants were selected by a non-probabilistic sampling method and we were able to collect valid answers from 872 participants from all macro-regions of the country. Our results show that few participants have deep knowledge of accessibility standards and guidelines. Thus, accessibility is not fully addressed in most mobile development projects. In addition, participants seem to be motivated more by social conscience and personal reasons than organization and project demands. This is related to the most popular barriers mentioned by participants: lack of accessibility requirements, lack of time, lack of training and the lack of awareness that people with disabilities are numerous and also potential users of any digital product.
In addition, a cross analysis showed that the participants with higher levels of accessibility awareness, knowledge, adoption and evaluation, but still in low levels, usually work for larger organizations, have more experience in the software development process, work for private or public companies, or develop mobile applications for the iOS platform. For organizations of all sizes, the most frequent barrier to accessibility adoption is that it is not a requirement. Particularly, for micro and small companies, high cost and lack of training are the most prevalent barriers. For public organization, private companies and freelancers, the most mentioned barriers were that accessibility is not a requirement, lack of time and training.
This paper is structured as follows. Section 2 presents concepts related to digital accessibility. Section 3 gives an overview of previous studies conducted to characterize the context of mobile and web development with respect to accessibility. Section 4 describes the research method we selected to reach our results and conclusions. Section 5 presents the analysis of the data collected by our survey. Section 6 discusses the results of our study and compares our findings with related work. Section 7 presents the concluding remarks.
Section snippets
Background
Usability can be defined as the “extent to which a system, product or service can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use” (ISO, 2018). The concept of usability is crucial to Human-Centered Design (HCD) methods that are mainly concerned with ways in which interactive systems can enhance human–system interaction by delivering software products and services with good usability (ISO, 2019).
In a World where
Related work
Many studies have been conducted to understand the accessibility perception and awareness of people involved in software development. Table 1 provides an overview of related work, concerning the studies’ methods, sample size (N), characteristics of the participants (e.g. location and role of participants in software development), and the platforms within the study scope. Note that our study is described in the last row, thus allowing a general comparison with the remaining studies.
Most studies
Research method
The goal of our study is to characterize people involved in the development of mobile applications in Brazil with respect to their awareness, knowledge, adoption, motivations and barriers related to mobile accessibility. To reach such a goal, we resorted to a survey method (Robert M. Groves et al., 2009, Molléri et al., 2016, Linåker et al., 2015) to systematically gather information from people involved in mobile application development and thus construct quantitative descriptors concerning
Results
This section describes the results of our investigation. In total, 874 participants answered our questionnaire. However, we removed data provided by two respondents that declared to be under age2 since we have not provided respondents with any parental authorization form. Therefore, our investigation is based on 872 valid responses. Our results are presented in four parts: demographics; accessibility awareness and knowledge; accessibility adoption in
Discussion
This section discusses the results of our investigation following the aspects of interest of our survey: sample characterization, accessibility awareness and knowledge, accessibility adoption, motivations and barriers. We also discuss insightful results we obtained by crossing the response from different dimensions of our questionnaire.
Conclusion
The results of the survey we conducted with 872 participants provides evidence that the mobile application development industry in Brazil needs to improve dramatically when it comes to accessibility awareness, knowledge, adoption and evaluation. Even though a further analysis showed that the results may vary across different dimensions (e.g. organization size and type), results still show that the level of accessibility awareness, knowledge, adoption and evaluation is still low for all groups.
CRediT authorship contribution statement
Manoel Victor Rodrigues Leite: Conceptualization, Methodology, Investigation, Writing Original Draft. Lilian Passos Scatalon: Investigation, Writing - Original Draft. André Pimenta Freire: Methodology, Formal analysis, Writing - Original Draft, Writing - Review & Editing. Marcelo Medeiros Eler: Conceptualization, Methodology, Investigation, Data curation, Writing - Original Draft, Writing - Review & Editing, Supervision, Funding acquisition.
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgments
We thank all participants that answered our questionnaire. We also thank the research agencies for their financial support. Lilian Passos Scatalon is financially supported by the grant 19/15367-3 of the São Paulo Research Foundation (FAPESP), Brazil. Marcelo Medeiros Eler is financially supported by the grant 18/12287-6 of the São Paulo Research Foundation (FAPESP), Brazil .
Manuel V. R. Leite is an Application Developer at IBM Brazil. He has five years of experience as a software developer and is interested in mobile applications, API Rest development and integration between software systems. He holds a M.Sc in Computer Science from the University of Saão Paulo (EACH-USP), Brazil.
References (56)
- et al.
Improving web accessibility: a study of webmaster perceptions
Comput. Hum. Behav.
(2004) - et al.
Accessibility evaluation of E-government mobile applications in Brazil
Procedia Comput. Sci.
(2015) - et al.
Accessibility evaluation of E-government mobile applications in Brazil
Procedia Comput. Sci.
(2015) - et al.
Salient beliefs influencing the intention to consider web accessibility
Comput. Hum. Behav.
(2019) - et al.
Accessibility issues in android apps: State of affairs, sentiments, and ways forward
Brazilian software market: Scenario and trends
(2018)- et al.
Accessibility assessment in mobile applications for android
- et al.
Accessibility issues in android apps: State of affairs, sentiments, and ways forward technical
- Antonelli, H.L., Rodrigues, S.S., Watanabe, W.M., de Mattos Fortes, R.P., 2018. A survey on accessibility awareness of...
- et al.
Factors influencing users’ intentions to make the web accessible to people with disabilities
Mobile accessibility guidelines
Charting the landscape of HCI education in brazil
Accessible smart cities?: Inspecting the accessibility of Brazilian municipalities’ mobile applications
Full mobile accessibility is a matter of respect: Guama update process for motor and hearing disability users
Developing accessible services: Understanding current knowledge and areas for future support
Axe - the standard in accessibility testing
Do android app users care about accessibility? An analysis of user reviews on the google play store
Automated accessibility testing of mobile apps
Practitioner barriers to diffusion and implementation of web accessibility
Technol. Disabil.
A survey on the accessibility awareness of people involved in web development projects in Brazil
How does HCI research affect education programs? A study in the Brazilian context
Digital Accessibility as a Business Practice – Essential Skills for Business Leaders
Get started with accessibility scanner
Espresso
Robolectric
IBM abilitylab mobile accessibility checker
Web accessibility in Turkey: awareness, understanding and practices of user experience professionals
Univers. Access Inf. Soc.
Cited by (12)
Current state of web accessibility in Latin America: an exploratory review of assessments and tools used
2024, Revista Espanola de Documentacion CientificaI feel for you! The effect of empathy exercises on accessibility awareness
2024, Universal Access in the Information SocietyEarly accessibility testing - An automated kit for Android developers
2023, ACM International Conference Proceeding SeriesEvolution may come with a price: Analyzing user reviews to understand the impact of updates on mobile apps accessibility
2023, ACM International Conference Proceeding Series#A11yDev: Understanding Contemporary Software Accessibility Practices from Twitter Conversations
2023, Conference on Human Factors in Computing Systems - ProceedingsAnalyzing Accessibility Reviews Associated with Visual Disabilities or Eye Conditions
2023, Conference on Human Factors in Computing Systems - Proceedings
Manuel V. R. Leite is an Application Developer at IBM Brazil. He has five years of experience as a software developer and is interested in mobile applications, API Rest development and integration between software systems. He holds a M.Sc in Computer Science from the University of Saão Paulo (EACH-USP), Brazil.
Lilian P. Scatalon is a research assistant at the University of São Paulo (EACH-USP), Brazil. Her current research interests are in digital accessibility, experimental software engineering, and programming and software testing education. She holds a Ph.D. in Computer Science from the University of São Paulo (ICMC-USP), Brazil.
Andre P. Freire received a Ph.D. degree in Computer Science from the University of York, England, in 2013. Since 2012 he has been a lecturer and researcher in the Universidade Federal de Lavras, Brazil. His current research interests include the areas of software engineering, inclusive design, information systems and software accessibility.
Marcelo M. Eler is an Associate Professor at the University of São Paulo (EACH-USP), Brazil. His research interest lies in the area of software engineering with focus on the software testing field. He is also interested in investigating how digital accessibility is approached by developers and organizations during the development process. He holds a Ph.D. in Computer Science from the University of São Paulo (ICMC-USP), Brazil.
- ☆
Editor: Kelly Blincoe.