Sergio Luján-Mora, Firas Masri. Evaluation of Web Accessibility: A Combined Method. In Pedro Isaias, Miguel Baptista Nunes (Eds.), Information Systems Research and Exploring Social Artifacts: Approaches and Methodologies, Hersey, PA: IGI Global, p. 314-331, 2012. ISBN: 978-1-4666-2491-7.
View book website: Information Systems Research and Exploring Social Artifacts: Approaches and Methodologies
The Web is present in all fields of our life, from information and service Web pages to electronic public administration (e-government). Users of the Web are a heterogeneous and multicultural public, with different abilities and disabilities (visual, hearing, cognitive, and motor impairments). Web accessibility is about making websites accessible to all Internet users (both disabled and non-disabled). To assure and certify the fulfillment of Web accessibility guidelines, various accessibility evaluation methods have been proposed, and are classified in two types: qualitative methods (analytical and empirical) and quantitative methods (metric-based methods). As no method by itself is enough to guarantee full accessibility, many studies combine these qualitative and quantitative methods in order to guarantee better results. Some recent studies have presented combined evaluation methods between qualitative methods only, thus leaving behind the great power of metrics that guarantee objective results. In this chapter, a combined accessibility evaluation method based both on qualitative and quantitative evaluation methods is proposed. This proposal presents an evaluation method combining essential analytical evaluation methods and empirical test methods.
ATutor (2011). AChecker: Web Accessibility Checker. Retrieved February 15, 2011, from http://achecker.ca/checker/index.php
Bailey, J., & Burd, E. (2005). Tree-Map Visualisation for Web Accessibility. Computer Software and Applications Conference (pp. 275-280), IEEE Press.
Brajnik, G. (2006). Web accessibility testing with barriers walkthrough. Retrieved February 10, 2011, from http://www.dimi.uniud.it/giorgio/projects/bw
Brajnik, G., & Lomuscio, R. (2007). SAMBA: a Semi"Automatic Method for Measuring Barriers of Accessibility. ACM SIGACCESS Conference on Computers and Accessibility (pp. 43-49), ACM Press.
Brajnik, G. (2008a). Beyond Conformance: The Role of Accessibility Evaluation Methods. In S. Hartmann et al. (Eds.), 2nd International Workshop on Web Usability and Accessibility (pp. 63-80), Auckland, New Zealand, Lecture Notes in Computer Science 5176.
Brajnik, G. (2008b). Measuring Web Accessibility by Estimating Severity of Barriers. In S. Hartmann, X. Zhou, M. Kirchberg (Eds.), 2nd International Workshop on Web Usability and Accessibility (pp. 112-121), Auckland, New Zealand, Lecture Notes in Computer Science 5176.
Bühler, C., Heck, H., Perlick, O., Nietzio, A., & Ulltveit-Moe, N. (2006). Interpreting Results from Large Scale Automatic Evaluation of Web Accessibility. In K. Miesenberger, J. Klaus, W. Zagler, A. Karshmer (Eds.), Computers Helping People with Special Needs (pp. 184-191). Berlin/Heidelberg, Germany: Springer.
Daskalantonakis, M. K. (1992). A Practical View of Software Measurement and Implementation Experiences within Motorola. IEEE Transactions on Software Engineering, 18(11), 998 - 1010.
Dey, A. (2004). Accessibility evaluation practices.survey, results. Retrieved February 15, 2011, from http://deyalexander.com/publications/accessibility-evaluation-practices.html
Díaz, B., & Cachero, C. (2009). Fiabilidad de herramientas automáticas para el aseguramiento de la accesibilidad en Web. In IADIS Ibero-Americana WWW/Internet 2009, Madrid, Spain.
Disability Rights Commission (2006). Guide to good practice in commissioning accessible websites. London, United Kingdom: British Standards Institution.
European Union (2002). European Parliament resolution on the Commission communication eEurope 2002: Accessibility of Public Web Sites and their Content (COM(2001) 529 - C5-0074/2002 - 2002/2032(COS)). Retrieved February 5, 2011, from http://www.europarl.europa.eu/omk/omnsapir.so/pv2?PRG=DOCPV&APP=PV2&LANGUE=EN&SDOCTA=18&TXTLST=1&POS=1&Type_Doc=RESOL&TPV=DEF&DATE=130602&PrgPrev=PRG@TITRE%7cAPP@PV2%7cTYPEF@TITRE%7cYEAR@02%7cFind@%2577%2565%2562%2520%7cFILE@BIBLIO02%7cPLAGE@1&TYPEF=TITRE&NUMB=1&DATEF=020613
European Union (2010). Digital Agenda 2010. Retrieved February 14, 2011, from http://ec.europa.eu/information_society/digital-agenda/index_en.htm
eXaminator (2005). eXaminator: Evaluación automática de la accesibilidad. Retrieved February 12, 2011, from http://examinator.ws/
Fenton, N. E., & Pfleeger, S. L. (1998). Software Metrics: A Rigorous and Practical Approach. Boston, USA: PWS Publishing Co.
Freire, A. P., Fortes, R., Turine, M., & Paiva, D. (2008). An Evaluation of Web Accessibility Metrics based on their Attributes. In Proceedings of the 26th annual ACM International Conference on Design of Communication (pp. 73-80), Lisbon, Portugal.
Fundación CTIC (2011). TAW. Retrieved February 10, 2011, from http://www.tawdis.net/
HiSoftware (2003). Cynthia Says. Retrieved February 15, 2011, from http://www.cynthiasays.com/
Internet Archive (2001). The Wayback Machine. Retrieved February 5, 2011, from http://www.archive.org/web/web.php
Jefatura del Estado de España (2002). LEY 34/2002, de 11 de julio, de servicios de la sociedad de la información y de comercio electrónico (BOE nº 166). Retrieved February 5, 2011, from http://www.boe.es/boe/dias/2002/07/12/pdfs/A25388-25403.pdf
King, A. (2011). WebbIE. Retrieved February 5, 2011, from http://www.webbie.org.uk/
Knowbility (2011). Accessibility Internet Rally (AIR). Retrieved January 16, 2012, from http://www.knowbility.org/v/air/
López, L. (2010). AWA: Marco metodológico especifico en el dominio de la accesibilidad web para el desarrollo de aplicaciones web. Unpublished doctoral dissertation, Universidad Carlos III, Madrid, Spain.
Luján-Mora, S. (2011). Análisis de la accesibilidad del sitio web del Senado de España. Retrieved February 12, 2011, from http://accesibilidadweb.dlsi.ua.es/?menu=ej-analisis-senado-parte-1
Mankoff, J., Fait, H., & Tran, T. (2005). Is Your Web Page Accessible? A Comparative Study of Methods for Assessing Web Page Accessibility for the Blind. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 41-50), Portland, USA.
Masri, F., & Luján-Mora, S. (2010a). Análisis de los métodos de evaluación de la accesibilidad web. In Universidad 2010, Havana, Cuba.
Masri, F., & Luján-Mora, S. (2010b). Test de usuario: Un método empírico imprescindible para la evaluación de la accesibilidad web. In Actas de la 5ª Conferencia Ibérica de Sistemas y Tecnologías de Información, Santiago de Compostela, Spain.
Ministro per l'Innovazione e le Tecnologie de la Repubblica Italiana (2005). Requisiti tecnici e i diversi livelli per l.accessibilit`a agli strumenti informatici, (G.U.n.1838/8/2005). Retrieved February 10, 2011, from http://www.pubbliaccesso.it/normative/DM080705.htm
Ministry of Justice, English Government (1995). Disability Discrimination Act. Retrieved February 20, 2011, from http://www.legislation.gov.uk/ukpga/1995/50/contents
Nielsen, J. (2000). Why You Only Need to Test with 5 Users. Retrieved March 14, 2011, from http://www.useit.com/alertbox/20000319.html
Parmanto, B., & Zeng, X. M. (2005). Metric for web accessibility evaluation. Journal of the American Society for Information Science and Technology, 56(13), 1394-1404.
Pederick, C. (2003). Web Developer for Firefox toolbar. Retrieved February 12, 2011, from http://chrispederick.com/work/web-developer/
Pernice, K., & Nielsen, J. (2001). Beyond Alt Text: Making the web easy to use for users with disabilities. Retrieved Feb 5, 2011, from http://www.nngroup.com/reports/accessibility/testing/
Petrie, H., & Kheir, O. (2007). The relationship between accessibility and usability of websites. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 397.406), San Jose, USA.
Romen, D., & Svanaes, D., 2008. Evaluating Web Site Accessibility: Validating the WAI Guidelines through Usability Testing with Disabled Users. In Proceedings of the 5th Nordic Conference on Human-computer Interaction: Building Bridges (pp. 535-538), Lund, Sweden.
Sirithumgul, P., Suchato, A., & Punyabukkana, P. (2009). Quantitative Evaluation for Web Accessibility with Respect to Disabled Groups. In Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (pp. 136-141), Madrid, Spain.
Slatin, J., & Rush, S. (2003). Maximum Accessibility: Making Your Web Site More Usable for Everyone. Boston, USA: Addison-Wesley.
Thatcher, J., Burks, M., Heilmann, C., Henry, S., Kirkpatrick, A., Lauke, P., Lawson, B., Regan, B., Rutter, R., Urban, M., & Waddell, C. (2006). Web Accessibility: Web Standards and Regulatory Compliance. Berkeley, USA: Apress.
Universidad del País Vasco (2011). EvalAccess 2.0: Web Service tool for evaluating web accessibility. Retrieved February 10, 2011, from http://sipt07.si.ehu.es/evalaccess2/index.html
University of Toronto (2011). A-Prompt: Web Accessibility Verifier. Retrieved February 10, 2011, from http://aprompt.snow.utoronto.ca/download.html
U.S. Government (1998). Section 508 Standards Guide. 1194.22 Web-based intranet and internet information and applications. Retrieved February 10, 2011, from http://www.section508.gov/index.cfm?fuseAction=stdsdoc#Web
Velleman, E., Meerbeld, C., Strobbe, C., Koch, J., Velasco, C.A., Snaprud, M., & Nietzio, A. (2007). D-WAB4, Unified Web Evaluation Methodology (UWEM 1.2 Core). Retrieved January 14, 2012, from http://www.wabcluster.org/uwem1_2/
Vigo, M., Arrue, M., Brajnik, G., Lomuscio, R., & Abascal, J. (2007). Quantitative metrics for measuring web accessibility. In Proceedings of the 2007 International Cross-disciplinary Conference on Web Accessibility (pp. 99-107), Banff, Canada.
Vigo, M., & Brajnik, G. (2011). Automatic web accessibility metrics: where we are and where we can go. Interacting with Computers, 23(2), 137155.
Villegas, E., Pifarré, M., & Fonseca, D. (2010). Diseño metodológico de experiencia de usuario aplicado al campo de la accesibilidad. In Actas de la 5ª Conferencia Ibérica de Sistemas y Tecnologías de Información. Santiago de Compostela, Spain.
W3C (World Wide Web Consortium) (1994). Evaluation, repair, and transformation tools for web content accessibility. Retrieved February 10, 2011, from http://www.w3.org/WAI/ER/existingtools.html
W3C (World Wide Web Consortium) (1995a). The W3C Markup Validation Service. Retrieved February 15, 2011, from http://validator.w3.org/
W3C (World Wide Web Consortium) (1995b). The W3C CSS Validation Service. Retrieved February 15, 2011, from http://jigsaw.w3.org/css-validator/
W3C (World Wide Web Consortium) (1999a). Web Content Accessibility Guidelines 1.0. Retrieved February 10, 2011, from http://www.w3.org/TR/WCAG10/
W3C (World Wide Web Consortium) (1999b). Checklist of Checkpoints for Web Content Accessibility Guidelines 1.0. Retrieved February 10, 2011, from http://www.w3.org/TR/WCAG10/full-checklist.html
W3C (World Wide Web Consortium) (2002). Template for Accessibility Evaluation Reports. Retrieved February 10, 2011, from http://www.w3.org/WAI/eval/template.html
W3C (World Wide Web Consortium) (2006). Web Accessibility Evaluation Tools: Overview. Retrieved February 20, 2011, from http://www.w3.org/WAI/ER/tools/
W3C (World Wide Web Consortium) (2008). Web Content Accessibility Guidelines 2.0. Retrieved February 10, 2011, from http://www.w3.org/TR/WCAG20/
W3C (World Wide Web Consortium) (2011). Web Accessibility Initiative (WAI). Retrieved February 15, 2011, from http://www.w3.org/WAI/
Web Accessibility Benchmarking Cluster (2007). Unified Web Evaluation Methodology 1.2. Retrieved February 5, 2011, from http://www.wabcluster.org/uwem1_2/
Web Accessibility in Mind (2011a). WebAIM: World Laws. Retrieved January 14, 2012, from http://www.webaim.org/articles/laws/world/
Web Accessibility in Mind (2011b). Web Accessibility Evaluation Tool (WAVE) 4.0. Retrieved January 14, 2012, from http://wave.webaim.org/