Firas Masri, Sergio Luján-Mora. A Combined Agile Methodology for the Evaluation of Web Accessibility. IADIS International Conference Interfaces and Human Computer Interaction 2011 (IHCI 2011), p. 423-428, Rome (Italy), July 24-26 2011. ISBN: 978-972-8939-52-6.
Download original paper in PDF: A Combined Agile Methodology for the Evaluation of Web Accessibility
To assure and certify the fulfillment of web accessibility guidelines (WCAG 1.0 & 2.0) and to guarantee accessibility to all disabled users, various accessibility evaluation methods have been proposed, basically classified in two types: qualitative methods (analytical and empirical) and quantitative methods (metric-based methods). As no method by itself is enough to guarantee full accessibility, many studies advice to combine these methods between each other in order to guarantee better results. Some recent studies present combined evaluation methods between qualitative methods only, thus leaving behind the great power of metrics that guarantee objective results and task diversity. To achieve this goal, the current paper proposes a systematic combined agile accessibility evaluation method based both on qualitative and quantitative evaluation methods. This proposal presents an evaluation methodology that combines between the essential analytical evaluation methods and the empirical user test methods. Finally, WAB metric (Web Accessibility Barrier) is included to summarize objectively the final results and amplify the use of this method to cover all types of evaluations tasks, like validating, certifying and comparing processes.
Keywords: Web accessibility, Empirical evaluation methodology, User test.
Brajnik, G., 2008. Beyond conformance: the role of accessibility evaluation Methods. In 2nd International Workshop on Web Usability and Accessibility IWWUA08, Auckland, New Zealand.
Brajnik, G., 2006. Web accessibility testing with barriers walkthrough. Visited: Feb 2011. Available at: www.dimi.uniud.it/giorgio/projects/bw.
Bühler, C., Heck, H., Perlick, O., Nietzio, A., and Ulltveit-Moe, N., 2006. Interpreting Results from Large Scale Automatic Evaluation of Web Accessibility. In Computers Helping People with Special Needs, Springer, and Berlin/Heidelberg.
Daskalantonakis M. K., 1992. A Practical View of Software Measurement and Implementation Experiences within Motorola. IEEE Transactions on Software Engineering, 18(11):998 - 1010.
Dey, A., 2004. Accessibility evaluation practices.survey, results. Visited: Feb 2011. Available at: http://deyalexander.com/publications/accessibility-evaluation-practices.html.
Díaz, B., Cachero, C. 2009. Fiabilidad de herramientas automáticas para el aseguramiento de la accesibilidad en Web. In IADIS Ibero-Americana WWW/Internet 2009, Madrid, Spain.
Disability Rights Commission (DRC). 2004. Formal investigation report: web accessibility. ISBN 0 11 703287 5.
Fenton N. E., Pfleeger S.L. Software Metrics: A Rigorous and Practical Approach. PWS Publishing Co., Boston, MA, USA, 1998.
Freire, A. P., Fortes, R., Turine, M., Paiva, D., 2008. An Evaluation of Web Accessibility Metrics based on their Attributes. SIGDOC.08, September 22-24, 2008, Lisbon, Portugal.
López, L. AWA: Marco metodológico especifico en el dominio de la accesibilidad web para el desarrollo de aplicaciones web. Tesis Doctoral, Universidad Carlos III, Leganés, Madrid. 2010.
Masri, F., Lujan, S., 2010a. Análisis de los métodos de Evaluación de la Accesibilidad web. Proceedings of the: Universidad 2010 conference. Havana, Cuba.
Masri, F., Lujan, S., 2010b. Test de usuario: Un Método Empírico Imprescindible para la Evaluación de la Accesibilidad Web. Proceedings of the: 5ª conferencia ibérica de sistemas y tecnologías de información 2010. Santiago de Compostela, España.
Nielsen, J., 2000. Why You Only Need to Test with 5 Users. Visited March 2011, available at: http://www.useit.com/alertbox/20000319.html.
Parmanto, B., & Zeng, X. M. 2005. Metric for web accessibility evaluation. Journal of the American Society for Information Science and Technology, 56(13), 1394-1404.
Pernice, K., Nielsen, J., 2001. Beyond Alt Text: Making the web easy to use for users with disabilities. Visited: Feb 2011, Available at: http://www.nngroup.com/reports/accessibility/testing/.
Petrie, H., Kheir, O., 2007: The relationship between accessibility and usability of websites. In: Proc. CHI 2007, pp. 397.406. ACM, CA
Requisiti tecnici e i diversi livelli per l.accessibilit`a agli strumenti informatici, 2005. (G.U.n.1838/8/2005), Visited Feb 2011, www.pubbliaccesso.it/normative/DM080705.htm.
Romen, D., Svanaes, D., 2008. Evaluating Web Site Accessibility: Validating the WAI Guidelines through Usability Testing with Disabled Users, proceedings: NordiCHI 2008, Octuber 20 to 22, 2008.
SEC.508, 2007. ELECTRONIC AND INFORMATION TECHNOLOGY, Visited Feb 2011, Available at: www.section508.gov/index.cfm?FuseAction=Content&ID=14.
Sirithumgul, P., Suchato, A., Punyabukkana, P. 2009. Quantitative Evaluation for Web Accessibility with Respect to Disabled Groups.
(SSWAE), 2011. Spanish Senate web accessibility evaluation. Available at: http://accesibilidadweb.dlsi.ua.es/?menu=ej-analisis-senado-parte-1 y http://accesibilidadweb.dlsi.ua.es/?menu=ej-analisis-senado-parte-2.
Thatcher, J., Burks, M., Heilmann, C., Henry, S., Kirkpatrick, A., Lauke, P., Lawson, B., Regan, B., Rutter, R., Urban, M., Waddell, C., 2006: Web Accessibility: Web Standards and Regulatory Compliance; Friends of ED.
UE Commission., 2002. Visited: Feb 2011. Available at: http://ec.europa.eu/ipg/standards/accessibility/index_en.htm.
Vigo, M., Arrue, M., Brajnik, G., Lomuscio, R., and Abascal, J. 2007. Quantitative metrics for measuring web accessibility. In W4A .07: Proceedings of the 2007 international cross-disciplinary conference on web accessibility (W4A). Banff, Canada.
Villegas, E., Pifarré, M., Fonseca, D., 2010. Diseño metodológico de experiencia de usuario aplicado al campo de la accesibilidad. Actas de la5ª conferencia ibérica de sistemas y tecnologías de información 2010. Santiago de Compostela, España.