I+D+i

9 Revisión sistemática

Según el artículo Las revisiones sistemáticas (I) (y II), una revisión sistemática es:

Las revisiones sistemáticas son el mejor esfuerzo por recopilar y sintetizar evidencia científica sobre un tema, a través de un método que asegure que los sesgos y limitaciones a los que hemos hecho mención en el artículo precedente de esta serie, sean los mínimos posibles. Esto se logra utilizando los principios del método científico.

Las etapas de una revisión sistemática son:

  1. formulación de la pregunta de la revisión,
  2. definición de las fuentes y del método de búsqueda,
  3. definición y aplicación de criterios de selección de los estudios,
  4. análisis crítico de los estudios,
  5. extracción y síntesis de los resultados de los estudios,
  6. y conclusiones e inferencias.

Una revisión sistemática se puede realizar a partir de un mapeo sistemático. Las diferencias que existen entre ambos tipos de estudios han sido analizadas en The value of mapping studies: a participant-observer case study (2010); en este artículo se presenta la siguiente tabla de diferencias entre un mapeo sistemático y una revisión sistemática:

SLR process Mapping Study SLR
Research Question General – related to research trends. Which researchers, how much activity, what type of studies etc. Specific - related to outcomes of empirical studies. Of the form: Is technology/method A better or not than B?
Search process Defined by topic area Defined by research question
Search strategy requirements Less stringent if only research trends are of interest Extremely stringent – all relevant studies must be found
Quality evaluation Not essential Important to ensure that results are based on best quality evidence
Results Set of papers related to a topic area and counts of the number of papers in various categories Answer to specific research question, possible with qualifiers (e.g. results apply to novices only).

En el artículo Systematic mapping studies in software engineering (2008), se explican algunas de las ventajas de un systematic review frente a un literature review:

Briefly, a systematic review (SR) goes through existing primary reports, reviews them in-depth and describes their methodology and results. Compared to literature reviews common in any research project, a SR has several benefits: a well-defined methodology reduces bias, a wider range of situations and contexts can allow more general conclusions, and use of statistical meta-analysis can detect more than individual studies in isolation (Kitchenham & Charters 2007).

La mayor desventaja es que un systematic review requiere un mayor esfuerzo:

However, SRs also have several drawbacks, the main one being that they require considerable effort.

Revisión sistemática del estado de la cuestión (systematic literature review)

How to... write a literature review

How to conduct a systematic or evidence-based literature review

Una revisión sistemática del estado de la cuestión es una revisión de la bibliografía referente a un tema realizada mediante un método que es explícito y transparente, que cumple un protocolo o un conjunto de fases.

Procedures for Performing Systematic Reviews

Cita: Barbara Kitchenham. Keele University and National ICT Australia Ltd, 2004.

Systematic review in software engineering

Cita: J. Biolchini,P.G. Mian, A.C.C. Natali, G.H. Travassos. System Engineering and Computer Science Department COPPE/UFRJ, Technical Report ES, 679(05), 45, May 2005.

Guidelines for performing Systematic Literature Reviews in Software Engineering

Cita: Barbara Kitchenham, Stuart Charters. Keele University and Durham University Joint Report, 2007.

Experiences Using Systematic Review Guidelines

Cita: Mark Staplesa, Mahmood Niazi. Journal of Systems and Software. Volume 80, Issue 9, September 2007, Pages 1425-1437.

Systematic literature reviews in software engineering: Preliminary results from interviews with researchers

Cita: M.A. Babar, He Zhang. 3rd International Symposium on Empirical Software Engineering and Measurement, Pages 346-355, 15-16 Oct. 2009.

Systematic review in software engineering: where we are and where we should be going

Cita: Barbara A. Kitchenham. In Proceedings of the 2nd international workshop on Evidential assessment of software technologies (EAST '12). ACM, New York, NY, USA, 1-2.

Ejemplos de revisión sistemática

Reconfigurable computing: a survey of systems and software

Cita: Katherine Compton and Scott Hauck. ACM Computing Surverys. Volume 34, Issue 2, June 2002, Pages 171-210.

Empirical studies of agile software development: A systematic review

Cita: Tore Dybå, Torgeir Dingsøyr. Information and Software Technology. Volume 50, Issues 9-10, August 2008, Pages 833-859.

A Systematic Review of Usability Evaluation in Web Development

Cita: Emilio Insfran, Adrian Fernandez. Web Information Systems Engineering – WISE 2008 Workshops, LNCS 5176, 2008, Pages 81-91.

Systematic literature reviews in software engineering - A systematic literature review

Cita: Barbara Kitchenham, O. Pearl Brereton, David Budgen, Mark Turner, John Bailey, Stephen Linkman. Information and Software Technology. Volume 51, Issue 1, January 2009, Pages 7-15.

Este artículo es especial, porque es una revisión sistemática de revisiones sistemáticas. Se podría decir que es una "metarevisión sistemática". También se puede decir que es "tertiary research", frente a primary research y secondary research.

Software engineering researchers' attitudes on case studies and experiments: An exploratory survey

Cita: D. Tofan, M. Galster, P. Avgeriou, D. Weyns. 15th Annual Conference on Evaluation & Assessment in Software Engineering (EASE 2011), pp. 91-95, 11-12 April 2011.

A systematic review on the effectiveness of web usability evaluation methods

Cita: Adrian Fernandes, Silvia Abrahão, Emilio Insfran. 16th International Conference on Evaluation & Assessment in Software Engineering (EASE 2012), 2012.

A systematic review on security in Process-Aware Information Systems - Constitution, challenges, and future directions

Cita: Maria Leitner, Stefanie Rinderle-Ma. Information and Software Technology. Volume 56, Issue 3, March 2014, Pages 273-293.

A Systematic Analysis and Synthesis of the Empirical MOOC Literature Published in 2013–2015

Cita: George Veletsianos and Peter Shepherdson. International Review of Research in Open and Distributed Learning, Volume 17, Issue 2, February 2016.

Research challenges in accessible MOOCs: a systematic literature review 2008–2016

Cita: Sanchez-Gordon, S. & Luján-Mora, S. Universal Access in the Information Society (2017). DOI: 10.1007/s10209-017-0531-2

Ver en línea: Research challenges in accessible MOOCs: a systematic literature review 2008–2016

Ejemplos de revisión

Educational Data Mining: A Review of the State of the Art

Cita: Cristóbal Romero, Sebastián Ventura. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). Volume 40, Issue 6, November 2010, Pages 601-618.

Este artículo tiene 304 citas que ocupan casi 8 páginas de las 18 páginas que tiene.