Living systematic review: Tools to ensure its quality
##plugins.themes.bootstrap3.article.sidebar##
##plugins.themes.bootstrap3.article.main##
https://orcid.org/0000-0003-1714-8979
Eduardo Amadeu Dutra Moresi
https://orcid.org/0000-0001-6058-3883
António Pedro Costa
https://orcid.org/0000-0002-4644-5879
Abstract
Living Systematic Review (LAR) is an emerging type of continually updated review. Associated with the LSR, different tools are explored to define the systematic review protocol, assess the quality of the evidence, and reduce the bias of this type of analysis. The main objective was to analyse through an LSR (1st version) the studies carried out in recent years using the LSR approach. Initially, a bibliometric analysis was carried out. Later, with the metadata collected in the Scopus database (211), the titles, abstracts, and keywords of 55 articles were analysed using the content analysis technique. Specifically, it was intended to answer the following question: What tools are used in Living Systematic Review? In this way, articles that fit the pre-defined inclusion criteria presupposed used Amstar, JBI Appraisal Tools, Cochrane Risk of Bias, Grade, Probast, Quadas or Tailored Prisma 2020. COVID-19 pandemic was the dominant topic. The most used tool was the Grade, thus evidencing the need to evaluate its use throughout the different phases of the LSR. It was maintained that the LSR is a very suitable type of review for studies that need periodic updates. The resources to the listed tools validate the quality of scientific production with an impact on its application. As a limitation, and at the same time as a clue for future studies, is the fact that these results are dated and that they need to be updated periodically. It can be further detailed on when to use (or not) the listed tools and when to (or not) update an LSR.
Downloads
##plugins.themes.bootstrap3.article.details##
How to Cite
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
openAccess
openAccess
Akl, E. A., Meerpohl, J. J., Elliott, J., Kahale, L. A., Schünemann, H. J., Agoritsas, T., Hilton, J., Perron, C., Hodder, R., Pestridge, C., Albrecht, L., Horsley, T., Platt, J., Armstrong, R., Nguyen, P. H., Plovnick, R., Arno, A., Ivers, N., Quinn, G., Au, A., Johnston, R., Rada, G., Bagg, M., Jones, A., Ravaud, P., Boden, C., Richter, B., Boisvert, I., Keshavarz, H., Ryan, R., Brandt, L., Kolakowsky-Hayner, S. A., Salama, D., Brazinova, A., Nagraj, S. K., Salanti, G., Buchbinder, R., Lasserson, T., Santaguida, L., Champion, C., Lawrence, R., Santesso, N., Chandler, J., Les, Z., Charidimou, A., Leucht, S., Shemilt, I., Chou, R., Low, N., Sherifali, D., Churchill, R., Maas, A., Siemieniuk, R., Cnossen, M. C., MacLehose, H., Simmonds, M., Cossi, M. J., Macleod, M., Skoetz, N., Counotte, M., Marshall, I., Soares-Weiser, K., Craigie, S., Marshall, R., Srikanth, V., Dahm, P., Martin, N., Sullivan, K., Danilkewich, A., García, L. M., Synnot, A., Danko, K., Mavergames, C., Taylor, M., Donoghue, E., Maxwell, L. J., Thayer, K., Dressler, C., McAuley, J., Thomas, J., Egan, C., McDonald, S., Tritton, R., McKenzie, J., Tsafnat, G., Elliott, S. A., Tugwell, P., Etxeandia, I., Merner, B., Turgeon, A., Featherstone, R., Mondello, S., Turner, T., Foxlee, R., Morley, R., van Valkenhoef, G., Garner, P., Munafo, M., Vandvik, P., Gerrity, M., Munn, Z., Wallace, B., Glasziou, P., Murano, M., Wallace, S. A., Green, S., Newman, K., Watts, C., Grimshaw, J., Nieuwlaat, R., Weeks, L., Gurusamy, K., Nikolakopoulou, A., Weigl, A., Haddaway, N., Noel-Storr, A., Wells, G., Hartling, L., O'Connor, A., Wiercioch, W., Hayden, J., Page, M., Wolfenden, L., Helfand, M., Pahwa, M., Yepes Nuñez, J. J., Higgins, J., Pardo, J. P., Yost, J., Hill, S., Pearson, L. e Living Systematic Review, N. (2017). Living systematic reviews: 4. Living guideline recommendations. Journal of Clinical Epidemiology, 91, 47-53.
Amado, J., Costa, A. P. e Crusoé, N. (2017). A Técnica de Análise de Conteúdo. In J. Amado (Ed.), Manual de Investigação Qualitativa em Educação (3ª edição). Coimbra: Imprensa da Universidade de Coimbra.
Bastian, M., Heymann, S. e Jacomy, M. (2009). Gephi: an open source software for exploring and manipulating networks. Proceedings of the Third International ICWSM Conference.
Callon, M., Courtial, J.-P., Turner, W. A. e Bauin, S. (1983). From translations to problematic networks: An introduction to co-word analysis. Social Science Information, 22(2), 191-235.
Carneiro, A. V. e Henriques, S. O. (2022). ISBE & Cochrane Portugal Newsletter nº 166: Quadro clínico de doentes COVID-19 internados com infecção pela variante Ómicron. ISBE & Cochrane Portugal Newsletter(166).
Chong, L. Y., Piromchai, P., Sharp, S., Snidvongs, K., Philpott, C., Hopkins, C. e Burton, M. J. (2019). Biologics for chronic rhinosinusitis. Cochrane Database of Systematic Reviews, 2019(12).
Chong, L. Y., Piromchai, P., Sharp, S., Snidvongs, K., Philpott, C., Hopkins, C. e Burton, M. J. (2020). Biologics for chronic rhinosinusitis. Cochrane Database of Systematic Reviews, 2020(2).
Chong, L. Y., Piromchai, P., Sharp, S., Snidvongs, K., Webster, K. E., Philpott, C., Hopkins, C. e Burton, M. J. (2021). Biologics for chronic rhinosinusitis. Cochrane Database of Systematic Reviews, 2021(3).
Costa, A. P. e Amado, J. (2018). Análise de Conteúdo Suportada por Software: Ludomedia.
Elliott, J. H., Synnot, A., Turner, T., Simmonds, M., Akl, E. A., McDonald, S., Salanti, G., Meerpohl, J., MacLehose, H., Hilton, J., Tovey, D., Shemilt, I., Thomas, J., Agoritsas, T., Perron, C., Hodder, R., Pestridge, C., Albrecht, L., Horsley, T., Platt, J., Armstrong, R., Nguyen, P. H., Plovnick, R., Arno, A., Ivers, N., Quinn, G., Au, A., Johnston, R., Rada, G., Bagg, M., Jones, A., Ravaud, P., Boden, C., Kahale, L., Richter, B., Boisvert, I., Keshavarz, H., Ryan, R., Brandt, L., Kolakowsky-Hayner, S. A., Salama, D., Brazinova, A., Nagraj, S. K., Buchbinder, R., Lasserson, T., Santaguida, L., Champion, C., Lawrence, R., Santesso, N., Chandler, J., Les, Z., Schünemann, H. J., Charidimou, A., Leucht, S., Chou, R., Low, N., Sherifali, D., Churchill, R., Maas, A., Siemieniuk, R., Cnossen, M. C., Cossi, M. J., Macleod, M., Skoetz, N., Counotte, M., Marshall, I., Soares-Weiser, K., Craigie, S., Marshall, R., Srikanth, V., Dahm, P., Martin, N., Sullivan, K., Danilkewich, A., García, L. M., Danko, K., Mavergames, C., Taylor, M., Donoghue, E., Maxwell, L. J., Thayer, K., Dressler, C., McAuley, J., Egan, C., Tritton, R., McKenzie, J., Tsafnat, G., Elliott, S. A., Tugwell, P., Etxeandia, I., Merner, B., Turgeon, A., Featherstone, R., Mondello, S., Foxlee, R., Morley, R., van Valkenhoef, G., Garner, P., Munafo, M., Vandvik, P., Gerrity, M., Munn, Z., Wallace, B., Glasziou, P., Murano, M., Wallace, S. A., Green, S., Newman, K., Watts, C., Grimshaw, J., Nieuwlaat, R., Weeks, L., Gurusamy, K., Nikolakopoulou, A., Weigl, A., Haddaway, N., Noel-Storr, A., Wells, G., Hartling, L., O'Connor, A., Wiercioch, W., Hayden, J., Page, M., Wolfenden, L., Helfand, M., Pahwa, M., Yepes Nuñez, J. J., Higgins, J., Pardo, J. P., Yost, J., Hill, S., Pearson, L. e Living Systematic Review, N. (2017). Living systematic review: 1. Introduction—the why, what, when, and how. Journal of Clinical Epidemiology, 91, 23-30.
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P., Mavergames, C. e Gruen, R. L. (2014a). Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap. PLoS medicine, 11(2), e1001603.
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C. e Gruen, R. L. (2014b). Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap. PLOS Medicine, 11(2), e1001603.
Ferreira, Ó., Baixinho, C., Medeiros, M. e Oliveira, E. (2021). Learning to Use Evidence in the Nursing Degree Course: Results of a Focus Group. New Trends in Qualitative Research, 8, 35-43.
Garcia-Holgado, A., Marcos-Pablos, S. e Garcia-Penalvo, F. J. (2020). Guidelines for performing Systematic Research Projects Reviews. International Journal of Interactive Multimedia and Artificial Intelligence, 6, 136+.
Garcia-Penalvo, F. J. (2022). Developing robust state-of-the-art reports: Systematic Literature Reviews. . Education in the Knowledge Society, 23.
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P. e Schünemann, H. J. (2008). GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ, 336(7650), 924-926.
Iannizzi, C., Dorando, E., Burns, J., Weibel, S., Dooley, C., Wakeford, H., Estcourt, L. J., Skoetz, N. e Piechotta, V. (2022). Methodological challenges for living systematic reviews conducted during the COVID-19 pandemic: A concept paper. Journal of Clinical Epidemiology, 141, 82-89.
Joana, B. I. (2020). Checklist for Systematic Reviews and Research Syntheses. In he (p. 6). Joanna Briggs Institute. https://joannabriggs.org/sites/default/files/2019- Joanna Briggs Institute (pp. 6).
Kahale, L., Elkhoury, R., El Mikati, I., Pardo-Hernandez, H., Khamis, A., Schünemann, H., Haddaway, N. e Akl, E. (2022). Tailored PRISMA 2020 flow diagrams for living systematic reviews: a methodological survey and a proposal [version 3; peer review: 2 approved]. F1000Research, 10(192).
Khamis, A. M., Kahale, L. A., Pardo-Hernandez, H., Schünemann, H. J. e Akl, E. A. (2019). Methods of conduct and reporting of living systematic reviews: A protocol for a living methodological survey F1000Research, 8.
Millard, T., Synnot, A., Elliott, J., Green, S., McDonald, S. e Turner, T. (2019). Feasibility and acceptability of living systematic reviews: Results from a mixed-methods evaluation. Systematic Reviews, 8(1).
Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J. e Mallett, S. (2019). PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies: Explanation and Elaboration. Annals of Internal Medicine, 170(1), W1-W33.
Pedrosa, J., Leite, C., Rosa, M. J. e Pinho, I. (2021). Avaliação das Aprendizagens em Portugal: Um olhar transversal sobre os fundamentos teóricos, as políticas educativas e as práticas. In UA (Ed.), (Re)pensar a qualidade das organizações educativas: olhares sobre a educação básica, secundária e superior: IX Simpósio de Organização e Gestão Escolar (pp. 271-288). Aveiro, Portugal: UA Editora.
Pinho, I. e Leite, D. (2014). Doing a literature review using content analysis - Research Networks Review. Poster CIAIQ 2014- Congresso Ibero-Americano em Investigação Qualitativa, Badajoz, Espanha, 4 - 16 de Julho.
Roffo, G. e Melzi, S. (2017). Ranking to learn: Feature ranking and selection via eigenvector centrality. New Frontiers in Mining Complex Patterns. Fifth International workshop, nfMCP2016.
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E. e Henry, D. A. (2017). AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ, 358, j4008.
Simmonds, M., Salanti, G., McKenzie, J., Elliott, J. e On behalf of the Living Systematic Review, N. (2017). Living systematic reviews: 3. Statistical methods for updating meta-analyses. Journal of Clinical Epidemiology, 91, 38-46.
Small, H. (1997). Update on science mapping: Creating large document spaces. Scientometrics, 38(2), 275-293.
Thomas, J., Noel-Storr, A., Marshall, I., Wallace, B., McDonald, S., Mavergames, C., Glasziou, P., Shemilt, I., Synnot, A., Turner, T., Elliott, J., Agoritsas, T., Hilton, J., Perron, C., Akl, E., Hodder, R., Pestridge, C., Albrecht, L., Horsley, T., Platt, J., Armstrong, R., Nguyen, P. H., Plovnick, R., Arno, A., Ivers, N., Quinn, G., Au, A., Johnston, R., Rada, G., Bagg, M., Jones, A., Ravaud, P., Boden, C., Kahale, L., Richter, B., Boisvert, I., Keshavarz, H., Ryan, R., Brandt, L., Kolakowsky-Hayner, S. A., Salama, D., Brazinova, A., Nagraj, S. K., Salanti, G., Buchbinder, R., Lasserson, T., Santaguida, L., Champion, C., Lawrence, R., Santesso, N., Chandler, J., Les, Z., Schünemann, H. J., Charidimou, A., Leucht, S., Shemilt, I., Chou, R., Low, N., Sherifali, D., Churchill, R., Maas, A., Siemieniuk, R., Cnossen, M. C., MacLehose, H., Simmonds, M., Cossi, M. J., Macleod, M., Skoetz, N., Counotte, M., Soares-Weiser, K., Craigie, S., Marshall, R., Srikanth, V., Dahm, P., Martin, N., Sullivan, K., Danilkewich, A., García, L. M., Danko, K., Taylor, M., Donoghue, E., Maxwell, L. J., Thayer, K., Dressler, C., McAuley, J., Egan, C., Tritton, R., McKenzie, J., Tsafnat, G., Elliott, S. A., Meerpohl, J., Tugwell, P., Etxeandia, I., Merner, B., Featherstone, R., Mondello, S., Foxlee, R., Morley, R., van Valkenhoef, G., Garner, P., Turgeon, A., Vandvik, P., Gerrity, M., Munn, Z., Murano, M., Wallace, S. A., Green, S., Newman, K., Watts, C., Grimshaw, J., Nieuwlaat, R., Weeks, L., Gurusamy, K., Nikolakopoulou, A., Weigl, A., Haddaway, N., Wells, G., Hartling, L., O'Connor, A., Wiercioch, W., Hayden, J., Page, M., Wolfenden, L., Helfand, M., Pahwa, M., Yepes Nuñez, J. J., Higgins, J., Pardo, J. P., Yost, J., Hill, S. e Pearson, L. (2017). Living systematic reviews: 2. Combining human and machine effort. Journal of Clinical Epidemiology, 91, 31-37.
Tranfield, D., Denyer, D. e Smart, P. (2003). Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review. British Journal of Management, 14(3), 207-222.
van Eck, N. J. e Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523-538.
van Eck, N. J. e Waltman, L. (2020). VOSViewer Manual. Leiden: University of Leiden.
Whiting, P. F. (2011). QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies. Annals of Internal Medicine, 155(8), 529-536.
Wolff, R. F., Moons, K. G. M., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J. e Mallett, S. (2019). PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies. Annals of Internal Medicine, 170(1), 51-58.
Yan, B.-N., Lee, T.-S. e Lee, T.-P. (2015). Mapping the intellectual structure of the Internet of Things (IoT) field (2000–2014): a co-word analysis. Scientometrics, 105(2), 1285-1300.
YWorks. (2020). yEd Graph Editor Manual. from https://yed.yworks.com/support/manual/index.html