• English
  • Español

B1O2 | Updating QUADAS: User experience informs the development of QUADAS-2

Abstract text
Background:
QUADAS is a widely used, evidence-based quality assessment tool, developed for use in systematic reviews of diagnostic test accuracy (DTA) studies. The experience of the QUADAS steering group, anecdotal reports, and feedback via Cochrane Collaboration members suggested some problems with QUADAS. We therefore decided to revise QUADAS using experience of its application, and new evidence regarding sources of bias and variation to produce “QUADAS-2”. This abstract describes evidence derived from user experience.
Objectives:
To gather structured feedback from reviewers who have used QUADAS, and to summarise the findings of studies that have evaluated QUADAS.
Methods:
We sought information on users’ experiences of QUADAS using a web-based questionnaire to elicit feedback from authors of Cochrane DTA reviews and protocols and authors of reviews on DARE which had used QUADAS. We conducted a systematic review of studies that had evaluated QUADAS.
Results:
64 Reviewers completed the questionnaire. The majority (70% to 89%) rated QUADAS as good or very good for coverage, ease of use, clarity and validity. Negative features highlighted were the mixing of questions relating to bias and applicability, and inability to use QUADAS to assess studies comparing multiple index tests. Approximately 15% of reviewers reported omitting items on reporting quality from their QUADAS assessments. Despite guidance, 20% of reviewers reported using QUADAS to calculate summary scores.
Four studies evaluated QUADAS; key recommendations were that QUADAS-2 should be expanded to cover studies comparing multiple index tests and topics where follow-up is the reference standard.
Conclusions:
The experience of reviewers using QUADAS informed development of QUADAS-2 and was largely consistent with the experience and conceptual decisions of the steering group. The experience of QUADAS users will continue to be important in informing future developments and ensuring continued relevance and wide up-take.
Authors
Westwood M1, Whiting P2, Rutjes A3, Mallet S4, Deeks J5, Sterne J2, Leeflang M6, Reitsma J7, Bossuyt P6
1 Kleijnen Systematic Reviews Ltd, UK
2 University of Bristol, UK
3 University of Bern, Switzerland
4 University of Oxford, UK
5 University of Birmingham, UK
6 University of Amsterdam, the Netherlands
7 University Medical Centre Utrecht, the Netherlands
Presenting author and contact person
Presenting author: 
Marie Westwood
Contact person: 
Marie Westwood (Contact this person)
Date and Location
Session: 
Oral session B1O2
Date: 
Thursday 20 October 2011 - 11:35 - 12:05
Location: