Abstract:
Since we introduced it in 2007 AMSTAR, which was developed and validated against RCTs, has become widely used for assessing the quality of systematic reviews (SRs). However, over half of published SRs now include non-randomized studies (NRS). Many of these reviews of disease associations and treatment effects cover topics that are of considerable significance to clinicians and policy makers. NRS are prone to a range of biases, and poor quality SRs that include these designs can be misleading. It is important to develop an instrument that enables users of such reviews to make a rapid and accurate appraisal of their quality. We intend to develop and validate a new instrument, AMSTAR NRS, which will be better suited to this purpose.
The workshop will include a discussion of the methodological challenges in the evaluation of SRs of NRS. We will present participants with SRs that include NRS and provide them with an opportunity to use AMSTAR to perform an assessment of their quality. Small group discussions will also allow us to gain knowledge about the experiences of using AMSTAR to assess the quality of reviews that include NRS and to get suggestions for developing an instrument for assessing SRs of NRS.