D2.417 - Research transparency, reproducibility and accessibility in Allergy, 2003 – 2023: Preliminary results of the TRACES study

Best research practices, including transparency, reproducibility, and accessibility, are vital in the generation of high-quality evidence. In recent years, this has been attracting mounting interest with numerous studies conducted in various medical specialties, but never Allergy. We therefore designed and conducted a longitudinal, systematic, meta-research study – TRACES (Transparency, Reproducibility, and Accessibility of Clinical and Experimental Studies in Allergy), to evaluate the status quo in the field of Allergy.

Following the previously published protocol, a systematic search was conducted on MEDLINE to identify all research articles published in indexed Allergy journals between 2003 and 2023. We randomly sampled and reviewed 500 records (100 records in 2003, 2008, 2013, 2018 and 2023, respectively) for a series of transparency and reproducibility indicators, including the presence of conflict-of-interest and funding statements, availability statements for protocols, data, materials and analysis scripts, pre-registration statements, and open access status. A comparative analysis was performed between papers published in the past decade (2013 – 2023) and before (2003 – 2008).

A total of 16981 records were identified, with eventually 497 accessible records reviewed and included in our analysis. Compared with older studies, significantly more articles published last decade were open access (27.0% vs. 55.2%, p<0.001), had an available funding statement (27.5% vs. 58.6%, p<0.001), as well as a conflict-of-interest statement (12.0% vs. 77.4%, p<0.001; Table 1). Among the 259 empirical studies which contain original data and/or analysis, there were also significant increases in the provision of availability statements of protocols (0.0% vs. 6.1%, p=0.015), data (1.1% vs. 18.9%, p<0.001), materials (1.1% vs. 9.1%, p=0.009), and pre-registration (1.1% vs. 9.8%, p=0.006), but not analysis scripts (0.0% all along), replication study (0.0% all along), and inclusion in evidence synthesis (14.7% vs. 11.6%).

As shown in TRACES, there are positive trends in the transparency, reproducibility and accessibility of Allergy research. However, the overall situation in our field, particularly the availability of protocols and analysis scripts, remains suboptimal. Better research practices should be advocated and adhered to.