The Adverse Event Atlas and Signal Consensus Index: A Multi-Source Pharmacovigilance Platform

Abstract

Background Post-market pharmacovigilance relies predominantly on single-database disproportionality analysis of spontaneous adverse event reports, which lacks corroboration across independent evidence streams and cannot integrate randomised trial evidence. No publicly accessible platform has previously combined European national pharmacovigilance registries, the US FDA Adverse Event Reporting System (FAERS), and clinical trial meta-analyses into a unified, continuously scored signal detection framework.

Methods We describe the Signal Consensus Index (SCI), a composite 0-100 pharmacovigilance signal score integrating disproportionality evidence from the Danish National Pharmacovigilance Database, the UK MHRA Yellow Card scheme, and FAERS, with DerSimonian-Laird meta-analytic risk ratios from ClinicalTrials.gov, across 6,905,874 drug-adverse event pairs. Each source contributes a continuous score derived from the lower bounds of three complementary disproportionality metrics (ROR, PRR, IC025) for spontaneous reporting sources, and from the pooled risk ratio lower confidence bound for clinical trials. The SCI is publicly accessible via the Adverse Event Atlas (aeatlas.com). We report reference set validation against the EU-ADR reference standard, a single-source comparison with discordance characterisation, temporal stability analysis across eight cumulative data windows (2015-2023), and a weight sensitivity analysis across seven pre-specified weighting schemes.

Results The SCI generated 129,176 Moderate-or-Strong signals (SCI ≥ 50, confidence ≥ 50) and 7,290 Strong signals (SCI ≥ 70, confidence ≥ 70). Reference set validation against 88 classifiable drug-event pairs (44 positive controls, 44 negative controls) yielded 18 true positives, 0 false positives, 44 true negatives, and 26 false negatives (sensitivity 40.9%, specificity 100.0%, PPV 100.0%, NPV 62.9%). Zero false positives were observed across all 44 classifiable negative controls, with five false negatives attributable to the confidence gate correctly suppressing single-source signals pending multi-source corroboration. Single-source comparison demonstrated that FAERS alone generated 1,438,246 disproportionality signals, of which 94.8% were not confirmed by the SCI, while 54,184 SCI-detected signals were absent from FAERS, of which 8.3% involved drugs absent from the US reporting system. Discordance analysis showed that 99.8% of Danish non-confirmation reflected data availability constraints. Temporal stability was high: 98.5% of pairs received identical classifications across all seven weight scenarios, and 57.0% of final Strong signals were already detectable as Moderate or Strong in the earliest data window (2015-2016). Strong classifications were stable across weight scenarios (94.0% of Strong observations remaining Strong).

Conclusions The SCI provides a transparent, openly accessible framework for cross-source pharmacovigilance signal prioritisation with 100% specificity and PPV against an established reference standard and stable classifications across weighting schemes. Progressive signal emergence through the Moderate tier supports its use as an early detection layer. The platform is available at aeatlas.com.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This study did not receive any funding

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

https://www.vigiaccess.org/ https://laegemiddelstyrelsen.dk/da/bivirkninger/bivirkninger-ved-medicin/interaktive-bivirkningsoversigter/ https://yellowcard.mhra.gov.uk/ https://open.fda.gov/data/faers/ https://clinicaltrials.gov/

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Comments (0)

No login
gif