Validation of a Novel Method to Assess the Clinical Quality of Information in Pregnancy-Related Pharmacovigilance Case Reports: A ConcePTION Project.

To assess the causal relationship between a medicinal product and a reported event, relevant information needs to be present. Information elements for assessing cases of exposure to medicinal products during pregnancy were predefined and used in a new tool to assess the quality of information. However, the extent in which the presence or absence of these predefined information elements is associated with the overall clinical quality of these cases, as evaluated by pharmacovigilance experts, remains uncertain. We aimed to validate a novel method to assess the clinical quality of information in real-world pregnancy pharmacovigilance case reports. The clinical quality of case reports regarding medicinal product exposure and pregnancy-related outcomes was appraised from spontaneous reports, literature, Teratology Information Services (UK and Switzerland), The Dutch Pregnancy Drug Register, the Gilenya pregnancy registry and the Enhanced PV programme of Novartis. Assessment was done by means of the novel standardised tool based on the presence and relevance of information, and by expert judgement. The novel tool was validated compared to the expert assessment as the gold standard expressed as the area under the receiver operating characteristic curves, after which the sensitivity and specificity were calculated using cross-tabulations. Inter-rater variability was determined by means of weighted Cohen's kappa. One hundred and eighty-six case reports were included. The clinical quality score as assessed by the novel method was divided into three categories with cut-off values of 45% (poor to intermediate) and 65% (intermediate to excellent). Sensitivity was 0.93 and 0.96 for poor to intermediate and intermediate to excellent, respectively. Specificity was respectively 0.52 and 0.73. Inter-rater variability was 0.65 (95% confidence interval 0.53-0.78) for the newly developed approach, and 0.40 (95% confidence interval 0.28-0.52) for the gold standard assessment. The tool described in this study using the presence and relevance of elements of information is the first designed, validated and standardised method for the assessment of the quality of information of case reports in pregnancy pharmacovigilance data. This method confers less inter-rater variability compared with a quality assessment by experts of pregnancy-related pharmacovigilance data

Improving Data Collection in Pregnancy Safety Studies: Towards Standardisation of Data Elements in Pregnancy Reports from Public and Private Partners, A Contribution from the ConcePTION Project

\ua9 2023, The Author(s).Introduction and Objective: The ConcePTION project aims to improve the way medication use during pregnancy is studied. This includes exploring the possibility of developing a distributed data processing and analysis infrastructure using a common data model that could form a foundational platform for future surveillance and research. A prerequisite would be that data from various data access providers (DAPs) can be harmonised according to an agreed set of standard rules concerning the structure and content of the data. To do so, a reference framework of core data elements (CDEs) recommended for primary data studies on drug safety during pregnancy was previously developed. The aim of this study was to assess the ability of several public and private DAPs using different primary data sources focusing on multiple sclerosis, as a pilot, to map their respective data variables and definitions with the CDE recommendations framework. Methods: Four pregnancy registries (Gilenya, Novartis; Aubagio, Sanofi; the Organization of Teratology Information Specialists [OTIS]; Aubagio, Sanofi; the Dutch Pregnancy Drug Register, Lareb), two enhanced pharmacovigilance programmes (Gilenya PRIM, Novartis; MAPLE-MS, Merck Healthcare KGaA) and four Teratology Information Services (UK TIS, Jerusalem TIS, Zerifin TIS, Swiss TIS) participated in the study. The ConcePTION primary data source CDE includes 51 items covering administrative functions, the description of pregnancy, maternal medical history, maternal illnesses arising in pregnancy, delivery details, and pregnancy and infant outcomes. For each variable in the CDE, the DAPs identified whether their variables were: identical to the one mentioned in the CDE; derived; similar but with a divergent definition; or not available. Results: The majority of the DAP data variables were either directly taken (85%, n = 305/357, range 73–94% between DAPs) or derived by combining different variables (12%, n = 42/357, range 0–24% between DAPs) to conform to the CDE variables and definitions. For very few of the DAP variables, alignment with the CDE items was not possible, either because of divergent definitions (1%, n = 3/357, range 0–2% between DAPs) or because the variables were not available (2%, n = 7/357, range 0–4% between DAPs). Conclusions: Data access providers participating in this study presented a very high proportion of variables matching the CDE items, indicating that alignment of definitions and harmonisation of data analysis by different stakeholders to accelerate and strengthen pregnancy pharmacovigilance safety data analyses could be feasible