Back to Explorer

Best Practices for Conducting and Reporting Pharmacoepidemiologic Safety Studies Using Electronic Healthcare Data Sets

FinalCenter for Drug Evaluation and Research Center for Biologics Evaluation and Research05/14/2013
Quality AssuranceData IntegrityValidation studiesQuality ControlPharmacovigilance

Description

This guidance describes best practices pertaining to conducting and reporting on pharmacoepidemiologic safety studies2 that use electronic healthcare data, which include administrative claims data and electronic medical record (EMR) data.3 The guidance includes recommendations for documenting the design, analysis, and results of pharmacoepidemiologic safety studies to optimize FDA’s review of protocols and final reports that are submitted to the Agency. For purposes of this guidance, the term pharmacoepidemiologic safety study refers to an observational study designed to assess the risk associated with a drug exposure and to test prespecified hypotheses. For ease of reference, this guidance uses the term drug to refer to drug and biological products regulated by CDER or CBER. Medical devices are not within the scope of this guidance.

Key Topics

Terms and concepts identified from this document

Scope & Applicability

Product Classes

4
Drug

Defined in section 201(g) of the FD&C Act; Articles intended for use in diagnosis, cure, mitigation, treatment, or prevention of disease; Product classification based on chemical action or specific intended uses like altering pH

Combination Product

Products combining drug, device, or biological constituents; Generally recommended for Enhanced Documentation; Requires 14971-based framework incorporating ICH Q9; A drug-device combination where the device constituent part detects ingestion.

vaccines

Class of medicinal products where lack of efficacy may require ICSR reporting

Biological products

development program for drug and biological products

Stakeholders

4
Industry

Guidance for Industry

data holders

Entities maintaining electronic healthcare data responsible for QA/QC

Sponsor

Entity responsible for submitting applications under section 524B

Applicant

Entity submitting development data and knowledge; Entity performing the work process for change

Regulatory Context

Regulatory Activities

7
Review of protocols

FDA's evaluation of submitted study designs

pharmacoepidemiologic safety studies

Observational studies using electronic healthcare data

Regulatory submission

The credibility assessment report may be included as part of a regulatory submission.

New drug applications

Submission process applicable to optical imaging drugs.

Abbreviated new drug applications

Submission process applicable to optical imaging drugs.

Biologics license applications

Submission process applicable to optical imaging drugs.

Risk Evaluation and Mitigation Strategy

FDA has determined that a class-wide REMS is necessary for all opioid analgesic drugs.

Document Types

9
Administrative claims data

RWD source typically collected for billing or payment; Partially curated data source such as administrative claims

FDA MAPP 6700.2

Standards for Data Management and Analytic Processes in the Office of Surveillance and Epidemiology.

Death certificates

Determining cause of death may call for information from death certificates

Study Protocol

Document defining the design and conduct of the trial

EMR data

EMR data are generated in the course of routine clinical care provision

Electronic medical record data

EMR data used in pharmacoepidemiologic safety studies

Protocol

Defines the standard of veterinary practice and limits for anesthetic regimens

Final reports

Reports of study results submitted to the Agency

Final report

required as part of the premarket submission

Attributes

10
Sample Size

statistically justified calculation required in the plan

Lag time

The time of a patient's actual date of service to the date when the adjudicated claim first appears.

Exposure risk window

Interval of exposure time relevant in design or analysis

Sensitivity

Analysis by sex of clinical performance measures such as sensitivity

Positive Predictive Value

Performance metric achieved by the model

Churn rate

investigators should provide information about the churn rate; Proportion of enrollees that disenroll from a health plan

Continuity of coverage

investigators should address continuity of coverage (enrollment and disenrollment)

Statistical Power

adequate statistical power and accounting for planned analyses

Public health impact

Element 1 of the fundamental elements approach; Element 1 of a vulnerability assessment; The scale of harm resulting from contamination; actionable process step because of the public health impact that would occur if the tank were contaminated.; Measured by potential deaths (e.g., 10,000 deaths) if a step is contaminated.

Confidence intervals

sponsors should include confidence intervals on all reported results

Technical Details

Substances

2
OTC medications

over-the-counter (OTC) medications and dietary supplements are not captured systematically; OTC medications and dietary supplements are not generally captured in insurance-based data sources.

Low cost generics

Uncaptured prescriptions might include low cost generics and drugs obtained through programs.

Testing Methods

9
Sensitivity Analyses

Statistical considerations in clinical trials

Validation

Verification activity often required for preventive controls

Post hoc analysis

An analysis that was not anticipated or described in the analysis plan or study protocol.

Feasibility analyses

Analyses conducted before the development of the protocol and analysis plan to determine if a study is feasible.

Observational studies

Alternative to clinical trials for examining cessation behaviors.; Alternative study design to support a marketing order.

Meta-analytical techniques

Used to obtain a pooled estimate from multiple data sources

propensity score modeling

Statistical approach to address confounding in pharmacoepidemiologic studies; Methods for bias reduction in the comparison of a treatment to a nonrandomized control group.

Cohort study

study design (e.g., cohort, case-control) employed

Case-control study

study design (e.g., cohort, case-control) employed

Processes

4
Pharmacoepidemiologic Safety Studies

Observational studies designed to assess risk associated with drug exposure

Outcome Validation

Information gathered in the outcome validation process should be incorporated into the analysis plan.

Pharmacoepidemiologic safety study

A framework for industry to use when submitting pharmacoepidemiologic safety study protocols; indicates the type of pharmacoepidemiologic safety study design; An observational study designed to assess the risk associated with a drug exposure and test prespecified hypotheses.

Postmarketing studies

FDAAA provides the specific circumstances when FDA can require the conduct of postmarketing studies

Clinical Concepts

4
Confounders

Covariate ascertainment and validation

healthy vaccinee effect

Confounding issue specific to vaccine studies

Pharmacogenetics

Other topics related to drug interaction studies

Adverse event

Safety monitoring concept defined in the protocol

Identified Hazards

Hazards

7
Bias

mitigate potential unwanted bias in learning or performance estimation

Time-varying confounder

A confounder variable whose values change over the study time frame.

Survivor bias

A specific type of selection bias arising from differences in competing risks or loss to follow-up.

Unmeasured confounding

Results might be biased because of unmeasured confounding

confounding by indication

Bias where the indication is an independent risk factor for the outcome; Type of channeling bias where indication is an independent risk factor

channeling

Bias where drugs are prescribed based on factors prognostic of patient outcomes; Drugs prescribed differently based on prognostic factors

Confounding

A factor to be managed in the analysis of real-world data; considering sources of potential bias and confounding; Studies must address two sources of error: systematic error (bias, confounding).

Standards & References

External Standards

5
ISPE guidelines

2008 ISPE guidelines highlight importance of describing data management; Guidelines for good pharmacoepidemiology practices (GPP).

ICD

Determination of the positive predictive value of a code-based (e.g., ICD) operational outcome definition.

Guidelines for Good Pharmacoepidemiology Practices

ISPE guidelines 2008

Consolidated Standards of Reporting Trials

CONSORT statement exemplifies how basic reporting standards can improve quality

Strengthening the Reporting of Observational Studies in Epidemiology

STROBE statement provides guidelines for reporting observational studies

Specifications

1
Statistical analysis plan

The investigators should describe the reasons for their choices of analysis plan; The plan should specify planned statistical techniques and diagnostic methods; Plan describing anticipated analyses for the study.

Related CFR Sections (3)

See Also (8)

Best Practices for Conducting and Reporting Pharmacoepidemiologic Safety Studies Using Electronic Healthcare Data Sets | Guideline Explorer | BioRegHub