Agreement between Self-Reports and Medical Records Was Only Fair in a Cross-Sectional Study of Performance of Annual Eye Examinations among Adults with Diabetes in Managed Care

Background: Despite consensus about the importance of measuring quality of diabetes care and the widespread use of self-reports and medical records to assess quality, little is known about the degree of agreement between these data sources. Objectives: To evaluate agreement between self-reported and...

Full description

Saved in:
Bibliographic Details
Published in:Medical care 2007-09, Vol.45 (9), p.876-883
Main Authors: Beckles, Gloria L. A., Williamson, David F., Brown, Arleen F., Gregg, Edward W., Karter, Andrew J., Kim, Catherine, Dudley, R. Adams, Safford, Monika M., Stevens, Mark R., Thompson, Theodore J.
Format: Article
Language:English
Subjects:
Adult
Adults
Aged
Cross-Sectional Studies
Diabetes
Diabetes complications
Diabetes mellitus
Diabetes Mellitus, Type 2 - epidemiology
Diabetes Mellitus, Type 2 - physiopathology
Diabetic Retinopathy - diagnosis
Diabetic Retinopathy - epidemiology
Diagnostic Tests, Routine
Eyes & eyesight
Female
Humans
Linear Models
Male
Managed care
Managed Care Programs - standards
Managed Care Programs - utilization
Medical records
Medical Records - statistics & numerical data
Middle Aged
Outcome Assessment (Health Care)
Patient assessment
Physical examinations
Quality Indicators, Health Care
Quality of care
Referents
Reproducibility of Results
Risk Assessment
Self Disclosure
Self reports
Surveys and Questionnaires
Type 1 diabetes mellitus
Type 2 diabetes mellitus
United States - epidemiology
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Background: Despite consensus about the importance of measuring quality of diabetes care and the widespread use of self-reports and medical records to assess quality, little is known about the degree of agreement between these data sources. Objectives: To evaluate agreement between self-reported and medical record data on annual eye examinations and to identify factors associated with agreement. Research Design and Subjects: Data from interviews and medical records were available for 8409 adults with diabetes who participated in the baseline round of the Translating Research Into Action for Diabetes (TRIAD) Study. Measures: Agreement between self-reports and medical records was evaluated as concordance and Cohen's kappa coefficient. Results: Self-reports indicated a higher performance of annual dilated eye examinations than did medical records (75.9% vs. 38.8%). Concordance between the data sources was 57.9%. Agreement was only fair (kappa coefficient = 0.25; 95% confidence interval, 0.23-0.26). Nearly two-thirds (64.6%) of discordance was due to lack of evidence in the medical record to support self-reported performance of the procedure. After adjustment, agreement was most strongly related to health plan (x² = 977.9, df = 9; P < 0.0001), and remained significantly better for 3 of the 10 health plans (P < 0.00001) and for persons younger than 45 years of age (P = 0.00002). Conclusions: The low level of agreement between self-report and medical records suggests that many providers of diabetes care do not have easily available accurate information on the eye examination status of their patients.
ISSN:0025-7079
1537-1948
DOI:10.1097/MLR.0b013e3180ca95fa