Abstract

Ongoing standardized post-market evaluation of blood glucose monitoring systems (BGMS) is both clinically important to confirm appropriate performance and mandatory under the European Union In Vitro Diagnostics Regulation. Publication and accessibility of studies on device performance has therefore become a key component of evidence-based purchasing decision for distributors and users.
In the present study, a comparative post-market evaluation of 6 BGMS was performed in accordance with ISO 15197:2015 1 protocols and requirements (Table 1). All devices, test strips, and solutions were supplied by the respective manufacturer. Duplicate glucose measurements of native and manipulated samples (ie, glycolysis at 37°C for 3-4 hours, glucose supplementation of a 40% glucose solution) of capillary whole blood or plasma were performed using the blood glucose monitor and one of two reference methods (see Table 1 for details). For the data analysis, whole blood measurements were converted to plasma equivalents via hematocrit based numeric conversion, if needed. Trueness and precision of the BGMS and reference assays were verified using certified bioanalytical standards and manufacturer issued control solution. Based on the in- and exclusion criteria established by the manufacturers and appendix A of DIN EN ISO 15197:2015, 600 subjects with diabetes totaling 3600 measurements were included in the analysis.
Test Systems Evaluated and System Accuracy Results.
Abbreviation: BGMS, blood glucose monitoring system; MARD, mean absolute relative difference; GDHFAD, glucose dehydrogenase-flavin adenine dinucleotide; GOD, glucose oxidase.
All six devices fulfilled the acceptance criteria pursuant to the directive guidelines. The measurements of each device lie in zones A and B of the Parkes/consensus error grid for patients with type 1 and type 2 diabetes. 2 Between 97.5% and 99.2% of measurements showed deviations of less than ±15 mg/dL and ±15% for glucose concentrations <100 mg/dL and ≥100 mg/dL, respectively (Table 1). All devices performed marginally better at lower concentrations. The BGMS evaluated with whole blood had the highest bias (-7.1%) and mean absolute relative difference (MARD) to the reference method (8.1%).
Yet, a direct comparison of BGMS using plasma or whole blood is not always readily practicable for a variety reasons. Foremost is the often poor overlap of sample material from manufacturer’s development and performance studies with the patient population used in post market follow-up studies with the actual patient population, be it demographic (age), physiological (hematocrit), or others. 3 Also, the basis of calibration differs between monitors depending on the manufacturers enzymatic assay for whole blood or plasma measurements. However, we found no significant effect of sample type, test strip reagent, or reference method on mean absolute relative difference (MARD, Table 1), bias or overall compliance with acceptance requirements.
Footnotes
Acknowledgements
The authors would like to thank the personnel of the Institute of Diabetes GmbH for providing technical help, intellectual input and feedback in conducting the studies, and preparing the manuscript. Tyson Bioresearch Inc., aktivmed GmbH, Beurer GmbH, and IME-DC GmbH were permitted to review and comment on the manuscript, final decision on content was retained by the authors.
Abbreviations
BGMS, blood glucose monitoring system; MARD, mean absolute relative difference; GDH, glucose dehydrogenase; FAD, flavin adenine dinucleotide; GOD, glucose oxidase.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: All authors are employees of the Institute of Diabetes Karlsburg GmbH, Germany, which carries out studies evaluating blood glucose meter systems on behalf of various clients.
