ECRI Institute PSO Uncovers Health Information Technology-Related Events in Deep Dive Analysis

As I wrote here, I was a reviewer of the report in the PA-based, ECRI Institute-conducted study "The Role of the Electronic Health Record in Patient Safety Events."  ECRI studied the Pennsylvania Patient Safety Reporting System database for HIT-related errors.   

The ECRI Institute is an independent organization renowned for its safety testing of medical technologies and reporting on same, and that "researches the best approaches to improving the safety, quality, and cost-effectiveness of patient care."  I've mentioned it and its bylaws in this blog in the past as a model for independent, unbiased testing and reporting of healthcare technologies.

The full report in PDF is at this link.  In the report, the Pennsylvania Patient Safety Authority analyzed reports of EHR-related events from a state database (the Pennsylvania Patient Safety Reporting System or PA-PSRS, pronounced "PAY-sirs") of reported medical errors and identified several major themes.

My review input led to a discrete "limitations" section.  Also, my invited July 2012 presentation to the PA Patient Safety Authority "Asking the Right Questions: Using Known HIT Safety Issues to Improve Risk Reporting and Analysis" with ECRI in attendance (link to PPT here) on the danger of limited datasets due to systematic impediments to information diffusion was apparently taken seriously. 

ECRI decided to do something about the knowledge gap, and they asked the right questions.

They've just released this summary of a new study they conducted.  I have a few comments which follow:
  

ECRI Institute PSO Uncovers Health Information Technology-Related Events in Deep Dive Analysis

Data transfer, data entry, system configurations, and more identified as serious problem areas
 
PLYMOUTH MEETING, Pa., Feb. 6, 2013 /PRNewswire-USNewswire/ -- The federal government is spending about $19 billion to encourage hospitals, physician practices, and other healthcare organizations to invest in their health information technology (HIT) infrastructure with the goal of improving patient safety and quality through the Health Information Technology for Economic and Clinical Health (HITECH) Act.

Concerned about the unintended consequences of HIT and the potential for errors to cause patient harm, ECRI Institute Patient Safety Organization (PSO) recently conducted a PSO Deep Dive™ analysis on HIT-related safety events. Their just-released 48-page report identified five potential problem areas, which can be assessed with the accompanying toolkit. The report and toolkit are available for purchase [appx. $350 U.S. - ed.] without membership in ECRI Institute PSO.

"Minimizing the unintended consequences of HIT systems and maximizing the potential of HIT to improve patient safety should be an ongoing focus of every healthcare organization," says Karen P. Zimmer , MD, MPH, FAAP, medical director, ECRI Institute PSO.

Based on [voluntary - ed.] reports submitted to the PSO from participating organizations, ECRI Institute PSO experts identified the following key HIT-related problems:

• inadequate data transfer from one HIT system to another
• data entry in the wrong patient record
• incorrect data entry in the patient record
• failure of the HIT system to function as intended
• configuration of the system in a way that can lead to mistakes

To collect enough reports for meaningful evaluation, ECRI Institute PSO asked participating organizations to submit standardized data about HIT events during a nine-week period. This enabled ECRI Institute PSO to identify patterns and trends from the aggregated data and share the findings, as well as its recommendations. The data in the PSO Deep Dive represents only that collected using the Agency for Healthcare Research and Quality (AHRQ) HIT Common Formats.  [Not the improved formats developed by AHRQ in their IT Hazards Manager project, still in development - ed.]  ECRI Institute PSO data encompasses over 800 HIT-related events.

According to the report, HIT must be considered in the context of the environment in which it operates during the three phases of any HIT project: planning for new or replacement systems, system implementation, and ongoing use and evaluation of the system. "Shortsighted approaches to HIT can lead to adverse consequences," caution the authors.

"Healthcare organizations should consider the findings and recommendations in the PSO Deep Dive as part of their effort to achieve those goals," adds Zimmer.

The HIT PSO Deep Dive findings were published in a 48-page report and toolkit with self-assessment questionnaire and action plan form available to all ECRI Institute PSO Members and its partner PSO members. The table of contents of the report is available for free viewing/download. Additional information will be presented in ECRI Institute PSO's Monthly Brief free e-newsletter March edition; go to www.ecri.org/psobrief to sign up. The full report and toolkit are also available for purchase.

For questions about this topic, or for information about purchasing the report, please contact ECRI Institute PSO by telephone at (610) 825-6000, ext. 5558; by e-mail at pso@ecri.org; by fax at (610) 834-1275, or by mail at 5200 Butler Pike, Plymouth Meeting, PA 19462-1298, USA.

From the free linked TOC document:

Key Recommendations

• Enlist leaders’ commitment and support for the organization’s health IT projects.

• Involve health IT users in system planning, design, and selection.

• Conduct a review of workflow and processes to determine how they must be modified.

• Evaluate the ability of existing IT systems within the organization to reliably exchange data with any health IT system under consideration.

• Conduct extensive tests before full implementation to ensure that the health IT system operates as expected.

• Provide user training and ongoing support; educate users about the capabilities and limitations of the system.

• Closely monitor the system’s ease of use and promptly address problems encountered by users.

• Introduce alterations to a health IT system in a controlled manner.

• Monitor the system’s effectiveness with metrics established by the organization.

• Require reporting of health IT-related events and near misses.

• Conduct thorough event analysis and investigation to identify corrective measures.

My comments are these:

• The ECRI study, report and recommendations are quite welcome.

• The case reports received were apparently voluntary and probably "conservative" and understated as hospitals are not happy to release data on problems and harms that can lead to, or support, litigation.  

• The study was just 9 weeks long, and with a limited set of healthcare organizations participating.  800 HIT-related events were identified. 

•  The relevant issues discovered in the events, as summarized in the bullet points above, are capable of causing clinician distraction, incorrect decisions, "use error" (as opposed to "user error", see here), patient harm, and death.  (I am aware of such issues in the press including harms and deaths, as readers here have read at links such as these and these and these and these, and others about which I am providing expert-witness consultation and cannot share.)
  

• I believe ECRI has now begun to peer below the water level, through the muck of industry control of the narrative, of what FDA CDRH leader Jeffrey Shuren MD JD referred to as "the tip of the iceberg" - i.e., the current level of knowledge of health IT difficulties, defects and harms. 

• The report is yet another red flag for a far more robust (and mandatory, in my view) post-marketing surveillance of health IT.  

• Those who claim these findings are "anecdotes" (as here) are looking increasingly foolish and cavalier.

Finally, readers of this blog have been reading about these issues for years.  You heard it here first.

-- SS 
 

New York Mayor Bloomberg: Gun Control - Yes, Bad Health IT Control - No?

The Mayor of New York, Bloomberg, calls for anti-gun legislation because accidents and unexpected events such as theft or use by a child can happen, even with legally owned guns (I don't think he believes law-abiding citizens who own them for defense or for sport would break the law with them).

Yet the selfsame Mayor uncritically calls for spread of another technology that in its present state is prone to accidents and unintended consequences, and unlike guns, at a level that even the Institute of Medicine has admitted in unknown due to systematic impediments to transparency (see the middle of this post for source).

From a release at MikeBloomberg.com:

Mayor Bloomberg Announces Expansion of Electronic Health Records Result in Major Health Care Improvements
Feb 07, 2013 | NYC.gov

Mayor Bloomberg, Deputy for Health and Human Services Linda I. Gibbs, Health Commissioner Thomas A. Farley today announced that the use of electronic health records has led to better health outcomes for tens of thousands New Yorkers in the critical areas of high blood pressure management, diabetes and tobacco control.

New York City's introduction of electronic health records, which has become a national model, was a result of the Primary Care Information Project, a program that began in 2005 to help medical providers, particularly those with underserved patients, use technology to improve the quality and efficiency of health care. The prompts that electronic health records give doctors, such as signaling a daily dose of aspirin to prevent heart disease or follow up questions for someone who smokes, make a dramatic difference in how aggressively they treat the chronic health conditions of their patients.

Through 3,200 primary care providers serving more than three million New Yorkers with electronic health records, over 96,000 additional patients reduced their high blood pressure, 81,000 patients improved their diabetes management and an additional 58,000 smokers were given assistance and successfully quit. The Mayor made the announcement at the “NYC Celebrates Improved Health Through Technology” event at the New York Institute of Technology where he was joined by Centers for Disease Control and Prevention Director Dr. Thomas Frieden, National Coordinator for Health Information Technology Dr. Farzad Mostashari and Director of Health Services Andrea Cohen.

There is no doubt the technology can accomplish such goals.  The IT I authored or spearheaded at major hospitals improved quality of care in areas such as diabetes and asthma care, invasive cardiology, and others.

The release, however, is missing the most important points.

The issue is not whether benefits can accrue from health IT.

The issues are ... at what level of harms in its present state, since the technology is unregulated and unvetted for potential risks, and also - are there simpler and cheaper ways to accomplish these ends, e.g., so that the underserved can get more access to care.

There is no mention of unintended harms, or even concern about harms, in the release - the very same harms mentioned by Joint Commission, FDA, Institute of Medicine (for example see JC, FDA, IOM) and many others.

That qualifies the press release as propaganda.  It is not balanced, almost like an ad for, say, VIOXX.

Apparently, for the Mayor it's OK to have increased risk and innocent victims due to bad health IT (like these and these and these and these, and others I cannot talk about due to case settlements), but not innocent victims of legally owned but stolen guns.

Medicine's tradition for centuries has been "first, do no harm", not "when you have benefits to the many, it's OK to overlook the risks and the roadkill."

We don't tolerate that any more from the likes of Merck, Pfizer, or Medtronic (to name a few examples).

Why does health IT always get special accommodation, as I have frequently asked?

With new federal funding for 2013, NYC REACH is now working to help behavioral health professionals and specialists with high numbers of Medicaid patients adopt and implement electronic health records to continue to improve care across the City.

Let's hope they don't have an Avatar rerun (link) or Contra Costa meltdown (link, link).

Note: this post is not about gun control, a complex issue unto itself, but about medical ethics and hypocrisy. 

-- SS

Feb. 8, 2013 Addendum: 

Prof. Jon Patrick of U. Sydney opines:

I can only say the story is a well crated ANECDOTE.

The pertinent text is this:

Between 2008 and 2011, the number of preventive care services participating doctors provided grew, on average, by about 290%, from 39 services per 100 patients to 113 services per 100 patients – nearly a threefold increase.

Which tells us the only tangible piece of information in that services are increased - where are the figures from the EDs or hospital intakes that show the number of visits for these diseases have gone down?

The other interesting point is the valid claim of better analytics - but they don't say how they were used, if at all:

"Patients served by doctors participating in the program were, for example, reminded to take daily aspirin doses to prevent heart disease or counseled to quit smoking. Electronic Health Records also permit doctors to view data on their entire population of patients, which helps them modify their routine office practices to help all of their patients and then evaluate how well those changes work."

-- SS