Showing posts with label EHR. Show all posts
Showing posts with label EHR. Show all posts

Saturday, July 7, 2012

Manipulation of 12,000 Medical Records Made Easy by EHR

This from a hospital in Canberra, Australia using a common ED EHR in that part of the world, iSOFT:

Canberra Hospital embroiled in data scandal
SBI Magazine (Secure Business Intelligence)
Jul 5, 2012 

A Canberra Hospital executive has admitted to manipulating Emergency Department records to make wait times and stays appear shorter than they were.

The executive told the Director-General of the Health Directorate they had made "approximately 20 to 30 changes to hospital records" a day from "late 2010" onwards.

ABC [Australian Broadcasting Corp.] News reported that the matter has been referred to police, while the executive has been suspended without pay.

Though the data manipulation was initially said to be motivated by concerns over job security, changes in 2011 and early 2012 were said to have been made due to "managerial pressure" to improve publicly-reported performance statistics.

This raises the issue that data manipulation might have been performed not just to improve reported statistics, but to cover up medical error, computer related or not, and thus deny injured patients or their heirs the right to legal redress.

"The only thing that worked to achieve benchmark targets was to alter the data," the executive later told investigators at PricewaterhouseCoopers (PwC), which was engaged by Health to perform a forensics analysis. The analysis is detailed in a new Auditor-General report (pdf).

In total, PwC found 11,700 performance records - about six percent of all records stored in the hospital's iSOFT emergency department information solution (EDIS) - had been altered.

It is believed more staff at Canberra Hospital altered records than the executive that has so far admitted responsibility.  "While an executive has admitted to changing EDIS records, it is probable that EDIS records have also been manipulated by other persons with access to the system," the federal auditor-general noted overnight.

This is another area where electronic records make possible tasks that are probably impossible with paper.  Altering 11,000+ records would be hard in paper charts, as the alterations would likely stick out in a pronounced manner.

"The executive’s admission to Audit does not appear to account for all of the changes to EDIS records that have been made to improve timeliness performance."

For example, changes to EDIS records, albeit a much smaller number, appear to have been made on days when the executive was on leave (seven days in total in 2010-11 and early 2011-12). 

I am saddened to note, a proper term for this activity might indeed be "conspiracy":  a conspiracy is an agreement between two or more persons to break the law at some time in the future.

User access control, IT security failures

Poor controls such as generic logins and inadequate user and password security made it easy for insiders to game the data.

While EDIS was on approximately 259 workstations across the hospital and 253 users had permission to run the software, there were only 23 user accounts.

Of these user accounts, only eight were in regular use, including four named administrator accounts (specific to administrative staff) and four generic user accounts: CLERK, NURSE, DOCTOR and BEDMAN.

The generic accounts could be used by personnel across the hospital, not just within the Emergency Department.

Passwords for the four generic user accounts were "very poor" and had "never been changed". Password expiry was set at a default 999 days.

Audit logs were equally poor, not proactively checked and unreliable.

The proper term for these arrangements might be "gross mismanagement" of clinical information technology.

"A feature of the logging record is that it logs the changed field in EDIS and a number of other fields simultaneously, while not identifying which field was changed and what its original value was," auditors noted.

"Audit also notes that the logging record is also ineffective, because every entry in EDIS is logged from “Workstation 14”.  

"Although EDIS has been disseminated widely throughout the Canberra Hospital each of these users logs into EDIS using the common “Workstation 14”.

"This practice, combined with the use of generic user accounts, makes the EDIS logging information useless for investigations of unauthorised activity."

Furthermore, it was possible to edit EDIS records up to 72 hours after a patient’s treatment, providing a generous window for later unauthorised changes to the records.

These "features" sound like seller misdesign with regard to the metadata (logging records).

Noticing anomalies

It was only in April this year that a full inquiry was commissioned after "anomalies" in performance figures were spotted by the Australian Institute of Health and Welfare (AIHW).

The AIHW found an unusually high number of emergency patients that were reported to have been seen at exactly within the required time for their illness category.

For example, there was an unusually high number of patients who were reported to have been seen at exactly 30 minutes or 60 minutes.

In addition, an unusually high number of people checked out of the Emergency Department precisely 240 minutes after their recorded arrival.

If you're going to engage in this type of activity, at least be competent at it...instead of setting up a red flag bigger than the flag that used to fly over the Kremlin.

The records that were manipulated mean that publicly reported information relating to the timeliness of access to the Emergency Department and overall length of stay in the Emergency Department have been inaccurately reported.

The report could not ascertain the level of over‐estimation due to the lack of a clear audit trail identifying what were legitimate and what were fabricated entries in patients’ records.  

Timelines can be critical to proving medical negligence in court.  Further, if time data could have been manipulated, it seems clinical data could have been manipulated as well.

EHR data manipulation is of unknown magnitude worldwide, but I can imagine if it's easy to do and the benefits potentially substantial, electronic records could possibly be less trustworthy than paper records.

-- SS

Addendum:  while on the topic of clinical IT Down Under, there's also this:

Coast medical records system 'dangerous'
Stephanie Bedo
Goldcoast.com.au


Doctors have complained about the system, saying some patient documents are missing, it has log-in problems and 10-minute delays in accessing critical information.

Gold Coast Health was the first region in the state to move to electronic record-keeping, rolled out progressively from October last year.

Queensland Health spent about $200 million on the electronic medical record roll-out last year, which was delayed by 12 months because of problems with the software provider.

... Hospital cardiologist Dr Greg Aroney raised concerns about the system at a Griffith University forum on the future of health on the Gold Coast this week.

"Our system is totally inadequate and dangerous," Dr Aroney said.


Read the whole story at this link:   http://www.goldcoast.com.au/article/2012/07/06/429621_gold-coast-news.html

A similar story from the states where the doctors' complaints were actually ignored is at my Sept. 2011 post "Blake Medical Center (Bradenton, Fla.) Ignores Health IT Warning Letter From 100 Staff Physicians." 

Let's hope the Australian physicians' complaints are taken more seriously.

-- SS

Friday, January 27, 2012

Wikipedia page on EHR's: ==Disadvantages== material seems to keep disappearing

It's interesting how most of the information below seems to have a hard time "staying put" on the Wikipedia page for "Electronic Health Record" at http://en.wikipedia.org/wiki/Electronic_health_record

The information is presented in a neutral fashion from impeccable sources. Yet several Wikipedia "editors" take issue with it and, rather then editing it or refuting it (and stating their rationale and sources!), they keep deleting it. (The most recent edit history comments follow this "disappearing" information, at the bottom of this post):


==Disadvantages==

===Software quality and usability deficiencies===
EHR software is unregulated, unlike computer systems used both in the development and production of, and as a part of pharmaceutical products, medical devices, food, blood establishments, tissue establishments, and clinical trials.http://en.wikipedia.org/wiki/Validation_%28drug_manufacture%29 Other life-critical industries also have strict software validation and testing standards, e.g., Federal Aviation Administration, NASA.http://www.faa.gov/regulations_policies/advisory_circulars/index.cfm/go/document.information/documentID/1019261http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20040014965_2004000657.pdf.

As a result, EHR software quality and usability is often suboptimal. For example, in "A study of an Enterprise Health information System", March 2011, a Medical Informatics researcher at [[University of Sydney]] in Australia found that a major EHR system for Emergency Departments slated for deployment in the public hospitals of [[New South Wales]] has serious deficiencies in software architecture and fit with clinician workflow. These deficiencies make it difficult to use and unreliable in terms of data integrity and loss, in one of the most demanding of clinical environments .http://sydney.edu.au/engineering/it/~hitru/index.php?option=com_content&task=view&id=91&Itemid=146

The [[Healthcare Information and Management Systems Society]] (HIMSS), a very large U.S. healthcare IT industry trade group, observed that EHR adoption rates "have been slower than expected in the United States, especially in comparison to other industry sectors and other developed countries. A key reason, aside from initial costs and lost productivity during EMR implementation, is lack of efficiency and usability of EMRs currently available."http://www.himss.org/content/files/HIMSS_DefiningandTestingEMRUsability.pdf

Serious reliability and usability problems with the U.S. Department of Defense’s [[AHLTA]] EHR system have been reported to the Congress.http://www.usmedicine.com/articles/electronic-records-system-unreliable-difficult-to-use-service-officials-tell-congress.html

The U.S. [[National Institute of Standards and Technology]] (NIST) issued a Sept. 2011 report on deficient usability of current EHR systems, with recommendations for usability evaluation, testing and validation.http://www.nist.gov/healthcare/usability/upload/Draft_EUP_09_28_11.pdf

===Unintended adverse consequences===
EHRs can introduce new unintended consequences, compared to paper records, and adverse outcomes, including patient injury and death, according to regualtory and governmental agencies, researchers, and others; for example, in an internal 2009 FDA memorandumhttp://www.ischool.drexel.edu/faculty/ssilverstein/Internal-FDA-Report-on-Adverse-Events-Involving-Health-Information-IT.pdf of Feb. 23, 2010 obtained and released by the Huffington Post Investigative Fundhttp://web.archive.org/web/20110425002322/http://huffpostfund.org/stories/2010/08/fda-obama-digital-medical-records-team-odds-over-safety-oversight, EHR-related medical errors are categorized as: errors of commission (EOC), errors of omission or transmission (EOT), errors in data analysis (EDA), and incompatibility between multi-vendor software applications or systems (ISMA).

The [[National Health Service]] (NHS) in the UK reports specific examples of EHR-caused patient harms in a 2009 document on guidance on the management of clinical risk relating to the deployment and use of health software, Annex A "Examples of potential harm presented by health software."http://www.isb.nhs.uk/documents/isb-0160/dscn-18-2009/0160182009specification.pdf.

Also, in "Research in Ambulatory Patient Safety 2000–2010: A 10-year review", Dec. 2011http://www.ama-assn.org/resources/doc/ethics/research-ambulatory-patient-safety.pdf, the American Medical Association reports:

:While health IT may confer benefits, some research has also suggested that health IT systems can create new issues or exacerbate existing problems. Wachter noted that, “[i]n both professional and lay publications, concerns have been raised that today’s electronic health records promote the copying and pasting of clinical information, instead of its thoughtful analysis; foster a focus on completing computerized checklists and templates rather than detailed probing of the patient’s history, and support less thoughtful diagnostic reasoning and more automatic behavior on the part of caregivers." Research indicates that a great deal depends on the design of the health information technology system, with poorly designed systems contributing to instances of errors (Ash et al). Where user interface designs are cumbersome to use and do not fit into the clinician’s natural work context, some have noted the potential for “cognitive overload,” among other reactions, and ultimately the possibility of increasing errors in data entry and retrieval as well as errors in the process of communication and coordination (Ash et al, Singh et al).


In the U.S., FDA's MAUDE (Manufacturer and User Facility Device Experience) databasehttp://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfMAUDE/search.CFMreveals many reported EHR problems, some of which could result in patient injury or death http://hcrenewal.blogspot.com/2011/01/maude-and-hit-risk-mother-mary-what-in.html. Both FDA (in the 2010 memo referenced above) and the [[Institute of Medicine]] of the National Academies in a 2011 study http://www.modernhealthcare.com/Assets/pdf/CH76254118.PDF reveal that EHR-related injuries and deaths are real, but the true extent is likely understated, they report, due to numerous factors impeding diffusion of knowledge such as contractual gag and hold harmless clauseshttp://jama.ama-assn.org/content/301/12/1276.extract and lack of familiarity by users of where to report EHR-related adverse events (per aforementioned 2009 FDA internal memo). A Medical Informatics researcher in the U.S. has compiled a well-referenced teaching site that covers unintended consequences of EHRs, health IT project difficulties and failure and related issues{{cite web | last=Silverstein| first=Scot| year=2012 | url=http://www.ischool.drexel.edu/faculty/ssilverstein/cases/ | title=Contemporary Issues in Medical Informatics: Common Examples of Healthcare Information Technology Difficulties| publisher=Drexel University |accessdate=2012-01-26}}.

The literature is conflicting on benefits and harms of EHRs http://hcrenewal.blogspot.com/2011/02/updated-reading-list-on-health-it.html, and as in the Jan. 2009 U.S. National Academies study "COMPUTATIONAL TECHNOLOGY FOR EFFECTIVE HEALTH CARE: IMMEDIATE STEPS AND STRATEGIC DIRECTIONS", EHR's ultimate success will depend upon accelerating interdisciplinary research in biomedical informatics, computer science, social science, and health care engineering.http://www8.nationalacademies.org/onpinews/newsitem.aspx?RecordID=12572

===Regulatory controversy===
FDA's Jeffrey Shuren, MD JD, Director of the [[Center for Devices and Radiological Health]] (CDRH), has explicitly declared EHRs are a medical device.http://healthit.hhs.gov/portal/server.pt/gateway/PTARGS_0_11673_910717_0_0_18/3Shuren_Testimony022510.pdf So has the [[Medical Products Agency (Sweden)]]; Swedish law for medical devices is based on EU Directives.http://www.lakemedelsverket.se/upload/foretag/medicinteknik/en/Medical-Information-Systems-Report_2009-06-18.pdf. In medicine, legal and ethical standards such as the NIH Guidelines for Conduct of Research Involving Human Subjectshttp://ohsr.od.nih.gov/guidelines/index.html and the World Medical Association Declaration Of Helsinkihttp://ohsr.od.nih.gov/guidelines/helsinki.html restrict introduction of new drugs and medical devices without informed consent, and without extensive preclinical and clinical testing and post-marketing surveillance, especially when risks of the technology are unknown. As in the 2011 U.S. [[Institute of Medicine]] study "Health IT and Patient Safety: Building Safer Systems for Better Care"http://www.modernhealthcare.com/Assets/pdf/CH76254118.PDF, there are calls for formal governmental regulation of the technology.


The edit-history comments are quite interesting, where a poster who uses the ID "Barek" keeps deleting all or most of the information on EHR disadvantages, despite indications the material is impeccably sourced and does not draw its own conclusions. Read from bottom to top:


17:29, 27 January 2012‎ Ohnoitsjamie (talk | contribs)‎ (67,826 bytes) (please discuss on talk page, as you are approaching WP:3RR)

17:28, 27 January 2012‎ InformaticsMD (talk | contribs)‎ (76,232 bytes) (clarifying that information comes from the cited sources.)

17:26, 27 January 2012‎ InformaticsMD (talk | contribs)‎ (76,137 bytes) (→Unintended adverse consequences)

17:24, 27 January 2012‎ InformaticsMD (talk | contribs)‎ (76,151 bytes) (If you have factual disageements, let them be known and document the source of your information.)

17:23, 27 January 2012‎ InformaticsMD (talk | contribs)‎ (76,137 bytes) (If you have factual disageements, let them be known and document the source of your information.)

17:18, 27 January 2012‎ InformaticsMD (talk | contribs)‎ (76,122 bytes) (Undid revision 473542684 by Barek (talk). Barek may have a conflict of interest regarding exposure of health IT difficulties.)

17:14, 27 January 2012‎ Barek (talk | contribs)‎ m (67,826 bytes) (Reverted edits by InformaticsMD (talk) to last version by Barek)

17:14, 27 January 2012‎ InformaticsMD (talk | contribs)‎ (76,122 bytes) (→Regulatory controversy)

17:12, 27 January 2012‎ InformaticsMD (talk | contribs)‎ (76,217 bytes) (The added information is factual, well-referenced from impeccable sources, and does not draw conclusions.)

17:08, 27 January 2012‎ Barek (talk | contribs)‎ (67,826 bytes) (→Disadvantages: restore some content after purging WP:SYNTH material)

17:06, 27 January 2012‎ Ohnoitsjamie (talk | contribs)‎ (65,826 bytes) (rv per WP:SYNTH)

17:01, 27 January 2012‎ 108.16.62.235 (talk)‎ (76,341 bytes) (Undid revision 473539844 by Barek (talk))

16:57, 27 January 2012‎ Barek (talk | contribs)‎ (65,826 bytes) (rv - some of that content is usable - but most is pure WP:SYNTH, attempting to draw conclusions rather than simply stating what's in the sources - requires a total re-write to be encyclopedic)

...
20:22, 26 January 2012‎ SarekOfVulcan (talk | contribs)‎ (65,058 bytes) (→Unintended Adverse Consequences: actually, remove whole section - BAD HANDWRITING can result in patient injury and death)

20:21, 26 January 2012‎ SarekOfVulcan (talk | contribs)‎ (65,860 bytes) (→Unintended Adverse Consequences: If it's unknown, we don't need to report it. If it's not a RS, we don't need to report its conclusions. And "a researcher says" isn't notable enough to mention without establishing authority in the subject) (undo)



I note that the logically fallacious "Bad handwriting can cause patient injury and death, so remove whole EHR Unintended Adverse Consequences section" and "if it's unknown, we don't need to report it" [regarding the referenced FDA and IOM observations that the true extent of EHR adverse consequences is unknown -- which is on its face a matter critical to public health and policy - ed.], coming from an editor who ironically calls him/herself "Sarek of Vulcan", offers a prime example of how the utopian concept of tapping "community wisdom" can fall flat on its face.

WP:SYNTH is Wikipedia-talk for "Synthesis of published material that advances a position", i.e., "drawing conclusions." Apparently, when it comes to EHR, citing the work of governmental regulatory and healthcare agencies, expert researchers, etc. is "drawing conclusions."

Wikipedia is essentially open to all, including the HIT industry and its pundits.

It is possible that the Wikipedia editors who keep deleting the material could have some sort of conflict of interest. COI could cause them to find easily-verifiable information from impeccable sources on the Wikipedia EHR page (viewed 22924 times in the last 30 days as of this morning) that refutes common cybernetic legends to be "inconvenient." We've certainly seen that type of person before (link).

This affair may also be another example of the "anechoic effect", the notion we discuss often on this blog that certain topics in medicine and health care 'just aren't talked about', in action.

The 'disadvantages' material, revised, will be re-posted again soon, after my being blocked (for 'reverting', i.e., restoring the material three times in 24 hrs.) expires tomorrow. It will be revised to have as neutral a tone as possible, with exact page numbers where possible, in accordance with written Wikipedia examples. If the additions still disappear, that will be revelatory.

-- SS