Evaluation of computerized provider order entry systems

Assessing the usability of systems for electronic prescription

Authors

  • Reza Rabie Ph.D. in Medical Informatics, Assistant Professor, Department of Health Information Technology and Management, Faculty of Paramedical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran

Keywords:

Computerized Provider Order Entry (CPOE), Electronic Prescribing, Medical Order Entry Systems, Usability

Abstract

Background: The field of medicine has been influenced by the growth and development of information systems such as the Computerized Provider Order Entry (CPOE) System.  Objective: This study aimed to evaluate the usability of CPOE systems for electronic prescription in Tehran, Iran.  Methods: This was an evaluation study conducted in 2017. The research population consisted of the CPOE systems used in hospitals of Tehran (Iran) and nurses who had access to, and used, the CPOE systems. Five hospitals with CPOE systems were included in the research sample. The data were collected using a questionnaire, and included a total of 50 questions. The questionnaires were distributed among 254 nurses who were the users of the systems. Data analysis was performed by IBM-SPSS version 21, using independent-samples t-test. A p-value of ≤0.05 was considered statistically significant. Results: Among the four aspects assessed, the “user-friendliness” (3.87±0.59) had the highest mean score. The lowest mean score (2.01±0.58) was related to the “decision support” feature of the systems. The highest and lowest mean scores for “prescription support” criterion belonged to system E (3.26±0.23) and system C (1.90±0.16), respectively. There was a statistically significant difference between the usability of the systems used in the private and the public hospitals (p<0.001). It was found that the CPOE systems in private hospitals had a higher level of usability (3.42+0.10) compared to those in public hospitals (2.91+0.25).  Conclusion: Two main functions of the studied CPOE systems i.e., decision support and prescription support should be developed to make electronic prescription safer and more intuitive. Addressing usability aspects of CPOE systems in practice could improve the usability of these systems for prescription.

References

Aggelidis VP, Chatzoglou PD. Hospital information systems: measuring end user computing satisfaction

[EUCS]. J Biomed Inform. 2014; 45(3): 566-79. doi: 10.1016/j.jbi.2012.02.009. PMID: 22426283.

Cho I, Lee JH, Choi SK, Choi JW, Hwang H, Bates DW. Acceptability and feasibility of the Leapfrog

computerized physician order entry evaluation tool for hospitals outside the United States. Int J Med

Inform. 2015; 84(9): 694-701. doi: 10.1016/j.ijmedinf.2015.05.011. PMID: 26049311.

Lainer M, Mann E, Sönnichsen A. Information technology interventions to improve medication safety in

primary care: a systematic review. Int J Qual Health Care. 2013; 25(5): 590-8. doi: 10.1093/intqhc/mzt043.

PMID: 23771745.

Pelayo S, Anceaux F, Rogalski J, Elkin P, Beuscart-Zephir MC. A comparison of the impact of CPOE

implementation and organizational determinants on doctor–nurse communications and cooperation. Int J

Med Inform. 2013; 82(12): 321-30. doi: 10.1016/j.ijmedinf.2012.09.001. PMID: 22999779.

Kazemi A, Ellenius J, Tofighi S, Salehi A, Eghbalian F, Fors UG. CPOE in Iran—A viable prospect?

Physicians’ opinions on using CPOE in an Iranian teaching hospital. Int J Med Inform. 2009; 78(3): 199- 207. doi: 10.1016/j.ijmedinf.2008.07.004. PMID: 18760960.

Osheroff J, Teich J, Levick D, Saldana L, Velasco F, Sittig D, et al. improving outcomes with clinical

decision support: an implementer's guide. 2nd Ed. 2012. HIMSS Publishing.

Kruse CS, Goetz K. Summary and frequency of barriers to adoption of CPOE in the US. J Med Syst. 2015;

(2): 15-20. doi: 10.1007/s10916-015-0198-2. PMID: 25638719, PMCID: PMC4312581.

Kaushal R, Jha AK, Franz C, Glaser J, Shetty KD, Jaggi T, et al. Return on investment for a computerized

physician order entry system. J Am Med Inform Assoc. 2006; 13(3): 261-6. doi: 10.1197/jamia.M1984.

PMID: 16501178, PMCID: PMC1513660.

Abramson EL, Kaushal R. Computerized provider order entry and patient safety. Pediatr Clin North Am.

; 59(6): 1247-55. doi: 10.1016/j.pcl.2012.08.001. PMID: 23116522.

Jozefczyk KG, Kennedy WK, Lin MJ, Achatz J, Glass MD, Eidam WS, et al. Computerized prescriber

order entry and opportunities for medication errors: comparison to tradition paper-based order entry. J

Pharm Pract. 2013; 26(4):434-7. doi: 10.1177/0897190012465982. PMID: 23462046.

Radley DC, Wasserman MR, Olsho LE, Shoemaker SJ, Spranca MD, Bradshaw B. Reduction in

medication errors in hospitals due to adoption of computerized provider order entry systems. J Am Med

Inform Assoc. 2013; 20(3): 470-6. doi: 10.1136/amiajnl-2012-001241. PMID: 23425440, PMCID:

PMC3628057.

De Keizer N, Talmon J, Ammenwerth E, Brender J, Rigby M, Nykänen P. Systematic prioritization of the

STARE-HI reporting items. Methods Inf Med. 2012; 51(2): 104-11. doi: 10.3414/ME10-01-0072. PMID:

Harrington L, Hardison Van L, Wickham V, Norris B, Kane M. Computerized Provider Order Entry

(CPOE): important nontechnical issues and considerations. Nurse Leader. 2014; 12(3): 54-7. doi:

1016/j.mnl.2014.03.002.

Balina HB, Sanniyasi S, George D, Jemimah KN, Ravichandran GD, Kannan G. Development of

computerized physician order entry with decision support system and preconceived physician attitude

towards CPOE by end user satisfaction. World J Pharm Sci. 2015; 2321-3310.

Yen K, Shane EL, Pawar SS, Schwendel ND, Zimmanck RJ, Gorelick MH. Time motion study in a

pediatric emergency department before and after computer physician order entry. Ann Emerg Med. 2009;

(4): 462-8. doi: 10.1016/j.annemergmed.2008.09.018. PMID: 19026466.

Shortliffe EH, Cimino JJ. Biomedical informatics: computer applications in health care and biomedicine.

th Ed. 2014. Springer.

American Society of Health-System Pharmacists. ASHP Guidelines on pharmacy planning for

implementation of Computerized Provider-Order Entry Systems in hospitals and health systems. Am J

Health Syst Pharm. 2011; 68(6): 9-31. doi: 10.2146/sp100011e. PMID: 21378288.

Khajouei R, Wierenga P, Hasman A, Jaspers MW. Clinicians’ satisfaction with CPOE ease of use and

effect on clinicians’ workflow, efficiency and medication safety. Int J Med Inform. 2011; 80(5): 297-309.

doi: 10.1016/j.ijmedinf.2011.02.009. PMID: 21419695.

Fumis RRL, Costa ELV, Martins PS, Pizzo V, Souza IA, Schettino GdPP. Is the ICU staff satisfied with

the computerized physician order entry? A cross-sectional survey study. Rev Bras Ter Intensiva. 2014;

(1): 1-6. PMID: 24770682, PMCID: PMC4031891.

Hagstedt L, Rudebeck C, Petersson Gr. Usability of computerised physician order entry in primary care:

assessing ePrescribing with a new evaluation model. Inform Prim Care. 2011; 19(3): 161-8. PMID:

Cresswell KM, Bates DW, Williams R, Morrison Z, Slee A, Coleman J, et al. Evaluation of medium-term

consequences of implementing commercial computerized physician order entry and clinical decision

support prescribing systems in two ‘early adopter’hospitals. J Am Med Inform Assoc. 2014; 21(2): 194- 202. doi: 10.1136/amiajnl-2013-002252. PMID: 24431334, PMCID: PMC4173168.

Gouyon B, Iacobelli S, Saliba E, Quantin C, Pignolet A, Jacqz-Aigrain E, et al. A Computer Prescribing

Order Entry–Clinical Decision Support system designed for neonatal care: results of the ‘preselected

prescription’concept at the bedside. J Clin Pharm Ther. 2017; 42(1): 64-8. doi: 10.1111/jcpt.12474. PMID:

, PMCID: PMC4096499.

Nuckols TK, Smith-Spangler C, Morton SC, Asch SM, Patel VM, Anderson LJ, et al. The effectiveness of

computerized order entry at reducing preventable adverse drug events and medication errors in hospital

settings: a systematic review and meta-analysis. Syst Rev. 2014; 4(3): 56. doi: 10.1186/2046-4053-3-56.

PMID: 24894078, PMCID: PMC4096499.

Armada ER, Villamañán E, López-de-Sá E, Rosillo S, Rey-Blas JR, Testillano ML,et al. Computerized

physician order entry in the cardiac intensive care unit: effects on prescription errors and workflow

conditions. J Crit Care. 2014; 29(2): 188-93. doi: 10.1016/j.jcrc.2013.10.016. PMID: 24287174.

Chan J1, Shojania KG, Easty AC, Etchells EE. Stability evaluation of order sets in a computerized provider

order entry system. BMJ Qual Saf. 2011; 20(11): 932-40. doi: 10.1136/bmjqs.2010.050021. PMID:

Eslami S, Abu-Hanna A, De Keizer NF. Evaluation of outpatient computerized physician medication order

entry systems: a systematic review. J Am Med Inform Assoc. 2007; 14(14): 400-406. doi:

1197/jamia.M2238. PMID: 17460137, PMCID: PMC2244893.

Ferrández O, Urbina O, Grau S, Mateu-de-Antonio J, Marin-Casino M, Portabella J, et al. Computerized

pharmacy surveillance and alert system for drug-related problems. J Clin Pharm Ther. 2017; 42(2): 201-8.

doi: 10.1111/jcpt.12495. PMID: 28078665. 28) Pevnick JM, Herzik AJ, Li X, Chen I, Chithriki M, Jim L, et al. Effect of computerized physician order

entry on imaging study indication. J Am Coll Radiol. 2015; 12(1): 70-74. doi: 10.1016/j.jacr.2014.07.028.

PMID: 25557572, PMCID: PMC4284426.

Vermeulen K, van Doormaal JE, Zaal RJ, Mol PG, Lenderink A, Haaijer-Ruskamp FM, et al. Cost- effectiveness of an electronic medication ordering system (CPOE/CDSS) in hospitalized patients. Int J Med

Inform. 2014; 83(8): 572-580. doi: 10.1016/j.ijmedinf.2014.05.003. PMID: 24929633.

Maat B, Rademaker CM, Oostveen MI, Krediet TG, Egberts TC, Bollen CW. The effect of a computerized

prescribing and calculating system on hypo-and hyperglycemias and on prescribing time efficiency in

neonatal intensive care patients. JPEN J Parenter Enteral Nutr. 2013; 37(1): 85-91. doi:

1177/0148607112444608. PMID: 22535919.

Published

2021-12-24