Clinical decision support system
This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these template messages)
A clinical decision support system (CDSS) is a health information technology, provides clinicians, staff, patients, or other individuals with knowledge and person-specific information, to help health and health care. CDSS encompasses a variety of tools to enhance decision-making in the clinical workflow. These tools include computerized alerts and reminders to care providers and patients; clinical guidelines; condition-specific order sets; focused patient data reports and summaries; documentation templates; diagnostic support, and contextually relevant reference information, among other tools. A working definition has been proposed by Robert Hayward of the Centre for Health Evidence: "Clinical decision support systems link health observations with health knowledge to influence health choices by clinicians for improved health care". CDSSs constitute a major topic in artificial intelligence in medicine.
A clinical decision support systems is an active knowledge system, which use variables of patient data to produce advice regarding the health case. This implies that a CDSS is simply a decision support system that is focused on using knowledge management.
In the early days, CDSSs were conceived of as being used to literally make decisions for the clinician. The clinician would input the information and wait for the CDSS to output the "right" choice and the clinician would simply act on that output. However, the modern methodology of using CDSSs to assist means that the clinician interacts with the CDSS, utilizing both their own knowledge and the CDSS, to make a better analysis of the patient's data than either human or CDSS could make on their own. Typically, a CDSS makes suggestions for the clinician to look through, and the clinician is expected to pick out useful information from the presented results and discount erroneous CDSS suggestions.
The two main types of CDSS are knowledge-based and non-knowledge-based :
An example of how a clinical decision support system might be used by a clinician is a diagnosis decision support system (DDSS). A DDSS requests some of the patients data and in response, proposes a set of appropriate diagnoses. The physician then takes the output of the DDSS and determines which diagnoses might be relevant and which are not, and if necessary orders further tests to narrow down the diagnosis.
Another example of a CDSS would be a case-based reasoning (CBR) system. A CBR system might use previous case data to help determine the appropriate amount of beams and the optimal beam angles for use in radiotherapy for brain cancer patients; medical physicists and oncologists would then review the recommended treatment plan to determine its viability.
Another important classification of a CDSS is based on the timing of its use. Physicians use these systems at point of care to help them as they are dealing with a patient, with the timing of use being either pre-diagnosis, during diagnosis, or post diagnosis. Pre-diagnosis CDSS systems are used to help the physician prepare the diagnoses. CDSS used during diagnosis help review and filter the physician's preliminary diagnostic choices to improve their final results. Post-diagnosis CDSS systems are used to mine data to derive connections between patients and their past medical history and clinical research to predict future events. As of 2012 it has been claimed that decision support will begin to replace clinicians in common tasks in the future.
Another approach, used by the National Health Service in England, is to use a DDSS to triage medical conditions out of hours by suggesting a suitable next step to the patient (e.g. call an ambulance, or see a general practitioner on the next working day). The suggestion, which may be disregarded by either the patient or the phone operative if common sense or caution suggests otherwise, is based on the known information and an implicit conclusion about what the worst-case diagnosis is likely to be; it is not always revealed to the patient, because it might well be incorrect and is not based on a medically-trained person's opinion - it is only used for initial triage purposes.
Most CDSSs consist of three parts: the knowledge base, an inference engine, and a mechanism to communicate. The knowledge base contains the rules and associations of compiled data which most often take the form of IF-THEN rules. If this was a system for determining drug interactions, then a rule might be that IF drug X is taken AND drug Y is taken THEN alert user. Using another interface, an advanced user could edit the knowledge base to keep it up to date with new drugs. The inference engine combines the rules from the knowledge base with the patient's data. The communication mechanism allows the system to show the results to the user as well as have input into the system.
An expression language such as GELLO[clarification needed] or CQL (Clinical Quality Language) is needed for expressing knowledge artifacts in a computable manner. For example: if a patient has diabetes mellitus, and if the last hemoglobin A1c test result was less than 7%, recommend re-testing if it has been over 6 months, but if the last test result was greater than or equal to 7%, then recommend re-testing if it has been over 3 months.
The current focus of the HL7 CDS WG is to build on the Clinical Quality Language (CQL). The U.S. Centers for Medicare & Medicaid Services (CMS) has announced that it plans to use CQL for the specification of Electronic Clinical Quality Measures (eCQMs).
CDSSs which do not use a knowledge base use a form of artificial intelligence called machine learning, which allow computers to learn from past experiences and/or find patterns in clinical data. This eliminates the need for writing rules and for expert input. However, since systems based on machine learning cannot explain the reasons for their conclusions, most clinicians do not use them directly for diagnoses, for reliability and accountability reasons. Nevertheless, they can be useful as post-diagnostic systems, for suggesting patterns for clinicians to look into in more depth.
- Artificial neural networks use nodes and weighted connections between them to analyse the patterns found in patient data to derive associations between symptoms and a diagnosis.
- Genetic algorithms are based on simplified evolutionary processes using directed selection to achieve optimal CDSS results. The selection algorithms evaluate components of random sets of solutions to a problem. The solutions that come out on top are then recombined and mutated and run through the process again. This happens over and over until the proper solution is discovered. They are functionally similar to neural networks in that they are also "black boxes" that attempt to derive knowledge from patient data.
- Non-knowledge-based networks often focus on a narrow list of symptoms, such as symptoms for a single disease, as opposed to the knowledge based approach which cover the diagnosis of many different diseases.
An example of a non-knowledge-based CDSS is a webserver developed using support vector machine for the prediction of gestational diabetes in Ireland. 
With the enactment of the American Recovery and Reinvestment Act of 2009 (ARRA), there is a push for widespread adoption of health information technology through the Health Information Technology for Economic and Clinical Health Act (HITECH). Through these initiatives, more hospitals and clinics are integrating electronic medical records (EMRs) and computerized physician order entry (CPOE) within their health information processing and storage. Consequently, the Institute of Medicine (IOM) promoted usage of health information technology including clinical decision support systems to advance quality of patient care. The IOM had published a report in 1999, To Err is Human, which focused on the patient safety crisis in the United States, pointing to the incredibly high number of deaths. This statistic attracted great attention to the quality of patient care.
With the enactment of the HITECH Act included in the ARRA, encouraging the adoption of health IT, more detailed case laws for CDSS and EMRs are still[when?] being defined by the Office of National Coordinator for Health Information Technology (ONC) and approved by Department of Health and Human Services (HHS). A definition of "Meaningful use" is yet to be published.[clarification needed]
Despite the absence of laws, the CDSS vendors would almost certainly be viewed as having a legal duty of care to both the patients who may adversely be affected due to CDSS usage and the clinicians who may use the technology for patient care.[clarification needed] However, duties of care legal regulations are not explicitly defined yet.
The evidence of the effectiveness of CDSS is mixed. There are certain disease entities, which benefit more from CDSS than other disease entities. A 2018 systematic review identified six medical conditions, in which CDSS improved patient outcomes in hospital settings, including: blood glucose management, blood transfusion management, physiologic deterioration prevention, pressure ulcer prevention, acute kidney injury prevention, and venous thromboembolism prophylaxis. A 2014 systematic review did not find a benefit in terms of risk of death when the CDSS was combined with the electronic health record. There may be some benefits, however, in terms of other outcomes. A 2005 systematic review had concluded that CDSSs improved practitioner performance in 64% of the studies and patient outcomes in 13% of the studies. CDSSs features associated with improved practitioner performance included automatic electronic prompts rather than requiring user activation of the system.
A 2005 systematic review found... "Decision support systems significantly improved clinical practice in 68% of trials." The CDSS features associated with success included integration into the clinical workflow rather than as a separate log-in or screen., electronic rather than paper-based templates, providing decision support at the time and location of care rather than prior and providing recommendations for care.
However, later systematic reviews were less optimistic about the effects of CDS, with one from 2011 stating "There is a large gap between the postulated and empirically demonstrated benefits of [CDSS and other] eHealth technologies ... their cost-effectiveness has yet to be demonstrated".
A 5-year evaluation of the effectiveness of a CDSS in implementing rational treatment of bacterial infections was published in 2014; according to the authors, it was the first long-term study of a CDSS.
Challenges to adoption
Much effort has been put forth by many medical institutions and software companies to produce viable CDSSs to support all aspects of clinical tasks. However, with the complexity of clinical workflows and the demands on staff time high, care must be taken by the institution deploying the support system to ensure that the system becomes a fluid and integral part of the clinical workflow. Some CDSSs have met with varying amounts of success, while others have suffered from common problems preventing or reducing successful adoption and acceptance.
Two sectors of the healthcare domain in which CDSSs have had a large impact are the pharmacy and billing sectors. There are commonly used pharmacy and prescription ordering systems that now perform batch-based checking of orders for negative drug interactions and report warnings to the ordering professional. Another sector of success for CDSS is in billing and claims filing. Since many hospitals rely on Medicare reimbursements to stay in operation, systems have been created to help examine both a proposed treatment plan and the current rules of Medicare in order to suggest a plan that attempts to address both the care of the patient and the financial needs of the institution.
Other CDSSs that are aimed at diagnostic tasks have found success, but are often very limited in deployment and scope. The Leeds Abdominal Pain System went operational in 1971 for the University of Leeds hospital, and was reported to have produced a correct diagnosis in 91.8% of cases, compared to the clinicians' success rate of 79.6%.
Despite the wide range of efforts by institutions to produce and use these systems, widespread adoption and acceptance has still not yet been achieved for most offerings. One large roadblock to acceptance has historically been workflow integration. A tendency to focus only on the functional decision making core of the CDSS existed, causing a deficiency in planning for how the clinician will actually use the product in situ. Often CDSSs were stand-alone applications, requiring the clinician to cease working on their current system, switch to the CDSS, input the necessary data (even if it had already been inputted into another system), and examine the results produced. The additional steps break the flow from the clinician's perspective and cost precious time.
Technical challenges and barriers to implementation
Clinical decision support systems face steep technical challenges in a number of areas. Biological systems are profoundly complicated, and a clinical decision may utilize an enormous range of potentially relevant data. For example, an electronic evidence-based medicine system may potentially consider a patient's symptoms, medical history, family history and genetics, as well as historical and geographical trends of disease occurrence, and published clinical data on medicinal effectiveness when recommending a patient's course of treatment.
Clinically, a large deterrent to CDSS acceptance is workflow integration.
While it has been shown that clinicians require explanations of Machine Learning-Based CDSS, in order to able to understand and trust their suggestions, there is an overall distinct lack of application of explainable Artificial Intelligence in the context of CDSS, thus adding another barrier to the adoption of these systems.
Another source of contention with many medical support systems is that they produce a massive number of alerts. When systems produce high volume of warnings (especially those that do not require escalation), aside from the annoyance, clinicians may pay less attention to warnings, causing potentially critical alerts to be missed.
One of the core challenges facing CDSS is difficulty in incorporating the extensive quantity of clinical research being published on an ongoing basis. In a given year, tens of thousands of clinical trials are published. Currently, each one of these studies must be manually read, evaluated for scientific legitimacy, and incorporated into the CDSS in an accurate way. In 2004, it was stated that the process of gathering clinical data and medical knowledge and putting them into a form that computers can manipulate to assist in clinical decision-support is "still in its infancy".
Nevertheless, it is more feasible for a business to do this centrally, even if incompletely, than for each individual doctor to try to keep up with all the research being published.
In addition to being laborious, integration of new data can sometimes be difficult to quantify or incorporate into the existing decision support schema, particularly in instances where different clinical papers may appear conflicting. Properly resolving these sorts of discrepancies is often the subject of clinical papers itself (see meta-analysis), which often take months to complete.
In order for a CDSS to offer value, it must demonstrably improve clinical workflow or outcome. Evaluation of CDSS is the process of quantifying its value to improve a system's quality and measure its effectiveness. Because different CDSSs serve different purposes, there is no generic metric which applies to all such systems; however, attributes such as consistency (with itself, and with experts) often apply across a wide spectrum of systems.
The evaluation benchmark for a CDSS depends on the system's goal: for example, a diagnostic decision support system may be rated based upon the consistency and accuracy of its classification of disease (as compared to physicians or other decision support systems). An evidence-based medicine system might be rated based upon a high incidence of patient improvement, or higher financial reimbursement for care providers.
Combining with electronic health records
Implementing EHRs was an inevitable challenge. The reasons behind this challenge are that it is a relatively uncharted area, and there are many issues and complications during the implementation phase of an EHR. This can be seen in the numerous studies that have been undertaken. However, challenges in implementing electronic health records (EHRs) have received some attention, but less is known about the process of transitioning from legacy EHRs to newer systems.
EHRs are a way to capture and utilise real-time data to provide high-quality patient care, ensuring efficiency and effective use of time and resources. Incorporating EHR and CDSS together into the process of medicine has the potential to change the way medicine has been taught and practiced. It has been said that "the highest level of EHR is a CDSS".
Since "clinical decision support systems (CDSS) are computer systems designed to impact clinician decision making about individual patients at the point in time that these decisions are made", it is clear that it would be beneficial to have a fully integrated CDSS and EHR.
Even though the benefits can be seen, to fully implement a CDSS that is integrated with an EHR has historically required significant planning by the healthcare facility/organisation, in order for the purpose of the CDSS to be successful and effective. The success and effectiveness can be measured by the increase in patient care being delivered and reduced adverse events occurring. In addition, there would be a saving of time and resources, and benefits in terms of autonomy and financial benefits to the healthcare facility/organisation.
Benefits of CDSS combined with EHR
A successful CDSS/EHR integration will allow the provision of best practice, high quality care to the patient, which is the ultimate goal of healthcare.
Errors have always occurred in healthcare, so trying to minimise them as much as possible is important in order to provide quality patient care. Three areas that can be addressed with the implementation of CDSS and Electronic Health Records (EHRs), are:
- Medication prescription errors
- Adverse drug events
- Other medical errors
CDSSs will be most beneficial in the future when healthcare facilities are "100% electronic" in terms of real-time patient information, thus simplifying the number of modifications that have to occur to ensure that all the systems are up to date with each other.
The measurable benefits of clinical decision support systems on physician performance and patient outcomes remain the subject of ongoing research.
Implementing electronic health records (EHR) in healthcare settings incurs challenges; none more important than maintaining efficiency and safety during rollout, but in order for the implementation process to be effective, an understanding of the EHR users' perspectives is key to the success of EHR implementation projects. In addition to this, adoption needs to be actively fostered through a bottom-up, clinical-needs-first approach. The same can be said for CDSS.
As of 2007, the main areas of concern with moving into a fully integrated EHR/CDSS system have been:
- Document accuracy and completeness
- Alert desensitisation
as well as the key aspects of data entry that need to be addressed when implementing a CDSS to avoid potential adverse events from occurring. These aspects include whether:
- correct data is being used
- all the data has been entered into the system
- current best practice is being followed
- the data is evidence-based[clarification needed]
Status in Australia
As of July 2015, the planned transition to EHRs in Australia is facing difficulties. The majority of healthcare facilities are still running completely paper-based systems, and some are in a transition phase of scanned EHRs, or are moving towards such a transition phase.
Victoria has attempted to implement EHR across the state with its HealthSMART program, but due to unexpectedly high costs it has cancelled the project.
South Australia (SA) however is slightly more successful than Victoria in the implementation of an EHR. This may be due to all public healthcare organisations in SA being centrally run.
(However, on the other hand, the UK's National Health Service is also centrally administered, and its National Programme for IT in the 2000s, which included EHRs in its remit, was an expensive disaster.)
SA is in the process of implementing "Enterprise patient administration system (EPAS)". This system is the foundation for all public hospitals and health care sites for an EHR within SA and it was expected that by the end of 2014 all facilities in SA will be connected to it. This would allow for successful integration of CDSS into SA and increase the benefits of the EHR. By July 2015 it was reported that only 3 out of 75 health care facilities implemented EPAS.
With the largest health system in the country and a federated rather than centrally administered model, New South Wales is making consistent progress towards statewide implementation of EHRs. The current iteration of the state's technology, eMR2, includes CDSS features such as a sepsis pathway for identifying at-risk patients based upon data input to the electronic record. As of June 2016, 93 of 194 sites in-scope for the initial roll-out had implemented eMR2
Status in Finland
The EBMEDS Clinical Decision Support service provided by Duodecim Medical Publications Ltd is used by more than 60% of Finnish public health care doctors.
- Gello Expression Language
- International Health Terminology Standards Development Organisation
- Medical algorithm
- Medical informatics
- Personal Health Information Protection Act (a law in force in Ontario)
- Treatment decision support (decision support tools for patients)
- Artificial intelligence in healthcare
- A Prospective Medical System of the Future /A complete health care system
- "CDSS". www.ebmconnect.com. Retrieved 2 February 2021.
- Berner, Eta S., ed. Clinical Decision Support Systems. New York, NY: Springer, 2007.
- "Decision support systems ." 26 July 2005. 17 Feb. 2009 <.
- Begum, Shahina; Ahmed, Mobyen Uddin; Funk, Peter; Xiong, Ning; Folke, Mia (July 2011). "Case-based reasoning systems in the health sciences: a survey of recent trends and developments". IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews. 41 (4): 421–434. doi:10.1109/TSMCC.2010.2071862. S2CID 22441650.
- Khussainova, Gulmira; Petrovic, Sanja; Jagannathan, Rupa (2015). "Retrieval with clustering in a case-based reasoning system for radiotherapy treatment planning". Journal of Physics: Conference Series. 616 (1): 012013. Bibcode:2015JPhCS.616a2013K. doi:10.1088/1742-6596/616/1/012013. ISSN 1742-6596.
- Khosla, Vinod (4 December 2012). "Technology will replace 80% of what doctors do". CNN. Archived from the original on 28 March 2013. Retrieved 25 April 2013.
- Peyman., Dehghani Soufi, Mahsa. Samad-Soltani, Taha. Shams Vahdati, Samad. Rezaei-Hachesu. Decision support system for triage management: A hybrid approach using rule-based reasoning and fuzzy logic. OCLC 1051933713.
- "HL7 CDS Standards". HL7 CDS Working Group. Retrieved 25 June 2019.
- CQL - Clinical Quality Language eCQI Resource Center, accessed 15 February 2022
- Spie (March 2015). "Tanveer Syeda-Mahmood plenary talk: The Role of Machine Learning in Clinical Decision Support". SPIE Newsroom. doi:10.1117/2.3201503.29.
- Wagholikar, Kavishwar; V. Sundararajan; Ashok Deshpande (2012). "Modeling Paradigms for Medical Diagnostic Decision Support: A Survey and Future Directions". Journal of Medical Systems. 36 (5): 3029–3049. doi:10.1007/s10916-011-9780-4. PMID 21964969. S2CID 14509743.
- Du, Yuhan; Rafferty, Anthony R.; McAuliffe, Fionnuala M.; Wei, Lan; Mooney, Catherine (21 January 2022). "An explainable machine learning-based clinical decision support system for prediction of gestational diabetes mellitus". Scientific Reports. 12 (1): 1170. doi:10.1038/s41598-022-05112-2.
- Medicine, Institute of (28 February 2001). Crossing the Quality Chasm: A New Health System for the 21st Century. doi:10.17226/10027. ISBN 978-0-309-46561-8. PMID 25057539.
- Varghese, J; Kleine, M; Gessner, SI; Sandmann, S; Dugas, M (May 2018). "Effects of computerized decision support system implementations on patient outcomes in inpatient care: a systematic review". Journal of the American Medical Informatics Association. 25 (5): 593–602. doi:10.1093/jamia/ocx100. PMC 7646949. PMID 29036406.
- Moja, L; Kwag, KH; Lytras, T; Bertizzolo, L; Brandt, L; Pecoraro, V; Rigon, G; Vaona, A; Ruggiero, F; Mangia, M; Iorio, A; Kunnamo, I; Bonovas, S (December 2014). "Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis". American Journal of Public Health. 104 (12): e12–22. doi:10.2105/ajph.2014.302164. PMC 4232126. PMID 25322302.
- Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, et al. (2005). "Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review". JAMA. 293 (10): 1223–38. doi:10.1001/jama.293.10.1223. PMID 15755945.
- Kensaku Kawamoto; Caitlin A Houlihan; E Andrew Balas; David F Lobach. (2005). "Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success". BMJ. 330 (7494): 765. doi:10.1136/bmj.38398.500764.8F. PMC 555881. PMID 15767266.
- Black, A.D.; Car, J.; Pagliari, C.; Anandan, C.; Cresswell, K.; Bokun, T.; McKinstry, B.; Procter, R.; Majeed, A.; Sheikh, A. (18 January 2011). "The impact of ehealth on the quality and safety of health care: A systematic overview". PLOS Medicine. 8 (1): e1000387. doi:10.1371/journal.pmed.1000387. PMC 3022523. PMID 21267058.
- Nachtigall, I; Tafelski, S; Deja, M; Halle, E; Grebe, M C; Tamarkin, A; Rothbart, A; Unrig, A; Meyer, E; Musial-Bright, L; Wernecke, K D; Spies, C (22 December 2014). "Long-term effect of computer-assisted decision support for antibiotic treatment in critically ill patients: a prospective 'before/after' cohort study". BMJ Open. 4 (12): e005370. doi:10.1136/bmjopen-2014-005370. PMC 4275685. PMID 25534209.
- National Academy of Medicine (2018). "Optimizing Strategies for Clinical Decision Support" (PDF). Healthit.gov. Archived (PDF) from the original on 23 April 2018. Retrieved 2 February 2021.
- Tonekaboni, Sana; Joshi, Shalmali; McCradden, Melissa D.; Goldenberg, Anna (28 October 2019). "What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Use". Machine Learning for Healthcare Conference. PMLR: 359–380.
- Antoniadi, Anna Markella; Du, Yuhan; Guendouz, Yasmine; Wei, Lan; Mazo, Claudia; Becker, Brett A.; Mooney, Catherine (31 May 2021). "Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review". Applied Sciences. 11 (11): 5088. doi:10.3390/app11115088. ISSN 2076-3417.
- Gluud C, Nikolova D (2007). "Likely country of origin in publications on randomised controlled trials and controlled clinical trials during the last 60 years". Trials. 8: 7. doi:10.1186/1745-6215-8-7. PMC 1808475. PMID 17326823.
- Gardner, Reed M (April 2004). "Computerized Clinical Decision-Support in Respiratory Care". Respiratory Care. 49 (4): 378–388. PMID 15030611.
- Wagholikar, K; Kathy L. MacLaughlin; Thomas M Kastner; Petra M Casey; Michael Henry; Robert A Greenes; Hongfang Liu; Rajeev Chaudhry (2013). "Formative evaluation of the accuracy of a clinical decision support system for cervical cancer screening". Journal of the American Medical Informatics Association. 20 (4): 747–759. doi:10.1136/amiajnl-2013-001613. PMC 3721177. PMID 23564631.
- Zandieh, Stephanie O.; Kahyun Yoon-Flannery; Gilad J. Kuperman; Daniel J. Langsam; Daniel Hyman; Rainu Kaushal (2008). "Challenges to EHR Implementation in Electronic- Versus Paper-based Office Practices". Journal of Global Information Management. 23 (6): 755–761. doi:10.1007/s11606-008-0573-5. PMC 2517887. PMID 18369679.
- Berner, Eta S.; Tonya J.La Lande (2007). "1". Clinical Decision Support Systems: Theory and Practice (2 ed.). New York: Springer Science and Business Media. pp. 3–22.
- Rothman, Brian; Joan. C. Leonard; Michael. M. Vigoda (2012). "Future of electronic health records: implications for decision support". Mount Sinai Journal of Medicine. 79 (6): 757–768. doi:10.1002/msj.21351. PMID 23239213.
- Sambasivan, Murali; Pouyan Esmaeilzadeh; Naresh Kumar; Hossein Nezakati (2012). "Intention to adopt clinical decision support systems in a developing country: effect of Physician's perceived professional autonomy, involvement and belief: a cross-sectional study". BMC Medical Informatics and Decision Making. 12: 142–150. doi:10.1186/1472-6947-12-142. PMC 3519751. PMID 23216866.
- Spellman Kennebeck, Stephanie; Nathan Timm; Michael K Farrell; S Andrew Spooner (2012). "Impact of electronic health record implementation on patient flow metrics in a pediatric emergency department". Journal of the American Medical Informatics Association. 19 (3): 443–447. doi:10.1136/amiajnl-2011-000462. PMC 3341791. PMID 22052897.
- McGinn, Carrie Anna; Gagnon, Marie-Pierre; Shaw, Nicola; Sicotte, Claude; Mathieu, Luc; Leduc, Yvan; Grenier, Sonya; Duplantie, Julie; Abdeljelil, Anis Ben; Légaré, France (11 September 2012). "Users' perspectives of key factors to implementing electronic health records in Canada: a Delphi study". BMC Medical Informatics and Decision Making. 12 (1): 105. doi:10.1186/1472-6947-12-105. ISSN 1472-6947. PMC 3470948. PMID 22967231.
- Rozenblum, R.; Jang, Y.; Zimlichman, E.; Salzberg, C.; Tamblyn, M.; Buckeridge, D.; Forster, A.; Bates, D. W.; Tamblyn, R. (22 February 2011). "A qualitative study of Canada's experience with the implementation of electronic health information technology". Canadian Medical Association Journal. 183 (5): E281–E288. doi:10.1503/cmaj.100856. ISSN 0820-3946. PMC 3060213. PMID 21343262.
- Berner, Eta S.; Tonya J.La Lande (2007). "4". Clinical Decision Support Systems: Theory and Practice (2 ed.). New York: Springer Science and Business Media. pp. 64–98.
- Loya, S. R.; Kawamoto, K; Chatwin, C; Huser, V (2014). "Service oriented architecture for clinical decision support: A systematic review and future directions". Journal of Medical Systems. 38 (12): 140. doi:10.1007/s10916-014-0140-z. PMC 5549949. PMID 25325996.
- Charette, Robert N. (21 May 2012). "Troubled HealthSMART System Finally Cancelled in Victoria Australia". Retrieved 18 May 2013.
- "EPAS program update". South Australian Health. Retrieved 15 May 2013.
- Hospital beds to be cut by 840, South Australian Opposition calculates, but SA Health denies figure set www.abc.net.au as accessed on 26 July 2015
- The eMR turns 10. "eHealth News" (PDF). Retrieved 6 August 2016.
- "EBMEDS Clinical Decision Support". EBMEDS. Retrieved 12 February 2022.
- Duodecim EBMEDS Clinical Decision Support
- Decision support chapter from Coiera's Guide to Health Informatics
- OpenClinical Archived 2 February 2020 at the Wayback Machine maintains an extensive archive of Artificial Intelligence systems in routine clinical use.
- Robert Trowbridge/ Scott Weingarten. Chapter 53. Clinical Decision Support Systems
- Stanford CDSS