Jump to content

Expert system

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Mdebellis (talk | contribs) at 00:45, 7 December 2013 (Changed wording of intro, made less wordy, more precise.). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

In artificial intelligence, an expert system is a computer system that emulates the decision-making ability of a human expert.[1] Expert systems are designed to solve complex problems by reasoning about knowledge, represented primarily as IF-THEN rules rather than through conventional procedural code.[2][3][4] The first expert systems were created in the 1970s and then proliferated in the 1980s.[5] Expert systems were among the first truly successful forms of AI software.[6][7][8][9][10][11]

An expert system is divided into two sub-systems: the inference engine and the knowledge base. The knowledge base represents facts about the world and rules. The inference engine applies the rules to the known facts to deduce new facts. Inference engines can also include explanation and debugging capabilities.[12]

History

Hayes-Roth expressed the key insight of early expert systems to be that intelligent systems derive their power from the knowledge they possess rather than from the specific formalisms and inference schemes they use. Although, in retrospect this seems a rather straight forward insight at the time in the history of Artificial Intelligence it was a significant step forward. Up until that point research had been focused on attempts to develop very general purpose problem solvers such as those described by Newell and Simon.[13]

Expert systems were introduced by the Stanford Heuristic Programming Project led by Edward Feigenbaum who is sometimes referred to as the "father of expert systems". The Stanford researchers tried to identify domains where expertise was highly valued and complex such as diagnosing infectious diseases (Mycin) and identifying unknown organic molecules (Dendral)

In addition to Feigenbaum key early contributors were Bruce Buchanan, Edward Shortliffe, Randall Davis, William vanMelle, and Carli Scott. Expert systems were among the first truly successful forms of AI software.[6][7][8][9][10][11]

Research on expert systems was also active in France. In the US the focus tended to be on rule-based systems, first on systems hard coded on top of LISP programming environments and then on expert system shells developed by vendors such as Intellicorp. In France research focused more on systems developed in Prolog. The advantage of expert system shells was that they were somewhat easier for non-programmers to use. The advantage of Prolog environments was that they weren't focused only on IF-THEN rules. Prolog environments provided a much fuller realization of a complete First Order Logic environment.[14][15]

In the 1980s, expert systems proliferated. Universities offered expert system courses and two thirds of the Fortune 1000 companies applied the technology in daily business activities.[5][16] Interest was international with the Fifth Generation Computer Systems project in Japan and increased research funding in Europe.

In 1981 the first IBM PC was introduced, with the MS-DOS operating system. The imbalance between the relatively powerful chips in the highly affordable PC compared to the much more expensive price of processing power in the Mainframes that dominated the corporate IT world at the time created a whole new type of architecture for corporate computing known as the Client-server model.[17] Calculations and reasoning could be performed at a fraction of the price of a mainframe using a PC. This model also enabled business units to bypass corporate IT departments and directly build their own application. As a result client server had a tremendous impact on the expert systems market. Expert systems were already outliers in much of the business world, requiring new skills that many IT departments did not have and were not eager to develop. They were a natural fit for new PC-based shells that promised to put application development into the hands of end users and experts. Up until that point the primary development environment for expert systems had been high end Lisp machines from Symbolics and Texas Instruments. With the rise of the PC and client server computing vendors such as Intellicorp and Inference Corporation shifted their priorities to developing PC based tools. In addition new vendors often financed by Venture Capital started appearing regularly. These new vendors included Aion Corporation, Neuron Data, Exsys, and many others.[18][19]

In the 1990's and beyond the term "expert system" and the idea of a standalone AI system mostly dropped from the IT lexicon. There are two interpretations of this. One is that "expert systems failed" that the IT world moved on because expert systems didn't deliver on their over hyped promise.[20] The other is the mirror opposite, that expert systems were simply victims of their success. As IT professionals grasped concepts such as rule engines such tools migrated from standalone tools for the development of special purpose "expert" systems to one more tool that an IT professional has at their disposal.[21] Many of the leading major business application suite vendors such as SAP, Siebel, and Oracle integrated expert system capabilities into their suite of products as a way of specifying business logic. Rule engines are no longer simply for defining the rules an expert would use but for any type of complex, volatile, and critical business logic. They often go hand in hand with business process automation and integration environments.[22][23][24]

Software architecture

An expert system is an example of a knowledge-based system. Expert systems were the first commercial systems to use a knowledge-based architecture. A knowledge-based system is essentially composed of two sub-systems: the knowledge base and the inference engine.[25]

The knowledge base represents facts about the world. In early expert systems such as Mycin and Dendral these facts were represented primarily as flat assertions about variables. In later expert systems developed with commercial shells the knowledge base took on more structure and utilized concepts from object-oriented programming. The world was represented as classes, subclasses, and instances and assertions were replaced by values of object instances. The rules worked by querying and asserting values of the objects.

The inference engine is an automated reasoning system that evaluates the current state of the knowledge-base, applies relevant rules, and then asserts new knowledge into the the knowledge base. The inference engine may also include capabilities for explanation, so that it can explain to a user the chain of reasoning used to arrive at a particular conclusion by tracing back over the firing of rules that resulted in the assertion.[26]

There are primarily two modes for an inference engine: forward chaining and backward chaining. The different approaches are dictated by whether the inference engine is being driven by the antecedent (left hand side) or the consequent (right hand side) of the rule. In forward chaining an antecedent fires and asserts the consequent. For example, consider the following rule:

R1: Man(x) => Mortal(x)

A simple example of forward chaining would be to assert Man(Socrates) to the system and then trigger the inference engine. It would match R1 and assert Mortal(Socrates) into the knowledge base.

Backward chaining is a bit less straight forward. In backward chaining the system looks at possible conclusions and works backward to see if they might be true. So if the system was trying to determine if Mortal(Socrates) is true it would find R1 and query the knowledge base to see if Man(Socrates) is true. One of the early innovations of expert systems shells was to integrate inference engines with a user interface. This could be especially powerful with backward chaining. If the system needs to know a particular fact but doesn't it can simply generate an input screen and ask the user if the information is known. So in this example, it could use R1 to ask the user if Socrates was a Man and then use that new information accordingly.

The use of rules to explicitly represent knowledge also enabled explanation capabilities. In the simple example above if the system had used R1 to assert that Socrates was Mortal and a user wished to understand why Socrates was mortal they could query the system and the system would look back at the rules which fired to cause the assertion and present those rules to the user as an explanation. In English if the user asked "Why is Socrates Mortal?" the system would reply "Because all men are mortal and Socrates is a man". A significant area for research was the generation of explanations from the knowledge base in natural english rather than simply by showing the more formal but less intuitive rules.[27]

As Expert Systems evolved many new techniques were incorporated into various types of inference engines.[28] Some of the most important of these were:

  • Truth Maintenance. Truth maintenance systems record the dependencies in a knowledge-base so that when facts are altered dependent knowledge can be altered accordingly. For example, if the system learns that Socrates is no longer known to be a man it will revoke the assertion that Socrates is mortal.
  • Hypothetical Reasoning. In hypothetical reasoning, the knowledge base can be divided up into many possible views, aka worlds. This allows the inference engine to explore multiple possibilities in parallel. In this simple example, the system may want to explore the consequences of both assertions, what will be true if Socrates is a Man and what will be true if he is not?
  • Fuzzy Logic. One of the first extensions of simply using rules to represent knowledge was also to associate a probability with each rule. So, not to assert that Socrates is mortal but to assert Socrates may be mortal with some probability value. Simple probabilities were extended in some systems with sophisticated mechanisms for uncertain reasoning and combination of probabilities.
  • Ontology Classification. With the addition of object classes to the knowledge base a new type of reasoning was possible. Rather than reason simply about the values of the objects the system could also reason about the structure of the objects as well. In this simple example Man can represent an object class and R1 can be redefined as a rule that defines the class of all men. These types of special purpose inference engines are known as classifiers. Although they were not highly used in expert systems classifiers are very powerful for unstructured volatile domains and are a key technology for the Internet and the emerging Semantic Web.[29][30]

Advantages

The goal of knowledge-based systems is to make the critical information required for the system to work explicit rather than implicit.[31] In a traditional computer program the logic is embedded in code that can typically only be reviewed by an IT specialist. With an expert system the goal was to specify the rules in a format that was intuitive and easily understood, reviewed, and even edited by domain experts rather than IT experts. The benefits of this explicit knowledge representation were rapid development and ease of maintenance.

Ease of maintenance is the most obvious benefit. This was achieved in two ways. First, by removing the need to write conventional code many of the normal problems that can be caused by even small changes to a system could be avoided with expert systems. Essentially, the logical flow of the program (at least at the highest level) was simply a given for the system, simply invoke the inference engine. This also was a reason for the second benefit rapid prototyping. With an expert system shell it was possible to enter a few rules and have a prototype developed in days rather than the months or year typically associated with complex IT projects.

A claim for expert system shells that was often made was that they removed the need for trained programmers and that experts could develop systems themselves. In reality this was seldom if ever true. While the rules for an expert system were more comprehensible than typical computer code they still had a formal syntax where a misplaced comma or other character could cause havoc as with any other computer language. In addition as expert systems moved from prototypes in the lab to deployment in the business world issues of integration and maintenance became far more critical. Inevitably demands to integrate with and take advantage of large legacy databases and systems arose. To accomplish this integration required the same skills as any other type of system.[32]

Disadvantages

The most common disadvantage cited for expert systems in the academic literature is the knowledge engineering problem. Obtaining the time of domain experts for any software application is always difficult but for expert systems it was especially difficult because the experts were by definition highly valued and in constant demand by the organization. As a result of this problem a great deal of research effort in the later years of expert systems was focused on tools for knowledge acquisition, to help automate the process of designing, debugging, and maintaining rules defined by experts. However, when looking at the life-cycle of expert systems in actual use other problems seem at least as critical as knowledge acquisition. These problems with expert systems were essentially the same problems as any other large system: integration, access to large databases, and performance.[33][34]

Performance was especially problematic for early expert systems as they were built using tools that featured interpreted rather than compiled code such as Lisp. Interpreting provides an extremely powerful development environment but with a cost that it is virtually impossible to obtain the levels of efficiency of the fastest compiled languages of the time such as C. System and database integration were difficult for early expert systems due to the fact that the tools were mostly in languages and platforms that were not familiar to nor welcomed in most corporate IT environments. Programming languages such as Lisp and Prolog and hardware platforms such as Lisp Machines and personal computers. As a result a great deal of effort in the later stages of expert system tool development were focused on integration with legacy environments such as COBOL, integration with large database systems, and porting to more standard platforms. These issues were resolved primarily by the client-server paradigm shift as PCs were gradually accepted in the IT world as a legitimate platform for serious business system development and as affordable minicomputer servers provided the processing power needed for AI applications.[32]

Applications

Hayes-Roth divides expert systems applications into 10 categories illustrated in the following table. Note that the example applications were not in the original Hayes-Roth table and some of the example applications came along quite a bit later. Any application that is not foot noted is described in the Hayes-Roth book.[26] Also, while these categories provide an intuitive framework for describing the space of expert systems applications, they are not rigid categories and in some cases an application may show characteristics of more than one category.

Category Problem Addressed Examples
Interpretation Inferring situation descriptions from sensor data Hearsay (Speech Recognition), PROSPECTOR
Prediction Inferring likely consequences of given situations Pretirm Birth Risk Assessment[35]
Diagnosis Inferring system malfunctions from observables CADUCEUS, MYCIN, PUFF
Design Configuring objects under constraints Dendral, Mortgage Loan Advisor, R1 (Dec Vax Configuration)
Planning Designing actions Mission Planning for Autonomous Underwater Vehicle[36]
Monitoring Comparing observations to plan vulnerabilities REACTOR[37]
Debugging Providing incremental solutions for complex problems SAINT, MATHLAB, MACSYMA
Repair Executing a plan to administer a prescribed remedy Toxic Spill Crisis Management
Instruction Diagnosing, assessing, and repairing student behavior SMH.PAL, Intelligent Clinical Training,[38] STEAMER[39]
Control Interpreting, predicting, repairing, and monitoring system behaviors Real Time Process Control,[40] Space Shuttle Mission Control[41]

Hearsay was an early attempt at solving voice recognition through an expert systems approach. For the most part this category or expert systems was not all that successful. Hearsay and all interpretation systems are essentially pattern recognition systems—looking for patterns in noisy data. In the case of Hearsay recognizing phonemes in an audio stream. Other early examples were analyzing sonar data to detect Russian submarines. These kinds of systems proved much more amenable to a neural network AI solution than a rule-based approach.

CADUCEUS and MYCIN were medical diagnosis systems. The user describes their symptoms to the computer as they would to a doctor and the computer returns a medical diagnosis.

Dendral was a tool to study hypothesis formation in the identification of organic molecules. The general problem it solved—designing a solution given a set of constraints—was one of the most successful areas for early expert systems applied to business domains such as sales people configuring Dec Vax computers and mortgage loan application development.

SMH.PAL is an expert system for the assessment of students with multiple disabilities.[42]

See also

References

  1. ^ Jackson, Peter (1998), Introduction To Expert Systems (3 ed.), Addison Wesley, p. 2, ISBN 978-0-201-87686-4
  2. ^ Nwigbo Stella and Agbo Okechuku Chuks, School of Science Education, Expert system: a catalyst in educational development in Nigeria: "The ability of this system to explain the reasoning process through back-traces (...) provides an additional feature that conventional programming does not handle"
  3. ^ Regina Barzilay, Daryl McCullough, Owen Rambow, Jonathan DeCristofaro, Tanya Korelsky, Benoit Lavoie: "A new approach to expert system explanations"
  4. ^ "Conventional programming". Pcmag.com. Retrieved 2013-09-15.
  5. ^ a b Cornelius T. Leondes (2002). Expert systems: the technology of knowledge management and decision making for the 21st century. pp. 1–22. ISBN 978-0-12-443880-4.
  6. ^ a b ACM 1998, I.2.1.
  7. ^ a b Russell & Norvig 2003, pp. 22−24.
  8. ^ a b Luger & Stubblefield 2004, pp. 227–331.
  9. ^ a b Nilsson 1998, chpt. 17.4.
  10. ^ a b McCorduck 2004, pp. 327–335, 434–435.
  11. ^ a b Crevier 1993, pp. 145–62, 197−203.
  12. ^ Nwigbo Stella and Agbo Okechuku Chuks, School of Science Education, Expert system: a catalyst in educational development in Nigeria: "Knowledge-based systems collect the small fragments of human know-how into a knowledge-base which is used to reason through a problem, using the knowledge that is appropriated"
  13. ^ Hayes-Roth, Frederick (1983). Building Expert Systems. Addison-Wesley. pp. 6–7. ISBN 0-201-10686-8. {{cite book}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  14. ^ George F. Luger and William A. Stubblefield, Benjamin/Cummings Publishers, Rule Based Expert System Shell: example of code using the Prolog rule based expert system shell
  15. ^ A. MICHIELS, Université de Liège, Belgique: "PROLOG, the first declarative language
  16. ^ Durkin, J. Expert Systems: Catalog of Applications. Intelligent Computer Systems, Inc., Akron, OH, 1993.
  17. ^ Orfali, Robert (1996). The Essential Client/Server Survival Guide. New York: Wiley Computer Publishing. pp. 1–10. ISBN 0-471-15325-7.
  18. ^ Hurwitz, Judith (2011). Smart or Lucky: How Technology Leaders Turn Chance into Success. John Wiley & Son. p. 164. ISBN 1118033787. Retrieved 29 November 2013.
  19. ^ Dunn, Robert J. (September 30, 1985). "Expandable Expertise for Everyday Users". InfoWorld. 7 (39): 30. Retrieved 2011-03-13.
  20. ^ AI Expert Newsletter: W is for Winter
  21. ^ Haskin, David (January 16, 2003). "Years After Hype, 'Expert Systems' Paying Off For Some". Datamation. Retrieved 29 November 2013.
  22. ^ SAP News Desk. "SAP News Desk IntelliCorp Announces Participation in SAP EcoHub". http://laszlo.sys-con.com. LaszloTrack. Retrieved 29 November 2013. {{cite web}}: External link in |work= (help)
  23. ^ Pegasystems. "Smart BPM Requires Smart Business Rules". http://www.pega.com. Retrieved 29 November 2013. {{cite web}}: External link in |work= (help)
  24. ^ Zhao, Kai (9-10 Oct. 2010). "Achieving business process and business rules integration using SPL". Future Information Technology and Management Engineering (FITME). 2: 329–332. Retrieved 29 November 2013. {{cite journal}}: Check date values in: |date= (help); Unknown parameter |coauthors= ignored (|author= suggested) (help)CS1 maint: date and year (link)
  25. ^ Smith, Reid (May 8, 1985). "Knowledge-Based Systems Concepts, Techniques, Examples" (PDF). http://www.reidgsmith.com. Schlumberger-Doll Research. Retrieved 9 November 2013. {{cite web}}: External link in |work= (help)
  26. ^ a b Hayes-Roth, Frederick (1983). Building Expert Systems. Addison-Wesley. ISBN 0-201-10686-8. {{cite book}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  27. ^ Nabil Arman, Polytechnic University of Palestine, January 2007, Fault Detection in Dynamic Rule Bases Using Spanning Trees and Disjoin Sets: ""
  28. ^ Mettrey, William (1987). "An Assessment of Tools for Building Large Knowledge- BasedSystems". AI Magazine. 8 (4).
  29. ^ MacGregor, Robert (1991). "Using a description classifier to enhance knowledge representation". IEEE Expert. 6 (3). Retrieved 10 November 2013. {{cite journal}}: Unknown parameter |month= ignored (help)
  30. ^ Berners-Lee, Tim (May 17, 2001). "The Semantic Web A new form of Web content that is meaningful to computers will unleash a revolution of new possibilities". Scientific American. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  31. ^ Hayes-Roth, Frederick (1983). Building Expert Systems. Addison-Wesley. p. 6. ISBN 0-201-10686-8. {{cite book}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  32. ^ a b Wong, Bo K. (1995). "Expert system applications in business: a review and analysis of the literature". Information and Management. 29 (3): 141–152. Retrieved 29 November 2013. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help); Unknown parameter |month= ignored (help)
  33. ^ Kendal, S.L.; Creen, M. (2007), An introduction to knowledge engineering, London: Springer, ISBN 978-1-84628-475-5, OCLC 70987401
  34. ^ Feigenbaum, Edward A.; McCorduck, Pamela (1983), The fifth generation (1st ed.), Reading, MA: Addison-Wesley, ISBN 978-0-201-11519-2, OCLC 9324691
  35. ^ Woolery, L.K. (1994). "Machine learning for an expert system to predict preterm birth risk". Journal of the American Medical Informatics Association. 1 (6): 439–446. Retrieved 30 November 2013.
  36. ^ Kwak, S.. H. (1990). "A mission planning expert system for an autonomous underwater vehicle". Proceedings of the 1990 Symposium on Autonomous Underwater Vehicle Technology: 123–128. Retrieved 30 November 2013.
  37. ^ Nelson, W. R. (1982). "REACTOR: An Expert System for Diagnosis and Treatment of Nuclear Reactors". Retrieved 30 November 2013. {{cite journal}}: Cite journal requires |journal= (help)
  38. ^ Haddawy, P (2010). "Intelligent Clinical Training Systems". Methods Inf Med 2010. Retrieved 30 November 2013. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  39. ^ Hollan, J (1984). "STEAMER: An interactive inspectable simulation-based training system". AI Magazine. Retrieved 30 November 2013. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  40. ^ Stanley, G.M. (July 15–17, 1991). "Experience Using Knowledge-Based Reasoning in Real Time Process Control" (PDF). Plenary paper presented at: International Federati on of Automatic Control (IFAC) Symposium on Compute r Aided Design in Control Systems. Retrieved 3 December 2013.{{cite journal}}: CS1 maint: date format (link)
  41. ^ Rasmussen, Arthur (1990). "The INCO Expert System Project: CLIPS in Shuttle mission control". NTRS. Retrieved 30 November 2013. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help); Unknown parameter |month= ignored (help)
  42. ^ Hofmeister, Alan (1994). "SMH.PAL: an expert system for identifying treatment procedures for students with severe disabilities". Exceptional Children. 61 (2). Retrieved 30 November 2013.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Expert_system&oldid=584928158"