UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
Project Halo: Towards a Digital Aristotle (2004)
Noah S. Friedland, Paul G. Allen, Gavin Matthews, Michael Witbrock, David Baxter, Jon Curtis, Blake Shepard, Pierluigi Miraglia, Jürgen Angele, Steffen Staab, Eddie Moench, Henrik Oppermann, Dirk Wenke, David Israel, Vinay Chaudhri,
Bruce Porter
,
Ken Barker
,
James Fan
, Shaw Yi Chaw,
Peter Yeh
,
Dan Tecuci
,
Peter Clark
Project Halo is a multi-staged effort, sponsored by Vulcan Inc, aimed at creating the Digital Aristotle, an application that will encompass much of the world's scientific knowledge and be capable of applying sophisticated problem solving to answer novel questions. Vulcan envisions two primary roles for the Digital Aristotle: as a tutor to instruct students in the sciences, and as an interdisciplinary research assistant to help scientists in their work. As a first step towards this goal, we have just completed a six-month Pilot phase, designed to assess the state of the art in applied Knowledge Representation and Reasoning (KR&R). Vulcan selected three teams, each of which was to formally represent 70 pages from the Advanced Placement (AP) chemistry syllabus and deliver knowledge based systems capable of answering questions on that syllabus. The evaluation quantified each system's coverage of the syllabus in terms of its ability to answer novel, previously unseen questions and to provide human-readable answer justifications. These justifications will play a critical role in building user trust in the question-answering capabilities of the Digital Aristotle. Prior to the final evaluation, a "failure taxonomy" was collaboratively developed in an attempt to standardize failure analysis and to facilitate cross-platform comparisons. Despite differences in approach, all three systems did very well on the challenge, achieving performance comparable to the human median. The analysis also provided key insights into how the approaches might be scaled, while at the same time suggesting how the cost of producing such systems might be reduced. This outcome leaves us highly optimistic that the technical challenges facing this effort in the years to come can be identified and overcome. This paper presents the motivation and long-term goals of Project Halo, describes in detail the 6-month first phase of the project - the Halo Pilot - its KR&R challenge, empirical evaluation, results and failure analysis. The pilot's outcome is used to define challenges for the next phase of the project and beyond.
Citation:
Artificial Intelligence Magazine
, Vol. 25, 4 (2004), pp. 29-47.
Bibtex:
@article{friedland:aimag04, title={Project Halo: Towards a Digital Aristotle}, author={Noah S. Friedland and Paul G. Allen and Gavin Matthews and Michael Witbrock and David Baxter and Jon Curtis and Blake Shepard and Pierluigi Miraglia and Jürgen Angele, Steffen Staab and Eddie Moench and Henrik Oppermann and Dirk Wenke and David Israel and Vinay Chaudhri and Bruce Porter and Ken Barker and James Fan and Shaw Yi Chaw and Peter Yeh and Dan Tecuci and Peter Clark}, volume={25}, journal={Artificial Intelligence Magazine}, number={4}, pages={29-47}, url="http://www.cs.utexas.edu/users/ai-lab?friedland:aimag04", year={2004} }
People
Ken Barker
Formerly affiliated Research Scientist
kbarker [at] cs utexas edu
Shaw Yi(Jason) Chaw
Ph.D. Alumni
jchaw [at] cs utexas edu
Peter Clark
Formerly affiliated Research Scientist
peterc [at] vulcan com
James Jumin Fan
Ph.D. Alumni
jfan [at] cs utexas edu
Bruce Porter
Faculty
porter [at] cs utexas edu
Dan Tecuci
Ph.D. Alumni
tecuci [at] cs utexas edu
Peter Zei-Chan Yeh
Ph.D. Alumni
pzyeh [at] cs utexas edu
Labs
Knowledge Representation & Reasoning