UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
Towards a Quantitative, Platform-Independent Analysis of Knowledge Systems (2004)
Noah S. Friedland, Paul G. Allen, Michael Witbrock, Gavin Matthews, Nancy Salay, Pierluigi Miraglia, Jurgen Angele, Steffen Staab, David Israel, Vinay Chaudhri,
Bruce Porter
,
Ken Barker
,
Peter Clark
The Halo Pilot, a six-month effort to evaluate the state-of-the-art in applied Knowledge Representation and Reasoning (KR&R) systems, collaboratively developed a taxonomy of failures with the goal of creating a common framework of metrics against which we could measure inter- and intra- system failure characteristics of each of the three Halo knowledge applications. This platform independent taxonomy was designed with the intent of maximizing its coverage of potential failure types; providing the necessary granularity and precision to enable clear categorization of failure types; and providing a productive framework for short and longer term corrective action. Examining the failure analysis and initial empirical use of the taxonomy provides quantitative insights into the strengths and weaknesses of individual systems and raises some issues shared by all three. These results are particularly interesting when considered against the long history of assumed reasons for knowledge system failure. Our study has also uncovered some shortcomings in the taxonomy itself, implying the need to improve both its granularity and precision. It is the hope of Project Halo to eventually produce a failure taxonomy and associated methodology that will be of general use in the fine-grained analysis of knowledge systems.
View:
PDF
Citation:
In
The Ninth International Conference on the Principles of Knowledge Representation and Reasoning (KR2004)
2004.
Bibtex:
@inproceedings{friedland:kr04, title={Towards a Quantitative, Platform-Independent Analysis of Knowledge Systems}, author={Noah S. Friedland and Paul G. Allen and Michael Witbrock and Gavin Matthews and Nancy Salay and Pierluigi Miraglia and Jurgen Angele and Steffen Staab and David Israel and Vinay Chaudhri and Bruce Porter and Ken Barker and Peter Clark}, booktitle={The Ninth International Conference on the Principles of Knowledge Representation and Reasoning (KR2004)}, url="http://www.cs.utexas.edu/users/ai-lab?friedland:kr04", year={2004} }
People
Ken Barker
Formerly affiliated Research Scientist
kbarker [at] cs utexas edu
Peter Clark
Formerly affiliated Research Scientist
peterc [at] vulcan com
Bruce Porter
Faculty
porter [at] cs utexas edu
Areas of Interest
Knowledge Representation & Reasoning
Labs
Knowledge Representation & Reasoning