Despite the fact that many symbolic and connectionist (neural net) learning algorithms are addressing the same problem of learning from classified examples, very little is known regarding their comparative strengths and weaknesses. This paper presents the results of experiments comparing the ID3 symbolic learning algorithm with the perceptron and back-propagation connectionist learning algorithms on several large real-world data sets. The results show that ID3 and perceptron run significantly faster than does back-propagation, both during learning and during classification of novel examples. However, the probability of correctly classifying new examples is about the same for the three systems. On noisy data sets there is some indication that back-propagation classifies more accurately.

PDF

In Proceedings of the Eleventh International Joint Conference on Artificial Intelligence (IJCAI-89), pp. 775-780, Detroit, MI, August 1989. Reprinted in ``Readings in Machine Learning'', Jude W. Shavlik and T. G. Dietterich (eds.), Morgan Kaufman, San Mateo, CA, 1990..

@inproceedings{mooney:ijcai89a, title={An Experimental Comparison of Symbolic and Connectionist Learning Algorithms}, author={Raymond J. Mooney and J.W. Shavlik and G. Towell and A. Gove}, booktitle={Proceedings of the Eleventh International Joint Conference on Artificial Intelligence (IJCAI-89)}, month={August}, address={Detroit, MI}, key={ID3 backprop perceptron}, pages={775-780}, note={Reprinted in ``Readings in Machine Learning'', Jude W. Shavlik and T. G. Dietterich (eds.), Morgan Kaufman, San Mateo, CA, 1990.}, url="http://www.cs.utexas.edu/users/ai-lab?mooney:ijcai89a", year={1989} }