Large scale experiments with naive bayes and decision trees for function tagging
Abstract
This paper describes the use of two machine learning techniques, naive Bayes and decision trees, to address the task of assigning function tags to nodes in a syntactic parse tree. Function tags are extra functional information, such as logical subject or predicate, that can be added to certain nodes in syntactic parse trees. We model the function tags assignment problem as a classification problem. Each function tag is regarded as a class and the task is to find what class/tag a given node in a parse tree belongs to from a set of predefined classes/tags. The paper offers the first systematic comparison of the two techniques, naive Bayes and decision trees, for the task of function tags assignment. The comparison is based on a standardized data set, the Penn Treebank, a collection of sentences annotated with syntactic information including function tags. We found out that decision trees generally outperform naive Bayes for the task of function tagging. Furthermore, this is the first large scale evaluation of decision trees based solutions to the task of functional tagging. © 2008 World Scientific Publishing Company.
Publication Title
International Journal on Artificial Intelligence Tools
Recommended Citation
Lintean, M., & Rus, V. (2008). Large scale experiments with naive bayes and decision trees for function tagging. International Journal on Artificial Intelligence Tools, 17 (3), 483-499. https://doi.org/10.1142/S0218213008004011
