Edinburgh Research Archive >
Informatics, School of >
Informatics thesis and dissertation collection >
Please use this identifier to cite or link to this item:
|Title: ||Discovering Lexical Generalisations. A Supervised Machine Learning Approach to Inheritance Hierarchy Construction|
|Authors: ||Sporleder, Caroline|
|Supervisor(s): ||Lascarides, Alex|
|Issue Date: ||Jul-2004|
|Publisher: ||University of Edinburgh. College of Science and Engineering. School of Informatics.|
|Abstract: ||Grammar development over the last decades has seen a shift away from large inventories of
grammar rules to richer lexical structures. Many modern grammar theories are highly lexicalised.
But simply listing lexical entries typically results in an undesirable amount of redundancy.
Lexical inheritance hierarchies, on the other hand, make it possible to capture linguistic
generalisations and thereby reduce redundancy.
Inheritance hierarchies are usually constructed by hand but this is time-consuming and
often impractical if a lexicon is very large. Constructing hierarchies automatically or semiautomatically
facilitates a more systematic analysis of the lexical data. In addition, lexical data
is often extracted automatically from corpora and this is likely to increase over the coming
years. Therefore it makes sense to go a step further and automate the hierarchical organisation
of lexical data too.
Previous approaches to automatic lexical inheritance hierarchy construction tended to focus
on minimality criteria, aiming for hierarchies that minimised one or more criteria such as the
number of path-value pairs, the number of nodes or the number of inheritance links (Petersen
2001, Barg 1996a, and in a slightly different context: Light 1994). Aiming for minimality is
motivated by the fact that the conciseness of inheritance hierarchies is a main reason for their
use. However, I will argue that there are several problems with minimality-based approaches.
First, minimality is not well defined in the context of lexical inheritance hierarchies as there
is a tension between different minimality criteria. Second, minimality-based approaches tend
to underestimate the importance of linguistic plausibility. While such approaches start with a
definition of minimal redundancy and then try to prove that this leads to plausible hierarchies,
the approach suggested here takes the opposite direction. It starts with a manually built hierarchy
to which a supervised machine learning algorithm is applied with the aim of finding a set
of formal criteria that can guide the construction of plausible hierarchies. Taking this direction
means that it is more likely that the selected criteria do in fact lead to plausible hierarchies.
Using a machine learning technique also has the advantage that the set of criteria can be much
larger than in hand-crafted definitions. Consequently, one can define conciseness in very broad
terms, taking into account interdependencies in the data as well as simple minimality criteria.
This leads to a more fine-grained model of hierarchy quality.
In practice, the method proposed here consists of two components: Galois lattices are used
to define the search space as the set of all generalisations over the input lexicon. Maximum
entropy models which have been trained on a manually built hierarchy are then applied to the
lattice of the input lexicon to distinguish between plausible and implausible generalisations
based on the formal criteria that were found in the training step. An inheritance hierarchy is
then derived by pruning implausible generalisations. The hierarchy is automatically evaluated
by matching it to a manually built hierarchy for the input lexicon.
Automatically constructing lexical hierarchies is a hard task, partly because what is considered
the best hierarchy for a lexicon is to some extent subjective. Supervised learning methods
also suffer from a lack of suitable training data. Hence, a semi-automatic architecture may
be best suited for the task. Therefore, the performance of the system has been tested using a
semi-automatic as well as an automatic architecture and it has also been compared to the performance
achieved by the pruning algorithm suggested by Petersen (2001). The findings show
that the method proposed here is well suited for semi-automatic hierarchy construction.|
|Description: ||Institute for Communicating and Collaborative Systems|
|Appears in Collections:||Informatics thesis and dissertation collection|
Items in ERA are protected by copyright, with all rights reserved, unless otherwise indicated.