Querying and Updating Treebanks: A Critical Survey and Requirements Analysis

Lai, C. and Bird, S. G. (2004) Querying and Updating Treebanks: A Critical Survey and Requirements Analysis. In Proceedings Australasian Language Technology Workshop, pages pp. 139-146, Macquarie University, Sydney.

Abstract

Language technology makes extensive use of hierarchically annotated text and speech data. These databases are stored in flat files and manipulated using corpus-specific query tools or special-purpose scripts. While the size of these databases and the range of applications has grown rapidly in recent years, neither method for managing the data has led to reusable, scalable software. The formal properties of the query languages are not well understood. Hence established methods for indexing tree data and optimizing tree queries cannot be employed. We analyze a range of existing linguistic query languages, and adduce a set of requirements for a reusable, scalable linguistic query language.