Learning Bias and Phonological Rule

A fundamental debate in the machine learning of language has been the role of prior knowledge in the learning process. Purely nativist approaches, such as the Principles and Parameters model, build parameterized linguistic generalizations directly into the learning system. Purely empirical approaches use a general, domain-independent learning rule (Error Back-Propagation, Instance-Based Generalization, MinimumDescription Length) to learn linguistic generalizations directly from the data. In this paper we suggest that an alternative to the purely nativist or purely empiricist learning paradigms is to represent the prior knowledge of language as a set of abstract learning biases,which guide an empirical inductive learning algorithm.We test our idea by examining the machine learning of simple SoundPattern ofEnglish (SPE)-style phonological rules.We represent phonological rules as finite state transducers which accept underlying forms as input and generate surface forms as output.We show thatOSTIA, a general-purpose transducer induction algorithm, was incapable of learning simple phonological rules likeflapping.We then augmentedOSTIAwith three kinds of learning biases which are specific to natural language phonology, and are assumed explicitly or implicitly by every theory of phonology: Faithfulness (underlying segments ten