Regression Testing For Grammar-Based Systems
Nikos Chatzichrisafis, Dick Crouch, Tracy Holloway King,
Rowan Nairn, Manny Rayner, and Marianne Santaholma
Abstract
In complex grammars, even small changes may have unforeseeable impact
on overall system performance. As grammars are increasingly central
components in grammar-based systems, it is imperative to have
systematic regression testing in place. Systematic testing in
grammar-based systems serves several purposes. It helps developers to
track progress, and recognize and correct shortcomings in linguistics
rules sets. It is also an essential tool for assessing overall system
status in terms of task and runtime performance.
This paper describes best practices in two closely related regression
testing frameworks used in grammar-based systems: MedSLT, a spoken
language translation system based on the Regulus platform, and a search
and question answering system based on PARC's XLE syntax-semantics
parser.
Proceedings of GEAF07; CSLI Publications On-line
Proceedings TOC
Proceedings as a single large pdf file