MARCH 1987 BENCHMARK TESTS

TEST MATERIAL: The first in the series of DARPA Benchmark Tests
using the Resource Management Corpus was conducted using material
released prior to the March 1987 DARPA Speech Recognition Workshop. 
Two sets of test material were designated. For Speaker Dependent
technology, a set of 4 speakers was identified, and sets of 25
sentence utterances per speaker were designated from the Speaker
Dependent Development Test material, amounting to a 100 sentence
utterance Speaker Dependent Test Set.  For Speaker Independent
technology, a set of 10 speakers was identified, and sets of 10
sentence utterances per speaker were designated from the speaker
Independent Development Test material, amounting to a 100 sentence
utterance Speaker Independent Test Set. 

SPEAKER INDEPENDENT SYSTEM TRAINING: No explicit constraint was
placed on the allowable material to be used for training Speaker
Independent systems. 

LIVE TALKERS: The tests implemented at Bolt, Beranek and Newman,
Inc. (BBN) and at Carnegie Mellon University (CMU) included the use
of test material form "live talkers". 

"HOMOPHONES CORRECT" OPTION IN SCORING: At the time of these tests,
no special provision was made to score susbtitution errors
involving homophones as correct.
 
STANDARD WORD-PAIR GRAMMAR: At the time of these tests, no
agreement had been reached on the use of a standard word-pair
grammar.