Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech
Table 4: ABX scores and bitrates for various codebook sizes on the clean ZeroSpeech19 English test set, using the “∅→{2}” model.
['Codebook size', 'R@10', 'ABX', 'Bitrate', 'RLE-Bitrate', 'Segment-ABX', 'Segment-Bitrate']
We find that the ABX score is best for 1024 codebook vectors, although the performance is quite good for all models. Unsurprisingly, models with smaller codebooks also achieve lower bitrates.