Conditional End-to-End Audio Transforms
Table 3: Acoustic context size. We varied the per timestep context size and measured MCD. Lower values are better. Plus/minus values denote the 95% confidence interval.
['Context Size', 'TIMIT', 'NSynth']
For example, speech often contains more variances in pitch whereas musical notes are held constant on the order of tens to hundreds of milliseconds. The acoustic context size denotes the contextual window modeled by each hidden state of our network. Larger contexts capture more acoustic content. All MCD values are between 10.3 and 10.7. Compare this to speech on TIMIT: a context size of 50 ms captures enough temporal context without overwhelming (i.e., smoothing) the hidden state. Larger fields of size 100-200 ms produce lower quality transforms.