Wavesplit: End-to-End Speech Separation by Speaker Clustering
Table 8: Wavesplit performance when the number of speakers varies (WSJ0-123mix, no dynamic mixing).
['Subset', 'ΔSI-SDR (dB)', 'ΔSDR (dB)']
The sequences with no speech overlap are excellent, highlighting that the model correctly identifies speaker turns and isolates speakers. Conversely, the sequences with three continuously active speakers report an accuracy lower than our model trained on WSJ0-3mix. We suspect that our loss clipping strategy is sub-optimal on this dataset.