Publication Details
Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio
Wang Xin (National Institute of Informatic)
Cooper Erica (National Institute of Informatic)
Diez Sánchez Mireia, M.Sc., Ph.D. (DCGM FIT BUT)
Landini Federico Nicolás (DCGM FIT BUT)
Evans Nicholas (EURECOM)
Yamagishi Junichi (SOKENDAI)
partial spoof, spoof diarization, countermeasure, clustering
This paper defines Spoof Diarization as a novel task in the Partial Spoof (PS) scenario. It aims to determine what spoofed when, which includes not only locating spoof regions but also clustering them according to different spoofing methods. As a pioneering study in spoof diarization, we focus on defining the task, establishing evaluation metrics, and proposing a bench- mark model, namely the Countermeasure-Condition Cluster- ing (3C) model. Utilizing this model, we first explore how to effectively train countermeasures to support spoof diariza- tion using three labeling schemes. We then utilize spoof lo- calization predictions to enhance the diarization performance. This first study reveals the high complexity of the task, even in restricted scenarios where only a single speaker per au- dio file and an oracle number of spoofing methods are con- sidered. Our code is available at https://github.com/ nii-yamagishilab/PartialSpoof.
@INPROCEEDINGS{FITPUB13323,
author = "Lin Zhang and Xin Wang and Erica Cooper and Mireia S\'{a}nchez Diez and Nicol\'{a}s Federico Landini and Nicholas Evans and Junichi Yamagishi",
title = "Spoof Diarization: {"}What Spoofed When{"} in Partially Spoofed Audio",
pages = "502--506",
booktitle = "Proceedings of Interspeech 2024",
journal = "Proceedings of Interspeech - on-line",
volume = 2024,
number = 9,
year = 2024,
location = "Kos, GR",
publisher = "International Speech Communication Association",
ISSN = "1990-9772",
doi = "10.21437/Interspeech.2024-1365",
language = "english",
url = "https://www.fit.vut.cz/research/publication/13323"
}