Project Details
Nástroje boje proti hlasovým DeepFakes
Project Period: 1. 1. 2024 - 31. 12. 2026
Project Type: grant
Code: VB02000060
Agency: Ministry of Interior of the Czech Republic
Program: Programu bezpečnostního výzkumu ČR 2021-2026: vývoj, testování a evaluace nových bezpečnostních technologií (SECTECH) - II. veřejná soutěž
Deepfakes; artificial intelligence; computer security
Deepfakes are a new application of artificial intelligence with a significant impact on computer security. They are becoming easier than ever to create, and these tools can be used to deceive individuals and organizations, especially when combined with social engineering tactics such as phishing.
This project therefore focuses on understanding the possible uses and associated threats in the malicious use of voice deepfakes, with the intention of finding reliable strategies to mitigate these threats. By doing so, we can ensure that these innovations are used ethically and responsibly, creating a more sustainable and fairer future for all.
Its activities are focused on three main areas: enhancing the robustness of voice biometric systems against voice deepfake spoofing attacks, creating tools to counter the malicious use of voice deepfakes, and evaluating people's ability to recognize voice deepfakes, while also finding ways to increase users' security awareness.
Malinka Kamil, Mgr., Ph.D. (DITS FIT BUT) , team leader
Brukner Jan, Ing. (DCGM FIT BUT)
Burget Lukáš, doc. Ing., Ph.D. (DCGM FIT BUT)
Černocký Jan, prof. Dr. Ing. (DCGM FIT BUT)
Firc Anton, Ing. (DITS FIT BUT)
Foltyn Lukáš, Bc. (DCGM FIT BUT)
Halas Jaromír (CC FIT BUT)
Hanáček Petr, doc. Dr. Ing. (DITS FIT BUT)
Knapovský Jan, Bc. (OIP FIT BUT)
Kotolan Martin (OIP FIT BUT)
Matějka Pavel, Ing., Ph.D. (DCGM FIT BUT)
Mihola David, Bc. (DCGM FIT BUT)
Plchot Oldřich, Ing., Ph.D. (DCGM FIT BUT)
Polok Alexander, Ing. (DCGM FIT BUT)
Reš Jakub, Ing. (DITS FIT BUT)
Rohdin Johan A., Dr. (DCGM FIT BUT)
Schwarz Petr, Ing., Ph.D. (DCGM FIT BUT)
Silnova Anna, MSc., Ph.D. (DCGM FIT BUT)
Staněk Vojtěch, Ing., Bc. (DCGM FIT BUT)
Šalko Milan, Ing. (DITS FIT BUT)
2024
- ALAM Jahangir, BARAHONA Quirós Sara, BOBOŠ Dominik, BURGET Lukáš, CUMANI Sandro, DAHMANE Mohamed, HAN Jiangyu, HLAVÁČEK Miroslav, KODOVSKÝ Martin, LANDINI Federico Nicolás, MOŠNER Ladislav, PÁLKA Petr, PAVLÍČEK Tomáš, PENG Junyi, PLCHOT Oldřich, RAJASEKHAR Gnana Praveen, ROHDIN Johan A., SILNOVA Anna, STAFYLAKIS Themos and ZHANG Lin. ABC SYSTEM DESCRIPTION FOR NIST SRE 2024. In: Proceedings of NIST SRE 2024. San Juan: National Institute of Standards and Technology, 2024, pp. 1-9. Detail
- WANG Shuai, CHEN Zhengyang, HAN Bing, WANG Hongji, XIANG Xu, ROHDIN Johan A., SILNOVA Anna, QIAN Yanmin and LI Haizhou et al. Advancing speaker embedding learning: Wespeaker toolkit for research and production. Speech Communication, vol. 162, no. 103104, 2024, pp. 1-12. ISSN 0167-6393. Detail
- ROHDIN Johan A., ZHANG Lin, PLCHOT Oldřich, STANĚK Vojtěch, MIHOLA David, PENG Junyi, STAFYLAKIS Themos, BEVERAKI Dmitriy, SILNOVA Anna, BRUKNER Jan and BURGET Lukáš. BUT systems and analyses for the ASVspoof 5 Challenge. In: Proceedings of ASV spoof 2024 Workshop. Kos Island: International Speech Communication Association, 2024, pp. 24-31. Detail
- POLOK Alexander, KLEMENT Dominik, HAN Jiangyu, SEDLÁČEK Šimon, YUSUF Bolaji, MACIEJEWSKI Matthew, WIESNER Matthew and BURGET Lukáš. BUT/JHU System Description for CHiME-8 NOTSOFAR-1 Challenge. In: Proceedings of CHiME 2024 Workshop. Kos Island: International Speech Communication Association, 2024, pp. 18-22. Detail
- MALINKA Kamil, FIRC Anton, ŠALKO Milan, PRUDKÝ Daniel, RADAČOVSKÁ Karolína and HANÁČEK Petr. Comprehensive Multiparametric Analysis of Human Deepfake Speech Recognition. Eurasip Journal on Image and Video Processing, vol. 2024, no. 1, pp. 1-25. ISSN 1687-5281. Detail
- FIRC Anton, MALINKA Kamil and HANÁČEK Petr. Deepfake Speech Detection: A Spectrogram Analysis. In: Proceedings of the ACM Symposium on Applied Computing. Avila: Association for Computing Machinery, 2024, pp. 1312-1320. ISBN 979-8-4007-0243-3. Detail
- FIRC Anton, MALINKA Kamil and HANÁČEK Petr. Diffuse or Confuse: A Diffusion Deepfake Speech Dataset. In: 2024 International Conference of the Biometrics Special Interest Group (BIOSIG). Darmstadt: GI - Group for computer science, 2024, pp. 1-7. ISBN 978-3-88579-749-4. Detail
- STAFYLAKIS Themos, SILNOVA Anna, ROHDIN Johan A., PLCHOT Oldřich and BURGET Lukáš. Challenging margin-based speaker embedding extractors by using the variational information bottleneck. In: Proceedings of Interspeech 2024. Kos: International Speech Communication Association, 2024, pp. 3220-3224. ISSN 1990-9772. Detail
- MALINKA Kamil, FIRC Anton, KAŠKA Petr, LAPŠANSKÝ Tomáš, ŠANDOR Oskar and HOMOLIAK Ivan. Resilience of Voice Assistants to Synthetic Speech. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Bydgoszcz: Springer Nature Switzerland AG, 2024, pp. 66-84. ISBN 978-3-031-70878-7. Detail