Datasets:
Add MMS-300M-AntiDeepfake-NDA submission for ADD22_eval_31 (EER=3.5559) (#14)
Browse files- Add MMS-300M-AntiDeepfake-NDA submission for ADD22_eval_31 (EER=3.5559) (9567aeda2c090e7e40251906fbcbcff1e6c21429)
- Fill reproduction block (inference, maintainer re-ran the model) (45eadfb3de323bd2a24813e7d79b91844e777a53)
submissions/mms-300m-antideepfake-nda.yaml
ADDED
|
@@ -0,0 +1,45 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
schema_version: 4
|
| 2 |
+
system:
|
| 3 |
+
name: MMS-300M-AntiDeepfake-NDA
|
| 4 |
+
slug: mms-300m-antideepfake-nda
|
| 5 |
+
description: 'AntiDeepfake detector (MMS-300M backbone): a self-supervised speech foundation model post-trained
|
| 6 |
+
for deepfake/spoof detection, with an AdaptiveAvgPool1d + single fully-connected layer head over the
|
| 7 |
+
SSL features. Released by nii-yamagishilab (arXiv:2506.21090). Trained **without** data augmentation
|
| 8 |
+
(NDA variant). Checkpoint copied bit-exactly from nii-yamagishilab/mms-300m-anti-deepfake-nda. Evaluated
|
| 9 |
+
here with a deterministic first-4 s window and batching (NOT the paper''s whole-utterance protocol).'
|
| 10 |
+
code: https://github.com/nii-yamagishilab/AntiDeepfake
|
| 11 |
+
checkpoint: https://huggingface.co/SpeechAntiSpoofingBenchmarks/MMS-300M-AntiDeepfake-NDA
|
| 12 |
+
params_millions: 315.0
|
| 13 |
+
paper:
|
| 14 |
+
arxiv_id: '2506.21090'
|
| 15 |
+
url: https://arxiv.org/abs/2506.21090
|
| 16 |
+
bibtex: "@article{ge2025posttraining,\n title={Post-training for Deepfake Speech Detection},\n author={Ge,\
|
| 17 |
+
\ Wanying and Wang, Xin and Kawahara, Tomoki and Yamamoto, Yuto and Delgado, Hector and Todisco,\
|
| 18 |
+
\ Massimiliano and Evans, Nicholas and Yamagishi, Junichi},\n journal={arXiv preprint arXiv:2506.21090},\n\
|
| 19 |
+
\ year={2025}\n}\n"
|
| 20 |
+
dataset:
|
| 21 |
+
id: SpeechAntiSpoofingBenchmarks/ADD22_eval_31
|
| 22 |
+
revision: a55a9f8f6bbab3e41dd8f354549aa03c949be2e9
|
| 23 |
+
split: test
|
| 24 |
+
scores:
|
| 25 |
+
eer_percent: 3.555901434482965
|
| 26 |
+
n_trials: 112861
|
| 27 |
+
n_skipped: 0
|
| 28 |
+
artifact:
|
| 29 |
+
scores_url: https://huggingface.co/SpeechAntiSpoofingBenchmarks/MMS-300M-AntiDeepfake-NDA/resolve/82be6a6d21b59828034420eac1c4688a74af2957/.eval_results/SpeechAntiSpoofingBenchmarks/ADD22_eval_31/scores.txt
|
| 30 |
+
scores_sha256: 70a2bc6397a347c0bb54dc1fffb9e5c65ab5c22693d5e055d7cb3f306f4d9e65
|
| 31 |
+
bench_version: speech-spoof-bench==0.4.1
|
| 32 |
+
reproduction:
|
| 33 |
+
reproduced_by: SpeechAntiSpoofingBenchmarks
|
| 34 |
+
reproduced_at: '2026-10-29'
|
| 35 |
+
reproduced_bench_version: speech-spoof-bench==0.4.1
|
| 36 |
+
match: inference
|
| 37 |
+
submitter:
|
| 38 |
+
hf_username: korallll
|
| 39 |
+
contact: k.n.borodin@mtuci.ru
|
| 40 |
+
submitted_at: '2026-10-29'
|
| 41 |
+
notes: 'score = output logit for class 1 (real / bona fide); higher = more bona fide. Backbone built from
|
| 42 |
+
the source fairseq config (mms_300m); the released model.safetensors overwrites every weight (220-key
|
| 43 |
+
exact match family-wide). Input: fixed first 64000 samples (4.0 s @ 16 kHz), tile-repeated if shorter,
|
| 44 |
+
per-utterance layer_norm; no resampling. Checkpoint license: CC BY-NC-SA 4.0. STRICTLY PROHIBITED on
|
| 45 |
+
the model''s in-domain corpora (see README); Arena runs ArAD + In-the-Wild only.'
|