korallll commited on
Commit
d406513
·
1 Parent(s): ff1c49d

Add MMS-300M-AntiDeepfake-NDA submission for ADD22_eval_31 (EER=3.5559) (#14)

Browse files

- Add MMS-300M-AntiDeepfake-NDA submission for ADD22_eval_31 (EER=3.5559) (9567aeda2c090e7e40251906fbcbcff1e6c21429)
- Fill reproduction block (inference, maintainer re-ran the model) (45eadfb3de323bd2a24813e7d79b91844e777a53)

submissions/mms-300m-antideepfake-nda.yaml ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 4
2
+ system:
3
+ name: MMS-300M-AntiDeepfake-NDA
4
+ slug: mms-300m-antideepfake-nda
5
+ description: 'AntiDeepfake detector (MMS-300M backbone): a self-supervised speech foundation model post-trained
6
+ for deepfake/spoof detection, with an AdaptiveAvgPool1d + single fully-connected layer head over the
7
+ SSL features. Released by nii-yamagishilab (arXiv:2506.21090). Trained **without** data augmentation
8
+ (NDA variant). Checkpoint copied bit-exactly from nii-yamagishilab/mms-300m-anti-deepfake-nda. Evaluated
9
+ here with a deterministic first-4 s window and batching (NOT the paper''s whole-utterance protocol).'
10
+ code: https://github.com/nii-yamagishilab/AntiDeepfake
11
+ checkpoint: https://huggingface.co/SpeechAntiSpoofingBenchmarks/MMS-300M-AntiDeepfake-NDA
12
+ params_millions: 315.0
13
+ paper:
14
+ arxiv_id: '2506.21090'
15
+ url: https://arxiv.org/abs/2506.21090
16
+ bibtex: "@article{ge2025posttraining,\n title={Post-training for Deepfake Speech Detection},\n author={Ge,\
17
+ \ Wanying and Wang, Xin and Kawahara, Tomoki and Yamamoto, Yuto and Delgado, Hector and Todisco,\
18
+ \ Massimiliano and Evans, Nicholas and Yamagishi, Junichi},\n journal={arXiv preprint arXiv:2506.21090},\n\
19
+ \ year={2025}\n}\n"
20
+ dataset:
21
+ id: SpeechAntiSpoofingBenchmarks/ADD22_eval_31
22
+ revision: a55a9f8f6bbab3e41dd8f354549aa03c949be2e9
23
+ split: test
24
+ scores:
25
+ eer_percent: 3.555901434482965
26
+ n_trials: 112861
27
+ n_skipped: 0
28
+ artifact:
29
+ scores_url: https://huggingface.co/SpeechAntiSpoofingBenchmarks/MMS-300M-AntiDeepfake-NDA/resolve/82be6a6d21b59828034420eac1c4688a74af2957/.eval_results/SpeechAntiSpoofingBenchmarks/ADD22_eval_31/scores.txt
30
+ scores_sha256: 70a2bc6397a347c0bb54dc1fffb9e5c65ab5c22693d5e055d7cb3f306f4d9e65
31
+ bench_version: speech-spoof-bench==0.4.1
32
+ reproduction:
33
+ reproduced_by: SpeechAntiSpoofingBenchmarks
34
+ reproduced_at: '2026-10-29'
35
+ reproduced_bench_version: speech-spoof-bench==0.4.1
36
+ match: inference
37
+ submitter:
38
+ hf_username: korallll
39
+ contact: k.n.borodin@mtuci.ru
40
+ submitted_at: '2026-10-29'
41
+ notes: 'score = output logit for class 1 (real / bona fide); higher = more bona fide. Backbone built from
42
+ the source fairseq config (mms_300m); the released model.safetensors overwrites every weight (220-key
43
+ exact match family-wide). Input: fixed first 64000 samples (4.0 s @ 16 kHz), tile-repeated if shorter,
44
+ per-utterance layer_norm; no resampling. Checkpoint license: CC BY-NC-SA 4.0. STRICTLY PROHIBITED on
45
+ the model''s in-domain corpora (see README); Arena runs ArAD + In-the-Wild only.'