tuna2134/sbv2-v2
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity

Use clap to achieve prompt controlled generation (#223)

Browse Source 
* 快速分类音频并把yml格式结果存在训练根目录里 (#190)

* Add files via upload

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Update models.py

* Update webui.py

* Update infer.py

* Create compress_model.py

* 重新提交，更新Gradio推理UI (#193)

* Update webui.py

* Update webui.py

* 更新 train_ms.py

* 更新 models.py

* 更新 models.py

* 更新 models.py

* 更新 train_ms.py

* 更新 train_ms.py

* 更新 models.py

* Update preprocess_text.py

* Update config.json

* Update train_ms.py

* Update webui.py (#206)

* Add files via upload (#209)

* Update train_ms.py

* Update train_ms.py

* Update preprocess_text.py

* Update train_ms.py

* fix (#211)

* Update emotion_clustering.py

* Add files via upload

* Update emotion_clustering.py

* add cluster center save

* Add files via upload

* Update config.py

* Update default_config.yml

* Update config.py

* Update config.py

* Update emotion_clustering.py

* Update emotion_clustering.py

* Update config.py

* Update emotion_clustering.py

* Update emotion_clustering.py

* Update webui.py

* Update emotion_clustering.py

* Update commons.py

* Update emotion_clustering.py

* Update webui.py

* Update webui.py

* Add files via upload

* Update train_ms.py

* Update train_ms.py

* Update train_ms.py

* Update train_ms.py

* Update train_ms.py

* Update webui.py

* Update emotion_clustering.py

* Update emotion_clustering.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix default_config.yml.

* Update infer.py

* feat: support infer 2.1 models

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix: support infer 2.1 models 兼容bug修复

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update train_ms.py

* Add CLAP

* Fix data loader

* Fix infer.py

* Fix webui.py

* Add prompt template

* Update clap_gen.py

* Fix wrong environ value

* Add g for dur disc

* Update clap_gen.py

* Fix multilang generation

* Update config.json

* Prompt mode

* Improve slice segments performance

* Add preprocess webui

* Update webui_preprocess.py

* Update webui_preprocess.py

* Update config.py

* Update default_config.yml

* Update config.py

* Update clap_gen.py

* Delete emo_gen.py

* Delete get_emo.py

* Delete emotional/wav2vec2-large-robust-12-ft-emotion-msp-dim directory

* Update README.md

* Update README

* Split val per lang

* Delete emotion_clustering.py

* Update default_config.yml

* Update default_config.yml

* Update config.py

* Update preprocess_text.py

* Update webui_preprocess.py

* Update defalut_config.yml

* Update webui_preprocess.py

* Update preprocess_text.py

* Random augmentation for CLAP

* Update data_utils.py

* Update preprocess_text.py

* Add vq for CLAP features to avoid overfitting

* Random dummy inputs

* Update webui.py

* Update models.py

* Update infer.py

* Apply Code Formatter Change

* Update config.json

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: YYuX-1145 <138500330+YYuX-1145@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Sora <654163754@qq.com>
Co-authored-by: Sihan Wang <wangsihan1995@gmail.com>
Co-authored-by: Stardust-minus <Stardust-minus@users.noreply.github.com>
This commit is contained in:
Stardust·减
2023-12-12 19:19:50 +08:00
committed by GitHub
parent 9cc786d781
commit eaefc57d71
49 changed files with 287404 additions and 3426 deletions
Download Patch File Download Diff File Expand all files Collapse all files

437
configs/config.json
View File

@@ -10,7 +10,7 @@
0.99
],
"eps": 1e-09,
"batch_size": 24,
"batch_size": 12,
"fp16_run": false,
"lr_decay": 0.99995,
"segment_size": 16384,
@@ -18,7 +18,10 @@
"warmup_epochs": 0,
"c_mel": 45,
"c_kl": 1.0,
"skip_optimizer": true
"skip_optimizer": true,
"freeze_ZH_bert": false,
"freeze_JP_bert": false,
"freeze_EN_bert": false
},
"data": {
"training_files": "filelists/train.list",
@@ -676,220 +679,220 @@
"埃舍尔_EN": 638,
"萨齐因_EN": 639,
"古田_EN": 640,
"陆景和": 641,
"莫弈": 642,
"左然": 643,
"夏彦": 644,
"三月七_ZH": 645,
"丹恒_ZH": 646,
"希儿_ZH": 647,
"娜塔莎_ZH": 648,
"希露瓦_ZH": 649,
"瓦尔特_ZH": 650,
"佩拉_ZH": 651,
"布洛妮娅_ZH": 652,
"虎克_ZH": 653,
"素裳_ZH": 654,
"克拉拉_ZH": 655,
"符玄_ZH": 656,
"白露_ZH": 657,
"杰帕德_ZH": 658,
"景元_ZH": 659,
"藿藿_ZH": 660,
"姬子_ZH": 661,
"穹_ZH": 662,
"星_ZH": 663,
"卡芙卡_ZH": 664,
"桂乃芬_ZH": 665,
"艾丝妲_ZH": 666,
"玲可_ZH": 667,
"彦卿_ZH": 668,
"托帕_ZH": 669,
"驭空_ZH": 670,
"浮烟_ZH": 671,
"停云_ZH": 672,
"镜流_ZH": 673,
"罗刹_ZH": 674,
"卢卡_ZH": 675,
"史瓦罗_ZH": 676,
"黑塔_ZH": 677,
"桑博_ZH": 678,
"伦纳德_ZH": 679,
"明曦_ZH": 680,
"银狼_ZH": 681,
"帕姆_ZH": 682,
"青雀_ZH": 683,
"乔瓦尼_ZH": 684,
"公输师傅_ZH": 685,
"晴霓_ZH": 686,
"螺丝咕姆_ZH": 687,
"阿兰_ZH": 688,
"奥列格_ZH": 689,
"丹枢_ZH": 690,
"尾巴_ZH": 691,
"寒鸦_ZH": 692,
"雪衣_ZH": 693,
"可可利亚_ZH": 694,
"青镞_ZH": 695,
"半夏_ZH": 696,
"银枝_ZH": 697,
"大毫_ZH": 698,
"霄翰_ZH": 699,
"信使_ZH": 700,
"费斯曼_ZH": 701,
"绿芙蓉_ZH": 702,
"dev_成男_ZH": 703,
"金人会长_ZH": 704,
"维利特_ZH": 705,
"维尔德_ZH": 706,
"斯科特_ZH": 707,
"卡波特_ZH": 708,
"刃_ZH": 709,
"岩明_ZH": 710,
"浣溪_ZH": 711,
"三月七_JP": 712,
"丹恒_JP": 713,
"希儿_JP": 714,
"娜塔莎_JP": 715,
"希露瓦_JP": 716,
"瓦尔特_JP": 717,
"佩拉_JP": 718,
"布洛妮娅_JP": 719,
"虎克_JP": 720,
"素裳_JP": 721,
"克拉拉_JP": 722,
"符玄_JP": 723,
"白露_JP": 724,
"杰帕德_JP": 725,
"景元_JP": 726,
"藿藿_JP": 727,
"姬子_JP": 728,
"卡芙卡_JP": 729,
"穹_JP": 730,
"星_JP": 731,
"桂乃芬_JP": 732,
"艾丝妲_JP": 733,
"彦卿_JP": 734,
"玲可_JP": 735,
"托帕_JP": 736,
"驭空_JP": 737,
"浮烟_JP": 738,
"停云_JP": 739,
"镜流_JP": 740,
"罗刹_JP": 741,
"卢卡_JP": 742,
"史瓦罗_JP": 743,
"黑塔_JP": 744,
"桑博_JP": 745,
"伦纳德_JP": 746,
"明曦_JP": 747,
"银狼_JP": 748,
"帕姆_JP": 749,
"青雀_JP": 750,
"乔瓦尼_JP": 751,
"公输师傅_JP": 752,
"晴霓_JP": 753,
"螺丝咕姆_JP": 754,
"阿兰_JP": 755,
"奥列格_JP": 756,
"丹枢_JP": 757,
"尾巴_JP": 758,
"寒鸦_JP": 759,
"雪衣_JP": 760,
"可可利亚_JP": 761,
"青镞_JP": 762,
"半夏_JP": 763,
"银枝_JP": 764,
"大毫_JP": 765,
"霄翰_JP": 766,
"信使_JP": 767,
"费斯曼_JP": 768,
"绿芙蓉_JP": 769,
"dev_成男_JP": 770,
"金人会长_JP": 771,
"维利特_JP": 772,
"维尔德_JP": 773,
"斯科特_JP": 774,
"刃_JP": 775,
"卡波特_JP": 776,
"岩明_JP": 777,
"浣溪_JP": 778,
"净砚_JP": 779,
"紫月季_JP": 780,
"歌蒂_JP": 781,
"奇怪的云骑_JP": 782,
"幻胧_JP": 783,
"斯薇塔_JP": 784,
"隐书_JP": 785,
"三月七_EN": 786,
"丹恒_EN": 787,
"希儿_EN": 788,
"娜塔莎_EN": 789,
"希露瓦_EN": 790,
"瓦尔特_EN": 791,
"佩拉_EN": 792,
"布洛妮娅_EN": 793,
"虎克_EN": 794,
"素裳_EN": 795,
"克拉拉_EN": 796,
"符玄_EN": 797,
"白露_EN": 798,
"杰帕德_EN": 799,
"景元_EN": 800,
"藿藿_EN": 801,
"姬子_EN": 802,
"卡芙卡_EN": 803,
"穹_EN": 804,
"星_EN": 805,
"桂乃芬_EN": 806,
"艾丝妲_EN": 807,
"彦卿_EN": 808,
"玲可_EN": 809,
"托帕_EN": 810,
"驭空_EN": 811,
"浮烟_EN": 812,
"停云_EN": 813,
"镜流_EN": 814,
"罗刹_EN": 815,
"卢卡_EN": 816,
"史瓦罗_EN": 817,
"黑塔_EN": 818,
"桑博_EN": 819,
"伦纳德_EN": 820,
"明曦_EN": 821,
"银狼_EN": 822,
"帕姆_EN": 823,
"青雀_EN": 824,
"乔瓦尼_EN": 825,
"公输师傅_EN": 826,
"晴霓_EN": 827,
"螺丝咕姆_EN": 828,
"阿兰_EN": 829,
"奥列格_EN": 830,
"丹枢_EN": 831,
"尾巴_EN": 832,
"寒鸦_EN": 833,
"雪衣_EN": 834,
"可可利亚_EN": 835,
"青镞_EN": 836,
"半夏_EN": 837,
"银枝_EN": 838,
"大毫_EN": 839,
"霄翰_EN": 840,
"信使_EN": 841,
"费斯曼_EN": 842,
"绿芙蓉_EN": 843,
"dev_成男_EN": 844,
"金人会长_EN": 845,
"维利特_EN": 846,
"维尔德_EN": 847,
"刃_EN": 848,
"卡波特_EN": 849,
"岩明_EN": 850,
"浣溪_EN": 851,
"紫月季_EN": 852,
"幻胧_EN": 853,
"女声_EN": 854
"三月七_ZH": 641,
"丹恒_ZH": 642,
"希儿_ZH": 643,
"娜塔莎_ZH": 644,
"希露瓦_ZH": 645,
"瓦尔特_ZH": 646,
"佩拉_ZH": 647,
"布洛妮娅_ZH": 648,
"虎克_ZH": 649,
"素裳_ZH": 650,
"克拉拉_ZH": 651,
"符玄_ZH": 652,
"白露_ZH": 653,
"杰帕德_ZH": 654,
"景元_ZH": 655,
"藿藿_ZH": 656,
"姬子_ZH": 657,
"穹_ZH": 658,
"星_ZH": 659,
"卡芙卡_ZH": 660,
"桂乃芬_ZH": 661,
"艾丝妲_ZH": 662,
"玲可_ZH": 663,
"彦卿_ZH": 664,
"托帕_ZH": 665,
"驭空_ZH": 666,
"浮烟_ZH": 667,
"停云_ZH": 668,
"镜流_ZH": 669,
"罗刹_ZH": 670,
"卢卡_ZH": 671,
"史瓦罗_ZH": 672,
"黑塔_ZH": 673,
"桑博_ZH": 674,
"伦纳德_ZH": 675,
"明曦_ZH": 676,
"银狼_ZH": 677,
"帕姆_ZH": 678,
"青雀_ZH": 679,
"乔瓦尼_ZH": 680,
"公输师傅_ZH": 681,
"晴霓_ZH": 682,
"螺丝咕姆_ZH": 683,
"阿兰_ZH": 684,
"奥列格_ZH": 685,
"丹枢_ZH": 686,
"尾巴_ZH": 687,
"寒鸦_ZH": 688,
"雪衣_ZH": 689,
"可可利亚_ZH": 690,
"青镞_ZH": 691,
"半夏_ZH": 692,
"银枝_ZH": 693,
"大毫_ZH": 694,
"霄翰_ZH": 695,
"信使_ZH": 696,
"费斯曼_ZH": 697,
"绿芙蓉_ZH": 698,
"dev_成男_ZH": 699,
"金人会长_ZH": 700,
"维利特_ZH": 701,
"维尔德_ZH": 702,
"斯科特_ZH": 703,
"卡波特_ZH": 704,
"刃_ZH": 705,
"岩明_ZH": 706,
"浣溪_ZH": 707,
"三月七_JP": 708,
"丹恒_JP": 709,
"希儿_JP": 710,
"娜塔莎_JP": 711,
"希露瓦_JP": 712,
"瓦尔特_JP": 713,
"佩拉_JP": 714,
"布洛妮娅_JP": 715,
"虎克_JP": 716,
"素裳_JP": 717,
"克拉拉_JP": 718,
"符玄_JP": 719,
"白露_JP": 720,
"杰帕德_JP": 721,
"景元_JP": 722,
"藿藿_JP": 723,
"姬子_JP": 724,
"卡芙卡_JP": 725,
"穹_JP": 726,
"星_JP": 727,
"桂乃芬_JP": 728,
"艾丝妲_JP": 729,
"彦卿_JP": 730,
"玲可_JP": 731,
"托帕_JP": 732,
"驭空_JP": 733,
"浮烟_JP": 734,
"停云_JP": 735,
"镜流_JP": 736,
"罗刹_JP": 737,
"卢卡_JP": 738,
"史瓦罗_JP": 739,
"黑塔_JP": 740,
"桑博_JP": 741,
"伦纳德_JP": 742,
"明曦_JP": 743,
"银狼_JP": 744,
"帕姆_JP": 745,
"青雀_JP": 746,
"乔瓦尼_JP": 747,
"公输师傅_JP": 748,
"晴霓_JP": 749,
"螺丝咕姆_JP": 750,
"阿兰_JP": 751,
"奥列格_JP": 752,
"丹枢_JP": 753,
"尾巴_JP": 754,
"寒鸦_JP": 755,
"雪衣_JP": 756,
"可可利亚_JP": 757,
"青镞_JP": 758,
"半夏_JP": 759,
"银枝_JP": 760,
"大毫_JP": 761,
"霄翰_JP": 762,
"信使_JP": 763,
"费斯曼_JP": 764,
"绿芙蓉_JP": 765,
"dev_成男_JP": 766,
"金人会长_JP": 767,
"维利特_JP": 768,
"维尔德_JP": 769,
"斯科特_JP": 770,
"刃_JP": 771,
"卡波特_JP": 772,
"岩明_JP": 773,
"浣溪_JP": 774,
"净砚_JP": 775,
"紫月季_JP": 776,
"歌蒂_JP": 777,
"奇怪的云骑_JP": 778,
"幻胧_JP": 779,
"斯薇塔_JP": 780,
"隐书_JP": 781,
"三月七_EN": 782,
"丹恒_EN": 783,
"希儿_EN": 784,
"娜塔莎_EN": 785,
"希露瓦_EN": 786,
"瓦尔特_EN": 787,
"佩拉_EN": 788,
"布洛妮娅_EN": 789,
"虎克_EN": 790,
"素裳_EN": 791,
"克拉拉_EN": 792,
"符玄_EN": 793,
"白露_EN": 794,
"杰帕德_EN": 795,
"景元_EN": 796,
"藿藿_EN": 797,
"姬子_EN": 798,
"卡芙卡_EN": 799,
"穹_EN": 800,
"星_EN": 801,
"桂乃芬_EN": 802,
"艾丝妲_EN": 803,
"彦卿_EN": 804,
"玲可_EN": 805,
"托帕_EN": 806,
"驭空_EN": 807,
"浮烟_EN": 808,
"停云_EN": 809,
"镜流_EN": 810,
"罗刹_EN": 811,
"卢卡_EN": 812,
"史瓦罗_EN": 813,
"黑塔_EN": 814,
"桑博_EN": 815,
"伦纳德_EN": 816,
"明曦_EN": 817,
"银狼_EN": 818,
"帕姆_EN": 819,
"青雀_EN": 820,
"乔瓦尼_EN": 821,
"公输师傅_EN": 822,
"晴霓_EN": 823,
"螺丝咕姆_EN": 824,
"阿兰_EN": 825,
"奥列格_EN": 826,
"丹枢_EN": 827,
"尾巴_EN": 828,
"寒鸦_EN": 829,
"雪衣_EN": 830,
"可可利亚_EN": 831,
"青镞_EN": 832,
"半夏_EN": 833,
"银枝_EN": 834,
"大毫_EN": 835,
"霄翰_EN": 836,
"信使_EN": 837,
"费斯曼_EN": 838,
"绿芙蓉_EN": 839,
"dev_成男_EN": 840,
"金人会长_EN": 841,
"维利特_EN": 842,
"维尔德_EN": 843,
"刃_EN": 844,
"卡波特_EN": 845,
"岩明_EN": 846,
"浣溪_EN": 847,
"紫月季_EN": 848,
"幻胧_EN": 849,
"女声_EN": 850,
"陆景和": 851,
"莫弈": 852,
"左然": 853,
"夏彦": 854
}
},
"model": {
@@ -946,5 +949,5 @@
"use_spectral_norm": false,
"gin_channels": 256
},
"version": "2.1"
"version": "2.2"
}