Commit Graph

61 Commits

Author SHA1 Message Date
tsukumi
e642a4cb69 Merge branch 'litagin02:master' into master 2024-12-08 03:37:27 +09:00
Aka Diffusion
3155e2acc1 Update server_fastapi.py
g2pの内容をjsonで取れるAPI
2024-11-10 15:27:19 +09:00
tsukumi
5a82105df3 Improve: Since the use cases for speech synthesis in English and Chinese are limited, only Japanese BERT models/tokenizers will be pre-loaded to save VRAM 2024-09-23 08:58:57 +09:00
tsukumi
fa7123c422 Fix: ONNX BERT model/tokenizer is not preloaded by default to avoid wasting VRAM 2024-09-18 05:11:15 +09:00
tsukumi
7d721fdf2b Fix: CUDAExecutionProvider was not being used to infer Style-Bert-VITS2 ONNX models even though CUDA was available 2024-09-18 04:37:23 +09:00
tsukumi
5e2c83c6c7 Improve: Support ONNX inference, add ONNX conversion script 2024-09-17 16:55:03 +09:00
tsukumi
a037b955ac Refactor: run "hatch run style:fmt" 2024-09-17 05:25:29 +09:00
tsukumi
80dd6dbc22 Improve: Use the device_map option in transformers to load BERT models directly to the GPU 2024-09-17 05:22:06 +09:00
aka7774
73519b41a5 /voice add model_name 2024-07-10 14:36:45 +09:00
litagin02
a271b8a41c Support limit=-1 for no limit in API, and update FAQ 2024-06-01 19:37:50 +09:00
litagin02
0a5e5fe1fe Add char limit log info 2024-05-26 19:50:50 +09:00
litagin02
8976a3ed2f Refactor: Use PathConfig and pathlib instead of paths.yml loading 2024-05-25 10:25:22 +09:00
litagin02
55c3847176 Add POST method for /voice in server_fastapi.py 2024-03-13 15:26:30 +09:00
litagin02
c028840794 Merge pull request #93 from litagin02/dev-refactor
Dev refactor
2024-03-13 15:12:02 +09:00
litagin02
69225a3e13 Style 2024-03-12 21:47:59 +09:00
litagin02
bdf394d2c2 Fix: migration to new TTSModelHolder 2024-03-12 20:56:50 +09:00
litagin02
3632d476c1 Clean 2024-03-12 15:24:42 +09:00
litagin02
bc0729d970 Fix: initialize worker and dict for use 2024-03-12 15:23:18 +09:00
litagin02
dada0af2b6 Format import using isort --profile black --gitignore --lai 2 . 2024-03-11 12:37:51 +09:00
tsukumi
d2fd378b56 Refactor: rename Model / ModelHolder to TTSModel / TTSModelHolder for clarification and add comments to each method 2024-03-10 03:47:17 +00:00
tsukumi
b7d7c78203 Refactor: when pyopenjtalk_worker is called without initialization, continue processing without a worker
When using style-bert-vits2 as a library, the requirement to be able to launch it in multiple processes may not be necessary. Also, if the library is embedded and exe-ed using PyInstaller or similar, it is difficult to make pyopenjtalk_worker run in a separate process.
Therefore, we changed it so that the worker is used only when it is explicitly initialized.
2024-03-10 03:04:27 +00:00
tsukumi
c594f7ea7a Refactor: change execution location of pyopenjtalk.initialize()
Considering library design, this function with many side effects should not be executed in a library.
2024-03-09 00:26:51 +00:00
tsukumi
d22a11ebb2 Fix: a bug that prevented speech synthesis in app.py 2024-03-08 22:09:47 +00:00
Aka Diffusion
ea3c05dcbb /voice method GET to POST 2024-03-08 23:45:41 +09:00
tsukumi
fe7e31e080 Refactor: moved common/tts_model.py to style_bert_vits2/ 2024-03-08 09:34:44 +00:00
tsukumi
4d5c537f95 Refactor: introducing Ruff 2024-03-08 05:02:02 +00:00
tsukumi
62919e904e Refactor: moved the module for extracting BERT features from text in each language to style_bert_vits2/text_processing/(language)/bert_feature.py 2024-03-07 03:34:58 +00:00
tsukumi
f880641eb5 Remove: modules under common/ that have been rewritten 2024-03-06 22:29:12 +00:00
litagin02
0a6e4f1203 Fix to use Path obj 2024-02-23 16:19:29 +09:00
litagin02
98ee6f4c69 Refactor: dataset_root and assets_root in configs/paths.yml 2024-01-02 22:51:17 +09:00
litagin02
ef4e82defc Refactor and add merge 2023-12-31 14:55:04 +09:00
litagin02
9a2fa2ac18 Fix skip bug and style 2023-12-31 08:07:20 +09:00
Daiki Arai
ef6a429421 improve error response format & docs 2023-12-31 00:15:40 +09:00
Daiki Arai
55d4bbf783 add text URL decoding option(encoding param) 2023-12-30 16:21:27 +09:00
Daiki Arai
0b3c679617 add CORS settings 2023-12-30 15:47:32 +09:00
Daiki Arai
2b6ec56bbf language=auto/mix are not available 2023-12-30 13:58:27 +09:00
Daiki Arai
e27e1de450 add api server 2023-12-30 13:23:13 +09:00
litagin02
58fab45b84 init (not checked bat script yet) 2023-12-27 05:37:46 +09:00
Stardust·减
76653b5b6d Dev 2.3. (#242)
* Fix inputs of duration discriminator

* Add LSTM

* Update models.py

* Update tensorboard scalar

* Noise injection for minimizing modality gap

* Update infer.py

* support bf16 run

* del unused_para flag

* support bf16 config

* add grad clip

* fix(logger and grad):add dur grad,fix grad clip

* Update webui_preprocess.py

* Fix English G2P

* fix(bert_gen):add pass

* Pass SDP to DD

* Update webui_preprocess.py

* Update config.json

* Update webui.py

* Update chinese_bert.py

* Upload webui for deploy

* Update webui.py

* torch.save as pt not npy

* Update config.json

* add freeze emo vq

* Update webui_preprocess.py

* Fix tone_sandhi.py

* Comment up grad clip

* Fix in-place addition

* Add SLM discriminator

* Add DDP for WD

* Feat: Style text: make emotions and style similar to the style text by mixing bert (#240) (#241)

* fix:(oldVersion210) Load on demand Emotion model

* feat: update fastapi.py. 添加更多错误日志信息

* Switch pyopenjtalk to pyopenjtalk-prebuilt

* fix: update fastapi.py. 2.2 reference适配

* Update resample.py

* 修复Onnx导出的BUG (#237)

* Add files via upload

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add files via upload

* Add files via upload

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Delete attentions_onnx.py

* Delete models_onnx.py

* Add files via upload

* Add files via upload

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update __init__.py

* Update __init__.py

* Update __init__.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------



* Fix onnx

* Format export

* Feat: style-text and bert mixing (JA only)

* Ensure the same tensor shape

* Update

* update gradio version

* Fix

* Style text for chinese and english (ver 2.2)

* Style text for chinese and english (ver 2.1)

* Style text in FastAPI

* Translate style text desc in chinese

---------

Co-authored-by: litagin02 <139731664+litagin02@users.noreply.github.com>
Co-authored-by: Sora <654163754@qq.com>
Co-authored-by: Sihan Wang <wangsihan1995@gmail.com>
Co-authored-by: Ναρουσέ·μ·γιουμεμί·Χινακάννα <40709280+NaruseMioShirakana@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Remove CLAP

* Revert "Remove CLAP"

This reverts commit 62fd59bc837c580239840a2bc84b15e0663730fc.

Revert

* Remove CLAP

* bf16 audo grad cilp

* Update webui and infer utils

* Update webui.py

* Update webui.py

* Update webui-preprocess.py

* Update webui_preprocess.py

---------

Co-authored-by: Sihan Wang <wangsihan1995@gmail.com>
Co-authored-by: OedoSoldier <31711261+OedoSoldier@users.noreply.github.com>
Co-authored-by: litagin02 <139731664+litagin02@users.noreply.github.com>
Co-authored-by: Sora <654163754@qq.com>
Co-authored-by: Ναρουσέ·μ·γιουμεμί·Χινακάννα <40709280+NaruseMioShirakana@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-12-19 19:12:26 +08:00
Ναρουσέ·μ·γιουμεμί·Χινακάννα
7a9ce8fc4c 修复Onnx导出的BUG (#237)
* Add files via upload

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add files via upload

* Add files via upload

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Delete attentions_onnx.py

* Delete models_onnx.py

* Add files via upload

* Add files via upload

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update __init__.py

* Update __init__.py

* Update __init__.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-12-14 19:39:16 +08:00
Sora
9e4cc4c7de fix: update fastapi.py. 2.2 reference适配 2023-12-14 14:48:19 +08:00
Sora
252ddd5b64 feat: update fastapi.py. 添加更多错误日志信息 2023-12-14 10:08:34 +08:00
Sora
ee84580ad3 feat: update fastapi.py. support infer 2.2 models 2023-12-13 11:08:01 +08:00
Sora
a4f3388029 update server_fastapi.py. 模型文件不存在时跳过加载模型 2023-12-06 21:48:52 +08:00
Sora
2b178ba183 fix server_fastapi.py: 修复bug。 2023-12-04 12:09:56 +08:00
pre-commit-ci[bot]
872e8cb0e5 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2023-12-03 14:44:09 +00:00
Sora
3623eed896 update server_fastapi.py: 添加2.1模型推理支持。 2023-12-03 22:41:36 +08:00
Sora
95f44ed4fe update server_fastapi.py: 缺少web文件时添加提示信息。configyml添加更多帮助注释 2023-12-01 10:13:42 +08:00
Sora
f5444c208d fix server_fastapi.py: 解决可能的BytesIO()未被回收导致内存泄露的问题,适配310以下版本python (#202) 2023-11-28 18:15:28 +08:00
Stardust·减
b186499ae9 Dev emo (#171)
* SYNC CHANGE TO EMO BRANCH (#162)

* Update README.md

* 更新 bert_models.json

* fix

* Update data_utils.py

* Update infer.py

* performance improve

* Feat: support auto split in webui (#158)

* Feat: support auto split in webui

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Fix: change /voice api to post (#160)

* Fix: change /voice api to post

* Fix: support /voice api get

* Fix: Add missing torch.cuda.empty_cache() (#161)

---------

Co-authored-by: Sora <atri@suzakuintsubaki.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Artrajz <969242373@qq.com>

* sync  (#163)

* Update README.md

* 更新 bert_models.json

* fix

* Update data_utils.py

* Update infer.py

* performance improve

* Feat: support auto split in webui (#158)

* Feat: support auto split in webui

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Fix: change /voice api to post (#160)

* Fix: change /voice api to post

* Fix: support /voice api get

* Fix: Add missing torch.cuda.empty_cache() (#161)

* del emo

* del emo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: Sora <atri@suzakuintsubaki.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Artrajz <969242373@qq.com>

* Add files via upload

* Update infer.py

* add emo

* add emo

* Update default_config.yml

* Fix slice segments GPU perf (#165)

* Fix slice segments GPU perf

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update commons.py

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Update infer.py

* Update models.py

* Update infer.py

* remove spec cache

* Update data_utils.py

* Update data_utils.py

* Update train_ms.py

* Revert "Fix slice segments GPU perf (#165)" (#169)

This reverts commit 28430fc76bc628297bb59d8f8d25100dbe46ab59.

* Update train_ms.py

* Update train_ms.py

* Update data_utils.py

* Update data_utils.py

* Update train_ms.py

* Update train_ms.py

* Update train_ms.py

* Update train_ms.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update default_config.yml

* Switch to Japanese wwm DeBERTa (#172)

* Switch to Japanese wwm DeBERTa

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Fix wrong ellipsis g2p (#173)

* Switch to Japanese wwm DeBERTa

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix ellipsis g2p

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Add files via upload

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix English phones not aligned with BERT features (#174)

* Fix English phones not aligned with BERT features

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Fix english bert gen (#175)

* Update webui.py

* Update webui.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add NCCL timeout

* Update train_ms.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update train_ms.py

* Update default_config.yml

* Update infer.py

* Update models.py

* Update train_ms.py

* Update infer.py

* Update emo_gen.py

* Feat: Support load and infer 2.0 models (#178)

* Feat: Support load and infer 2.0 models

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* 复用相同逻辑,修正静音添加错误 (#181)

* Refactor: reuse the same part of voice api.

* Fix: server_fastapi.py

* Update train_ms.py

* Update data_utils.py

* Update data_utils.py

* Update train_ms.py

* Update train_ms.py

* Update train_ms.py

* Update train_ms.py

* Update data_utils.py

* Update data_utils.py

* Add files via upload

* Update train_ms.py

* Update train_ms.py

* Update train_ms.py

* Update default_config.yml

* Update utils.py

* Update train_ms.py

* Update utils.py

* Update default_config.yml

* Update data_utils.py

* Update default_config.yml

* Update train_ms.py

* Update train_ms.py

* Update config.py

* Update utils.py

* Update train_ms.py

* Update train_ms.py

* feat: add voice mix and tone mix (#187)

* feat: add voice mix and tone mix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Stardust·减 <star_dust_chen@foxmail.com>

* Add files via upload

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: Sora <atri@suzakuintsubaki.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Artrajz <969242373@qq.com>
Co-authored-by: Leng Yue <lengyue@lengyue.me>
Co-authored-by: OedoSoldier <31711261+OedoSoldier@users.noreply.github.com>
Co-authored-by: 潮幻Mark <sunyunfei201@gmail.com>
2023-11-25 13:08:51 +08:00