tuna2134/sbv2-v2
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity

修复了VQ未注册入网络的问题 (#216)

Browse Source 
* Add files via upload

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
This commit is contained in:
Ναρουσέ·μ·γιουμεμί·Χινακάννα
2023-12-07 20:48:25 +08:00
committed by GitHub
parent 87462fe50f
commit f550f86caa
1 changed files with 1046 additions and 1044 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
models.py
View File

@@ -345,7 +345,9 @@ class TextEncoder(nn.Module):
self.ja_bert_proj = nn.Conv1d(1024, hidden_channels, 1) self.ja_bert_proj = nn.Conv1d(1024, hidden_channels, 1)
self.en_bert_proj = nn.Conv1d(1024, hidden_channels, 1) self.en_bert_proj = nn.Conv1d(1024, hidden_channels, 1)
self.emo_proj = nn.Linear(1024, 1024) self.emo_proj = nn.Linear(1024, 1024)
self.emo_quantizer = [ self.emo_quantizer = nn.ModuleList()
for i in range(0, n_speakers):
self.emo_quantizer.append(
VectorQuantize( VectorQuantize(
dim=1024, dim=1024,
codebook_size=10, codebook_size=10,
@@ -354,7 +356,7 @@ class TextEncoder(nn.Module):
learnable_codebook=True, learnable_codebook=True,
ema_update=False, ema_update=False,
) )
] * n_speakers )
self.emo_q_proj = nn.Linear(1024, hidden_channels) self.emo_q_proj = nn.Linear(1024, hidden_channels)
self.encoder = attentions.Encoder( self.encoder = attentions.Encoder(