Commit Graph

330 Commits

Author SHA1 Message Date
Stardust·减
63d6f52bef Update train_ms.py 2023-09-06 10:20:42 +08:00
Stardust·减
9e30c85a15 Update models.py 2023-09-06 10:13:18 +08:00
Stardust·减
57276857d9 Update data_utils.py 2023-09-06 10:12:31 +08:00
Stardust·减
0afb102d48 Update data_utils.py 2023-09-06 10:11:59 +08:00
Stardust·减
5a4e71b6ce Update data_utils.py 2023-09-06 10:04:14 +08:00
Stardust·减
41e575eb68 clean 2023-09-06 10:03:49 +08:00
Stardust·减
1d0dfc80f1 Merge pull request #19 from ricecakey06/dev
Bug fix
2023-09-06 07:50:42 +08:00
Rice Cake
155a7ec308 change 'JA' to 'JP' 2023-09-06 05:29:57 +08:00
Rice Cake
db7de50663 fix bug 2023-09-06 05:29:16 +08:00
Stardust·减
4c25d8aaf7 Update bert_gen.py 2023-09-05 22:34:27 +08:00
Stardust·减
f8ebfe4273 Update bert_gen.py 2023-09-05 22:22:06 +08:00
Stardust·减
ba3091241b Update symbols.py 2023-09-05 22:19:54 +08:00
Stardust·减
7bdc2de090 Update japanese.py 2023-09-05 22:08:44 +08:00
Stardust·减
0cc7cd2759 Update japanese.py 2023-09-05 22:07:55 +08:00
Stardust·减
de0a08df10 Update requirements.txt 2023-09-05 22:06:15 +08:00
Stardust·减
6fc26aa92b Update cleaner.py 2023-09-05 22:02:13 +08:00
Stardust·减
e52acffc7f Update esd.list 2023-09-05 21:59:10 +08:00
Stardust·减
a4ea278bc3 Update __init__.py 2023-09-05 21:53:37 +08:00
Stardust·减
edda628161 Update japanese_bert.py 2023-09-05 20:42:25 +08:00
Stardust·减
5adb7a11bc add empty cache 2023-09-05 20:39:56 +08:00
Stardust·减
7ba432978b Update chinese_bert.py 2023-09-05 20:39:10 +08:00
Stardust·减
b39eb46a16 clean code 2023-09-05 20:35:05 +08:00
Stardust·减
08fb63a017 Update bert_gen.py 2023-09-05 20:31:47 +08:00
Stardust·减
c7b796df77 Update bert_gen.py 2023-09-05 20:27:00 +08:00
Stardust·减
97ec85a510 Update japanese_bert.py 2023-09-05 20:24:51 +08:00
Stardust·减
eee6e42290 Update japanese_bert.py 2023-09-05 20:24:23 +08:00
Stardust·减
cb80c6550f Update bert_gen.py 2023-09-05 20:18:15 +08:00
Stardust·减
908c0bca2c Update bert_gen.py 2023-09-05 20:17:48 +08:00
Stardust·减
a716d8ef82 Update bert_gen.py 2023-09-05 20:17:03 +08:00
Stardust·减
eb1a08f7d4 Update bert_gen.py 2023-09-05 20:15:42 +08:00
Stardust·减
555b1f4bb5 clean code 2023-09-05 19:52:00 +08:00
Stardust·减
ff0c76dccb add logger 2023-09-05 19:50:24 +08:00
Stardust·减
89b6c5d589 Update requirements.txt 2023-09-05 19:48:34 +08:00
Stardust·减
70b6e3bb9a Update bert_gen.py 2023-09-05 19:46:39 +08:00
Stardust·减
9d2ed39365 fix jp 2023-09-05 19:41:52 +08:00
Stardust·减
13c9a12573 fix 2023-09-05 19:41:41 +08:00
Stardust·减
1f080322dc 添加device传参 2023-09-05 19:40:15 +08:00
Stardust·减
3719c5e303 Update chinese_bert.py 2023-09-05 19:38:45 +08:00
Stardust·减
dcd5ed3c43 新增device传参 2023-09-05 19:38:23 +08:00
Stardust·减
eb14f4a0b7 多卡预处理 2023-09-05 19:35:21 +08:00
Stardust·减
d02113267b 多卡预处理 2023-09-05 19:34:28 +08:00
Stardust·减
f945aa6091 Update bert_gen.py 2023-09-05 19:31:35 +08:00
Stardust·减
e86c8a8991 use torchrun 2023-09-05 17:26:39 +08:00
Lengyue
042fb96fd9 Lint bert gen & remove unused vars 2023-09-05 01:59:36 -04:00
Lengyue
d4d0082b05 lint code (no other modify) 2023-09-05 01:21:17 -04:00
Lengyue
eabeb72e27 Optimize preprocess code 2023-09-05 01:08:51 -04:00
Lengyue
55404f92b5 Add reference pre-commit config 2023-09-05 01:08:42 -04:00
Stardust·减
24ba0f26df Update train_ms.py 2023-09-05 11:30:28 +08:00
Stardust·减
ff8469f0f6 decrease num_worker 2023-09-05 11:26:50 +08:00
Stardust·减
2b88603554 Delete bert/bert-base-japanese-v3/.gitkeep 2023-09-05 10:32:09 +08:00