Commit Graph

15 Commits

Author SHA1 Message Date
tsukumi
9723f75f99 Fix: g2p process fails in PyTorch-independent environment 2024-11-08 02:56:05 +09:00
tsukumi
eb5d245903 Add: Test for ONNX inference code (without PyTorch dependency) 2024-09-23 10:04:02 +09:00
tsukumi
fa7123c422 Fix: ONNX BERT model/tokenizer is not preloaded by default to avoid wasting VRAM 2024-09-18 05:11:15 +09:00
tsukumi
9de6e04ad7 Add: Preparation for ONNX inference support ④ 2024-09-17 13:25:17 +09:00
tsukumi
cfd6bd5bb6 Improve: Models can now be loaded directly onto NVIDIA GPUs 2024-09-17 05:23:02 +09:00
tsukumi
80dd6dbc22 Improve: Use the device_map option in transformers to load BERT models directly to the GPU 2024-09-17 05:22:06 +09:00
tsukumi
bdf20e8911 Refactor: Use bert_models.transfer_model() 2024-09-17 05:21:03 +09:00
tsukumi
f84d2ed48b Add: Implement bert_models.transfer_model() 2024-09-17 05:19:44 +09:00
tsukumi
07d246b98b Refactor: run "hatch run style:fmt" 2024-03-12 18:27:08 +00:00
tsukumi
483bc68d57 Refactor: unify invoke format of open() function 2024-03-12 18:00:51 +00:00
tsukumi
74af2c831c Add: cache_dir and revision optional arguments to load_model() / load_tokenizer() 2024-03-12 17:45:10 +00:00
litagin02
dada0af2b6 Format import using isort --profile black --gitignore --lai 2 . 2024-03-11 12:37:51 +09:00
litagin02
c776c08235 Apply black formatter 2024-03-11 09:47:47 +09:00
tsukumi
a672aeefd9 Fix: maintain compatibility with Python 3.9 2024-03-08 08:45:56 +00:00
tsukumi
fac4f9a8ab Refactor: rename text_processing to nlp
"text_processing" is clearer, but the import statement is longer.
"nlp" is shorter and makes it clear that it is natural language processing.
2024-03-08 06:20:44 +00:00