tsukumi
5e2c83c6c7
Improve: Support ONNX inference, add ONNX conversion script
2024-09-17 16:55:03 +09:00
tsukumi
9de6e04ad7
Add: Preparation for ONNX inference support ④
2024-09-17 13:25:17 +09:00
tsukumi
b9fdeb4492
Add: Preparation for ONNX inference support ②
2024-09-17 09:02:14 +09:00
tsukumi
0e71d7ef7c
Fix: Specifying the device_map option in extract_bert_feature()
2024-09-17 05:22:30 +09:00
tsukumi
bdf20e8911
Refactor: Use bert_models.transfer_model()
2024-09-17 05:21:03 +09:00
tsukumi
9c233630ef
Refactor: don't keep models in bert_feature module for each language
...
BERT models and tokenizers are already stored and managed in the bert_models module and should not be stored here.
In addition, since there may be situations where the user would like to use cpu instead of mps for inference when using it as a library, the automatic switching process to mps was removed.
2024-03-10 14:18:57 +00:00
tsukumi
a672aeefd9
Fix: maintain compatibility with Python 3.9
2024-03-08 08:45:56 +00:00
tsukumi
fac4f9a8ab
Refactor: rename text_processing to nlp
...
"text_processing" is clearer, but the import statement is longer.
"nlp" is shorter and makes it clear that it is natural language processing.
2024-03-08 06:20:44 +00:00
