6 Commits

Author	SHA1	Message	Date
tsukumi	810ca43615	Improve: Disable enable_cpu_mem_arena for CPU inference only to prevent excessive memory consumption during the inference session of the BERT model	2024-12-22 09:17:31 +09:00
tsukumi	405c5deddd	Improve: Adjusted the default Execution Provider options	2024-12-22 07:04:20 +09:00
tsukumi	08c439e88e	Refactor: Use I/O Binding during BERT inference and always release memory after inference	2024-12-22 06:49:43 +09:00
tsukumi	d935d30e4c	Add: test code for CoreMLExecutionProvider on a trial basis ... Currently ONNXRuntime's CoreML support is not very good, and on my environment, I get errors like “coreml_execution_provider.cc:192 operator() Input (/sdp/flows.3/GatherND_2_output_0) has a dynamic shape ({-1,-1}) but the runtime shape ({0,10}) has zero elements. This is not supported by the CoreML EP.” and inference fails. I hope this will be fixed in a future version of ONNXRuntime, and leave the test code as it is.	2024-09-23 21:07:27 +09:00
tsukumi	7d721fdf2b	Fix: CUDAExecutionProvider was not being used to infer Style-Bert-VITS2 ONNX models even though CUDA was available	2024-09-18 04:37:23 +09:00
tsukumi	70f8d53a1e	Add: empty __init__.py	2024-03-07 09:09:24 +00:00