如何快速解决Qwopus3.6-27B-v2-GGUF部署问题:从OOM到推理速度优化的完整指南
2026/6/5 17:06:35
参考:
https://github.com/modelscope/FunASR/blob/main/examples/industrial_data_pretraining/sense_voice/demo_onnx.py
安装:
pip install funasr_onnx
使用:
from pathlib import Path from funasr_onnx import SenseVoiceSmall from funasr_onnx.utils.postprocess_utils import rich_transcription_postprocess model_dir = "iic/SenseVoiceSmall" model = SenseVoiceSmall(model_dir, batch_size=10, quantize=True) wav_or_scp = [r"C:\Users\loong\Downloads\asr_example.wav"] res = model(wav_or_scp, language="auto", use_itn=True) print([rich_transcription_postprocess(i) for i in res])