PyTorch-NPU/SDXL-Lightning:华为昇腾加速的闪电级AI图像生成革命
2026/6/1 12:13:16
Chord是一款基于Qwen2.5-VL多模态大模型的视觉定位服务,能够通过自然语言指令精确定位图像中的目标对象。本教程将详细介绍如何部署该服务,并配置Supervisor进行进程守护、自动重启和日志管理。
# 安装conda环境 wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh bash Miniconda3-latest-Linux-x86_64.sh # 创建虚拟环境 conda create -n chord python=3.10 conda activate chord # 安装PyTorch pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118# 下载模型权重 git lfs install git clone https://huggingface.co/Qwen/Qwen2.5-VL /opt/models/Qwen2.5-VL # 安装项目依赖 pip install -r requirements.txtsudo apt update sudo apt install supervisor在/etc/supervisor/conf.d/chord.conf中添加:
[program:chord] command=/opt/miniconda3/envs/chord/bin/python /opt/chord/app/main.py directory=/opt/chord user=root autostart=true autorestart=true startsecs=10 startretries=3 redirect_stderr=true stdout_logfile=/var/log/chord.log stdout_logfile_maxbytes=50MB stdout_logfile_backups=10 environment=MODEL_PATH="/opt/models/Qwen2.5-VL",DEVICE="cuda"sudo supervisorctl reread sudo supervisorctl update sudo supervisorctl start chord创建/etc/logrotate.d/chord文件:
/var/log/chord.log { daily rotate 30 missingok notifempty compress delaycompress sharedscripts postrotate /usr/bin/supervisorctl signal HUP chord endscript }# 实时查看日志 tail -f /var/log/chord.log # 按日期筛选日志 grep "2024-03-15" /var/log/chord.logimport requests url = "http://localhost:7860/api/predict" files = {"image": open("test.jpg", "rb")} data = {"prompt": "找到图里的白色花瓶"} response = requests.post(url, files=files, data=data) print(response.json())# 使用ab进行压力测试 ab -n 100 -c 10 -p test.json -T "multipart/form-data" http://localhost:7860/api/predictsudo supervisorctl status chordjournalctl -u supervisor.servicelsof -i :7860model.half()results = model.batch_infer(images, prompts)修改Supervisor配置:
environment=MODEL_PATH="/opt/models/Qwen2.5-VL",DEVICE="cuda:0,cuda:1"sudo supervisorctl stop chord export MODEL_PATH="/path/to/custom/model" sudo supervisorctl start chord通过本教程,我们完成了Chord视觉定位模型的完整部署,并实现了:
获取更多AI镜像
想探索更多AI镜像和应用场景?访问 CSDN星图镜像广场,提供丰富的预置镜像,覆盖大模型推理、图像生成、视频生成、模型微调等多个领域,支持一键部署。