01.01.03.DeepSeek：环境搭建篇（模型托管平台ModelScope：使用DeepSeek-R1 7B推理模型）
操作流程1、下载安装2、配置3、测试官网https://www.modelscope.cn/models下载安装注意越狱版创建虚拟环境## 查看效果conda info --envsconda create--nameDeepSeek-R1-Distill-Qwen-7B-abliterated-v2python3.12.7-y# 激活环境conda activate DeepSeek-R1-Distill-Qwen-7B-abliterated-v2# 退出环境# 当前的conda虚拟环境里只需要执行conda deactivate# conda deactivate DeepSeek-R1-Distill-Qwen-7B-abliterated-v2# 删除环境# conda remove -n DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 --all -y下载模型DeepSeek-R1-Distill-Qwen-7B-abliterated-v2cd/usr/local/softwaremkdir-p/mnt/D/modelscope/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2chmod0777-R/mnt/D/modelscope/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2chown$USER:$USER-R/mnt/D/modelscope/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2MAX_JOBS$(nproc)pip3installmodelscope modelscope download--modelhuihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2--local_dir/mnt/D/modelscope/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2配置编写推理脚本:# 安装依赖MAX_JOBS$(nproc)pipinstalltorch2.9.0torchvision0.24.0torchaudio2.9.0 --index-url https://download.pytorch.org/whl/cu126MAX_JOBS$(nproc)pipinstalltransformers datasets acceleratecat/mnt/D/modelscope/inference.pyEOF from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer AutoTokenizer.from_pretrained(/mnt/D/modelscope/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2) model AutoModelForCausalLM.from_pretrained(/mnt/D/modelscope/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2) messages [ {role: user, content: 你是谁?能帮助我做什么}, ] inputs tokenizer.apply_chat_template( messages, add_generation_promptTrue, tokenizeTrue, return_dictTrue, return_tensorspt, ).to(model.device) outputs model.generate(**inputs, max_new_tokens40) print(tokenizer.decode(outputs[0][inputs[input_ids].shape[-1]:])) EOF测试选择命令行运行与测试chmod0777-R/mnt/D/modelscope/inference.pychown$USER:$USER-R/mnt/D/modelscope/inference.py# 查看输出结果python3 /mnt/D/modelscope/inference.py
