解决 Ascend 上 vllm 运行时出现 urllib3.exceptions.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED]

作者：zjun

2025-01-06
上海
本文字数：508 字
阅读完需：约 2 分钟

解决Ascend上vllm运行时出现urllib3.exceptions.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED]

背景

尝试使用 vllm 模型，脚本代码如下：

from vllm import LLM, SamplingParams
prompts = [    "Hello, my name is",    "The president of the United States is",    "The capital of France is",    "The future of AI is",]sampling_params = SamplingParams(temperature=0.8, top_p=0.95)
llm = LLM(model="facebook/opt-125m")
outputs = llm.generate(prompts, sampling_params)
for output in outputs:    prompt = output.prompt    generated_text = output.outputs[0].text    print(f"Prompt: {prompt!r}, Generated text: {generated_text!r}")