예제 8.4 ModuleNotFoundError: No module named 'vllm' 에러 남

[mrdantzig]

---

ModuleNotFoundError Traceback (most recent call last)
/tmp/ipykernel_32965/4248812640.py in <cell line: 0>()
1 import torch
----> 2 from vllm import LLM, SamplingParams
3
4 model_id = "shangrilar/yi-ko-6b-text2sql"
5 llm = LLM(model=model_id, dtype=torch.float16, max_model_len=1024)

ModuleNotFoundError: No module named 'vllm'

---

NOTE: If your import is failing due to a missing package, you can
manually install dependencies using either !pip or !apt.

To view examples of installing some common dependencies, click the
"Open Examples" button below.

아래와 같이 수정해도 'ModuleNotFoundError: No module named 'vllm'' 계속 나옴.

!pip install vllm==0.4.1 -qqq
import torch
from vllm import LLM, SamplingParams

model_id = "shangrilar/yi-ko-6b-text2sql"
llm = LLM(model=model_id, dtype=torch.float16, max_model_len=1024)

Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Installing build dependencies ... done
Getting requirements to build wheel ... error
ERROR: Failed to build 'xformers' when getting requirements to build wheel

ModuleNotFoundError Traceback (most recent call last)
/tmp/ipykernel_32965/3736511612.py in <cell line: 0>()
1 get_ipython().system('pip install vllm==0.4.1 -qqq')
2 import torch
----> 3 from vllm import LLM, SamplingParams
4
5 model_id = "shangrilar/yi-ko-6b-text2sql"

ModuleNotFoundError: No module named 'vllm'

---

NOTE: If your import is failing due to a missing package, you can
manually install dependencies using either !pip or !apt.

To view examples of installing some common dependencies, click the
"Open Examples" button below.