| Aspect | Change | Modified File |
|---|---|---|
| Chat endpoint | http://localhost:8001/v1/chat/completions |
model.py |
| Completions endpoint | http://localhost:8001/v1/completions |
model.py |
| Models healthcheck URL | http://localhost:8001/v1/models |
model.py |
| Additional OSS model | Added registry gpt-oss-20b (openai/gpt-oss-20b) |
registry.py |
| Additional gemma3 model | Added registry gemma3-27b (openai/gemma3-27b) |
registry.py |
Entity Recognition using VLLM and GPT-oss
- gpt-oss-20b
- gemma3-27b
setup(
name="my-project",
version="0.1.0",
packages=find_packages(),
install_requires=[
"spacy-llm @ git+https://github.com/f-buerckel/spacy-llm.git@main",
],
)
Or with Pip:
pip install git+https://github.com/f-buerckel/spacy-llm.git@main