generated from coulomb/repo-seed
Add activity-core LLM endpoint support
This commit is contained in:
33
README.md
33
README.md
@@ -110,8 +110,37 @@ then parse one without another provider call:
|
||||
```bash
|
||||
python -m llm_connect.replay /path/to/audit/record.json --json
|
||||
```
|
||||
|
||||
## Writing your own adapter
|
||||
|
||||
## Server runtime profiles
|
||||
|
||||
Serve mode enables named runtime profiles by default. A client can send
|
||||
`config.model_name="custodian-triage-balanced"` and the server resolves it to
|
||||
the configured provider/model before calling the adapter.
|
||||
|
||||
Useful runtime environment variables:
|
||||
|
||||
```bash
|
||||
LLM_CONNECT_HOST=0.0.0.0
|
||||
LLM_CONNECT_PORT=8080
|
||||
LLM_CONNECT_PROVIDER=openrouter
|
||||
LLM_CONNECT_MODEL=anthropic/claude-sonnet-4
|
||||
LLM_CONNECT_CUSTODIAN_TRIAGE_PROVIDER=openrouter
|
||||
LLM_CONNECT_CUSTODIAN_TRIAGE_MODEL=anthropic/claude-sonnet-4
|
||||
```
|
||||
|
||||
For local smoke tests without provider credentials:
|
||||
|
||||
```bash
|
||||
export LLM_CONNECT_MOCK_RESPONSE="$(python -c 'import json; print(json.dumps(json.load(open("fixtures/activity_core/daily-triage-valid-content.json"))))')"
|
||||
python -m llm_connect.server --provider mock
|
||||
python scripts/smoke_activity_core_endpoint.py --url http://127.0.0.1:8080
|
||||
```
|
||||
|
||||
Disable profile dispatch with `--disable-profiles`. Set
|
||||
`LLM_CONNECT_STRICT_PROFILES=1` or pass `--strict-profiles` to reject direct
|
||||
model names that are not configured profiles.
|
||||
|
||||
## Writing your own adapter
|
||||
|
||||
```python
|
||||
from llm_connect import LLMAdapter, RunConfig, LLMResponse
|
||||
|
||||
Reference in New Issue
Block a user