mozempkandClaude Opus 4.8
ea852087c4
Add a slot-cache-proxy service (profile stack) in front of llama-swap-stack.
Injects return_progress into streaming chat, taps llama.cpp prompt_progress
SSE, serves GET /progress {loading|prefill|generating|idle} with pct/tok_s/
ETA. The pi-load-progress extension polls it; point pi llmruntime baseUrl at
http://localhost:48090/v1. host net + pid:host (load tracker reads the
containerised llama-server /proc/io). Transparent superset of llama-swap
(no endpoint lost; /progress is net-new). Script mirrors llmruntime-x570.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
38 lines
690 B
Plaintext
38 lines
690 B
Plaintext
# Model files — large binaries, download with scripts/download_models.sh
|
|
models/*.gguf
|
|
models/*.bin
|
|
models/*.safetensors
|
|
|
|
# Benchmark output logs, CSVs, and generated env snapshots — generated, not source
|
|
benchmark-results/*.log
|
|
benchmark-results/*.csv
|
|
benchmark-results/*.txt
|
|
benchmark-results/*.env
|
|
# Keep the .gitkeep placeholder
|
|
!benchmark-results/.gitkeep
|
|
|
|
# Docker build cache artifacts
|
|
.docker/
|
|
|
|
# Python cache
|
|
__pycache__/
|
|
*.pyc
|
|
*.pyo
|
|
.venv/
|
|
|
|
# Editor / OS artifacts
|
|
.DS_Store
|
|
Thumbs.db
|
|
*.swp
|
|
*.swo
|
|
*~
|
|
.idea/
|
|
.vscode/
|
|
|
|
# Local overrides (never commit secrets or machine-specific tweaks)
|
|
.env.local
|
|
envs/.env.*.local
|
|
|
|
# slot-cache-proxy runtime (KV bins + proxy.log)
|
|
slot-cache/
|