By midiagent •
Added
- Custom model support – Connect to any OpenAI-compatible endpoint (Ollama, LM Studio, HuggingFace, etc.) for on-device generation or cloud services. Use custom API endpoints and API keys if applicable. Experimental: for best results with local models, run the largest model your hardware can handle.
Fixed
- Request cancellation – Eliminated glitches that caused cancelled jobs to hang or restart.