• v2.5.0-task-model: lightweight task model services + tasks table

    indifferentketchup released this 2026-05-27 21:44:39 +00:00 | 43 commits to main since this release

    Task model infrastructure for cheap LLM calls (auto-naming, search
    rewrite, tags, summaries) via a dedicated llama-server instance at
    TASK_MODEL_URL, falling back to LLAMA_SWAP_URL with FAST_MODEL when
    unset. Replaces the inline fetch in auto_name.ts with taskModelCompletion.

    Adds search query rewriting: on step 0 when web tools are enabled, the
    user's message is summarized into a search intent hint appended to the
    system prompt, improving web_search relevance.

    Schema: tasks table for provider dispatch and arena, sessions.tags column.

    Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

    Downloads