xllama / wiki / chat

Chat, streaming & modes

The chat module keeps message history, streams each response, runs tools and records the turn for persistence.

The ReAct loop

  • Send the running history to the engine and stream the reply.
  • If the model returns tool calls, execute them locally, append results and loop again.
  • When the model returns a final answer with no tool calls, end the turn.

BUILD and PLAN

ModeBehaviorBest for
BUILDOne direct ReAct loopMost day-to-day tasks
PLANPlan up to five steps, run a sequential subagent for each, then synthesizeMulti-step missions

Toggle modes with Shift+Tab or /mode. Subagents run sequentially because one local engine owns one KV context.

Context & sessions

  • Auto-compaction summarizes history near 78% context usage.
  • /compact runs the same process on demand.
  • Overflow recovery trims older history and retries.
  • Sessions are scoped to the current working directory and restored with /resume.

Input shortcuts

KeyAction
EnterSend
Alt+Enter / Ctrl+JNew line
Ctrl+CStop the running agent
Shift+TabBUILD ⇄ PLAN
Ctrl+RToggle reasoning
Ctrl+FSearch transcript; Enter / ↑ cycle matches
Ctrl+VPaste text or image
Ctrl+YCopy last answer
PgUp / PgDnScroll transcript

Search & code rendering

Ctrl+F opens transcript search. Matching text is highlighted with a k/N counter; press Enter or ↑ to move through results and Esc to close.

Fenced code blocks use lightweight, language-agnostic syntax highlighting for strings, comments, numbers and common keywords while preserving the terminal-first rendering.