Skip to content

Fix wording in agent feature description #207

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Chida82 wants to merge 2 commits into
base: main
Choose a base branch
from
+9 −7
Open

Fix wording in agent feature description #207

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
5b44551
Fix grammar and clarity in README.md for low-latency experience and s…
Chida82 May 20, 2026
1449313
revert for low latency experience description
Chida82 May 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 9 additions & 7 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -177,17 +177,19 @@ by the on-disk KV cache itself. Moreover the tools and the system prompt
are all designed vertically for DeepSeek v4 Flash. This provides a
few advantages:

* Low latency experience, bounded mainly by the prefill speed limits. Displaying of generated text, tool calling, start of a new session are always instantaneous.
* Low latency experience, bounded mainly by prefill speed limits. Generated text display, tool calls, and new session startup are always instantaneous.
* Live progress bar during prefill time.
* No DSML tool calling conversion, the tools are handled natively in the LLM format.
* KV cache mismatch are impossible by construction, the current state is always the truth.
* KV cache mismatches are impossible by construction, the current state is always the truth.
* Everything is tuned for this model.
* Ability to switch session with `/list` and `/switch` without any prefill stage.
* Ability to switch sessions with `/list` and `/switch` without any prefill stage.


However, while the system already works, there is still a lot of work to do
before it is ready for prime time. Once the agent reaches its desired shape,
we will *likely* split the server and the client, creating a stateful,
session-based protocol that can recreate all of this in a client-server setup.

However while the system already works, there is a lot of work to do
in order to make it ready for prime time. When finally the agent will reach
the wanted shape, we will *likely* split the server and the client creating a stateful
session-based protocol that can recreate all that in a client-server way.

## Benchmarking

Expand Down