Skip to content
This repository was archived by the owner on Jun 24, 2024. It is now read-only.

Commit 9376078

Browse files
committed
docs(readme): further detail current branches
1 parent 581b2a0 commit 9376078

File tree

1 file changed

+4
-3
lines changed

1 file changed

+4
-3
lines changed

README.md

+4-3
Original file line numberDiff line numberDiff line change
@@ -14,11 +14,12 @@ machine learning.
1414

1515
## Current State
1616

17-
There are currently three available versions of `llm` (the crate and the CLI):
17+
There are currently four available versions of `llm` (the crate and the CLI):
1818

1919
- The released version `0.1.1` on `crates.io`. This version is several months out of date and does not include support for the most recent models.
20-
- The `main` branch of this repository. This version can reliably infer GGMLv3 models, but does not support GGUF, and is also somewhat out of date.
21-
- The `develop` branch of this repository. This version supports GGUF, but is updating to the latest version of GGML, and is therefore not yet stable.
20+
- The `main` branch of this repository. This version can reliably infer GGMLv3 models, but does not support GGUF, and uses an old version of GGML.
21+
- The `gguf` branch of this repository; this is a version of `main` that supports inferencing with GGUF, but does not support any models other than Llama, requires the use of a Hugging Face tokenizer, and does not support quantization. It also uses an old version of GGML.
22+
- The `develop` branch of this repository. This is a from-scratch re-port of `llama.cpp` to synchronize with the latest version of GGML, and to support all models and GGUF. It is currently a work in progress, and is not yet ready for use.
2223

2324
The plan is to finish up the work on `develop` (see [the PR](https://github.com/rustformers/llm/pull/442)), and then merge it into `main` and release a new version of `llm` to `crates.io`, so that up-to-date support for the latest models and GGUF will be available. It is not yet known when this will happen.
2425

0 commit comments

Comments
 (0)