mirrors/llama.cpp
0
0 Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-10-29 02:06:31 +08:00
Code Activity
Files
xsn/server_engine
llama.cpp/common
T
History
Gabe Goodhart 23f7aabc16 model : Granite Switch Decision (#30676) 
* feat(convert): Add decision.chat to support decision models that can also chat

Branch: GraniteSwitchDecision
AI-usage: full (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* feat(convert): Add conversion for Granite Switch as decision model

The template follows from the usage sample:
https://huggingface.co/ibm-granite/granite-switch-4.1-8b#guardian-and-decision-side-by-side

Branch: GraniteSwitchDecision
AI-usage: draft (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* feat(common): Add support for chat+decision models in common

Branch: GraniteSwitchDecision
AI-usage: full (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* feat(common): Add granite switch decision model enum

Branch: GraniteSwitchDecision
AI-usage: full (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* feat(server): Plumb through decision_chat bool to support decision+chat models

Branch: GraniteSwitchDecision
AI-usage: full (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* feat(server): Add Granite Switch decision support

Branch: GraniteSwitchDecision
AI-usage: draft (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* docs: Update server README for granite switch decisions / chat+decisions

Branch: GraniteSwitchDecision
AI-usage: draft (Claude + Sonnet 5.5)
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* Revert "feat(convert): Add decision.chat to support decision models that can also chat"

This reverts commit 952ef56764.

* Revert "feat(common): Add support for chat+decision models in common"

This reverts commit 93ed782e3a.

* Revert "feat(server): Plumb through decision_chat bool to support decision+chat models"

This reverts commit 97e9af60dd.

* fix: If Granite Switch supports decisions, it always supports text too

Branch: GraniteSwitchDecision
AI-usage: none
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>

* docs: Remove reference to decision.chat in server README

Branch: GraniteSwitchDecision
AI-usage: none
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>
2026-10-16 20:00:41 +02:00
..
jinja
jinja : improve context copy constructor performance (#30562)
2026-10-15 11:00:57 +02:00
parsers
model: add Muse Spark Open (text, vision and audio) (#30616)
2026-10-15 23:27:12 +02:00
arg.cpp
server: save only restorable slot states to the prompt cache (#30498)
2026-10-15 06:30:17 +02:00
arg.h
server : improve startup log messages (#29125)
2026-09-19 15:37:13 +03:00
base64.hpp
llava : expose as a shared library for downstream projects (#3613)
2023-11-07 00:36:23 +03:00
build-info.cpp.in
common : make build info output stream configurable (#28322)
2026-09-04 09:13:20 +03:00
build-info.h
common : make build info output stream configurable (#28322)
2026-09-04 09:13:20 +03:00
chat-auto-parser-generator.cpp
chat: replace output string with parts (#30389)
2026-10-14 01:03:56 +02:00
chat-auto-parser-helpers.cpp
chat: replace output string with parts (#30389)
2026-10-14 01:03:56 +02:00
chat-auto-parser-helpers.h
chat : avoid including json in chat.h (#21306)
2026-04-03 09:07:59 +03:00
chat-auto-parser.h
common: add json.h abstraction (#27511)
2026-08-22 16:28:28 +02:00
chat-diff-analyzer.cpp
common: add json.h abstraction (#27511)
2026-08-22 16:28:28 +02:00
chat-peg-parser.cpp
chat : name tool and argument parser rules by index (#30088)
2026-10-07 22:37:51 +02:00
chat-peg-parser.h
common: add json.h abstraction (#27511)
2026-08-22 16:28:28 +02:00
chat.cpp
model: add Muse Spark Open (text, vision and audio) (#30616)
2026-10-15 23:27:12 +02:00
chat.h
chat: replace output string with parts (#30389)
2026-10-14 01:03:56 +02:00
CMakeLists.txt
cmake : remove precompiled headers (#28892)
2026-09-14 16:07:28 +02:00
common.cpp
model : Granite Switch Decision (#30676)
2026-10-16 20:00:41 +02:00
common.h
model : Granite Switch Decision (#30676)
2026-10-16 20:00:41 +02:00
console.cpp
cli: exit on stdin EOF and drop the console wide Ctrl+C broadcast (#29722)
2026-09-30 16:24:46 +02:00
console.h
cli : add command and file auto-completion (#19985)
2026-03-05 10:47:28 +01:00
debug.cpp
common: fix missing exports in llama-common (#22340)
2026-04-27 08:06:39 +03:00
debug.h
common: fix missing exports in llama-common (#22340)
2026-04-27 08:06:39 +03:00
download.cpp
common : add common_is_tty() helper and fix deprecated warnings on Windows (#29860)
2026-10-03 15:48:24 +02:00
download.h
server: add dedup-cache-models preset option (#27346)
2026-08-19 11:04:26 +02:00
fit.cpp
Revert "Change max context length for auto-fitting with unified KV (#28849)" (#29437)
2026-09-26 07:59:15 -07:00
fit.h
fit: also take into account n_streams (#27496)
2026-08-22 16:16:06 +02:00
hf-cache.cpp
common : add fs_write_atomic() (#29642)
2026-09-29 13:46:53 +02:00
hf-cache.h
server : improve startup log messages (#29125)
2026-09-19 15:37:13 +03:00
http.h
common: honor HTTP_PROXY/HTTPS_PROXY env vars in http client (#21752)
2026-10-16 17:01:37 +02:00
imatrix-loader.cpp
imatrix: calculate activation-based statistics for new format (GGUF) imatrices (#14891)
2026-10-04 11:24:53 +02:00
imatrix-loader.h
imatrix: calculate activation-based statistics for new format (GGUF) imatrices (#14891)
2026-10-04 11:24:53 +02:00
json-schema-to-grammar.cpp
json-schema : accept escaped hyphen in regex patterns (#29127)
2026-09-19 14:11:13 +02:00
json-schema-to-grammar.h
common : implement common_schema internal representation for JSON schemas (#28736)
2026-09-12 16:14:50 -05:00
json-schema.cpp
common : implement common_schema internal representation for JSON schemas (#28736)
2026-09-12 16:14:50 -05:00
json-schema.h
common : implement common_schema internal representation for JSON schemas (#28736)
2026-09-12 16:14:50 -05:00
json.cpp
common: json.h: fix clang lto (#27575)
2026-08-23 01:11:10 +02:00
json.h
json: Fixed json enum handling (#28518)
2026-09-21 10:32:07 +02:00
llguidance.cpp
llama : support multi-output backend sampling (#25532)
2026-08-10 16:58:56 +03:00
log.cpp
tests : consolidate context state tests into test-llama-context (#30023)
2026-10-13 16:21:55 +03:00
log.h
tests : consolidate context state tests into test-llama-context (#30023)
2026-10-13 16:21:55 +03:00
ngram-cache.cpp
common : read ngram cache parts by reference instead of copying (#30061)
2026-10-16 10:06:32 +03:00
ngram-cache.h
spec : add self‑speculative decoding (no draft model required) + refactor (#18471)
2026-01-28 19:42:42 +02:00
ngram-map.cpp
speculative : fix out-of-bounds read in ngram-map on prompt shrink (#23936)
2026-07-07 10:25:04 +03:00
ngram-map.h
fix: correct misspellings in code comments (#21217)
2026-03-31 13:50:51 +02:00
ngram-mod.cpp
ngram-mod : Add missing include (#23857)
2026-05-29 09:21:37 +03:00
ngram-mod.h
ngram-mod : fix build [no ci] (#19216)
2026-01-30 21:27:27 +02:00
peg-parser.cpp
chat : refactor API (#30210)
2026-10-09 10:06:22 -05:00
peg-parser.h
chat : refactor API (#30210)
2026-10-09 10:06:22 -05:00
preset.cpp
common : prepare load_from_models_dir() for path conversion (#29674)
2026-10-04 11:35:33 +03:00
preset.h
common : use fs::path for config dir (#29649)
2026-09-29 17:22:49 +02:00
reasoning-budget.cpp
llama : support multi-output backend sampling (#25532)
2026-08-10 16:58:56 +03:00
reasoning-budget.h
common : add support for multiple end sequences in the reasoning budget sampler (#25544)
2026-07-25 11:58:09 +02:00
sampling.cpp
llama : report compute graph reallocations during inference (#30329)
2026-10-12 11:53:58 +03:00
sampling.h
chat : refactor API (#30210)
2026-10-09 10:06:22 -05:00
speculative.cpp
models : add Nemotron Super 3.5 VL and Nemotron Bolt 74B A9B support (#30520)
2026-10-15 16:34:56 +03:00
speculative.h
imatrix: calculate activation-based statistics for new format (GGUF) imatrices (#14891)
2026-10-04 11:24:53 +02:00
subproc.cpp
common: add subproc.h wrapper, disabled on android/ios (#26102)
2026-07-26 20:54:25 +02:00
subproc.h
common: add subproc.h wrapper, disabled on android/ios (#26102)
2026-07-26 20:54:25 +02:00
trie.cpp
common : add support for multiple end sequences in the reasoning budget sampler (#25544)
2026-07-25 11:58:09 +02:00
trie.h
common : add support for multiple end sequences in the reasoning budget sampler (#25544)
2026-07-25 11:58:09 +02:00
unicode.cpp
common/peg : handle invalid utf-8 sequences in the AST (#29161)
2026-09-20 06:51:40 -05:00
unicode.h
common/peg : handle invalid utf-8 sequences in the AST (#29161)
2026-09-20 06:51:40 -05:00