llama.cpp/tools at xsn/server_engine - llama.cpp - Gitea: Git with a cup of tea

mirrors/llama.cpp

0 Fork 0

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-10-28 17:56:13 +08:00

Files

T

History

Xuan Son Nguyen 5e59982160 engine: separate engine and server

2026-10-16 20:17:40 +02:00

..

batch: migrate the rest of examples to llama_batch_ext (#29601 )

2026-09-30 18:08:43 +02:00

server: save only restorable slot states to the prompt cache (#30498 )

2026-10-15 06:30:17 +02:00

chat: replace output string with parts (#30389 )

2026-10-14 01:03:56 +02:00

cvector-generator

batch: migrate the rest of examples to llama_batch_ext (#29601 )

2026-09-30 18:08:43 +02:00

engine: separate engine and server

2026-10-16 20:17:40 +02:00

docs: fix export-lora --lora-scaled syntax [no release] (#24703 )

2026-06-18 16:46:17 +02:00

server: use port 9931 by default (#30159 )

2026-10-09 10:40:03 +02:00

cmake : introduce semantic versioning (#26839 )

2026-08-12 14:15:03 +02:00

imatrix : include clocale for std::setlocale (#30079 )

2026-10-07 10:58:22 +02:00

llama-bench: respect -fitc if bigger than required benchmark size (#28331 )

2026-10-09 19:14:30 +02:00

mtmd: add mtmd_audio_stream + support voxtral-realtime (#30629 )

2026-10-16 01:46:42 +02:00

batch: migrate the rest of examples to llama_batch_ext (#29601 )

2026-09-30 18:08:43 +02:00

quantize: cap working memory size to avoid loading big tensors onto RAM (#27795 )

2026-08-27 18:31:13 +02:00

batch: migrate the rest of examples to llama_batch_ext (#29601 )

2026-09-30 18:08:43 +02:00

rpc : turn GGML_RPC_DEBUG into a verbosity level and add logs (#29544 )

2026-10-11 17:43:35 +03:00

engine: separate engine and server

2026-10-16 20:17:40 +02:00

tokenize : drop --stdin mutual-exclusion check (#25672 )

2026-07-15 18:41:51 +02:00

args: add --video-* CLI arguments (#24318 )

2026-08-27 12:11:12 +02:00

metal : key the fa-vec tuned table by family instead of SKU (#29075 )

2026-09-23 19:23:15 +08:00

fix(ui): take the agentic turns default from DEFAULT_AGENTIC_CONFIG (#30582 )

2026-10-15 12:36:06 +02:00

CMakeLists.txt

engine: separate engine and server

2026-10-16 20:17:40 +02:00