Georgi Gerganov df11702136 metal : optimize argmax and pool_1d (#30862) ...

* metal : optimize argmax and pool_1d

Add a two-pass partial reduction for large-row argmax and use cooperative threadgroup reductions for pool_1d. Allocate scratch space for the argmax partials through the Metal buffer allocator.

Assisted-by: pi:llama.cpp/ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF (Mac Studio, M2 Ultra, 192GB)

* tests : add pool_1d perf cases

Add representative POOL_1D max cases for the MoE down-projection amax shapes, reducing the whole intermediate dim.

Assisted-by: pi:llama.cpp/ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF (Mac Studio, M2 Ultra, 192GB)

* cont : minor fix

2026-10-20 16:46:00 +03:00

..

fusion

tests : update Metal fusion baseline for beam (#30764)

2026-10-19 09:11:38 +03:00

llama-context

kv-cache: honor PARTIAL_ONLY in the plain KV cache (#30514)

2026-10-15 07:39:18 +03:00

peg-parser

chat : refactor API (#30210)

2026-10-09 10:06:22 -05:00

snapshots

tests : fix typo in test-quant-type-selection for nemotron 3 nano (#28835)

2026-09-13 18:50:46 +02:00

.gitignore

tests : consolidate context state tests into test-llama-context (#30023)

2026-10-13 16:21:55 +03:00

CMakeLists.txt

ggml: fix conv_1d result layout for batched input (#28738)

2026-10-14 14:16:08 +03:00

gguf-model-data.cpp

common : use fs::path for cache dirs (#29595)

2026-09-29 07:24:03 +02:00

gguf-model-data.h

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

test-alloc.cpp

ggml : add alloc_buffer_n to buffer type interface (#23671)

2026-10-02 11:08:08 +03:00

test-arg-parser.cpp

common : add --spec-draft-n-ubatch (#30459)

2026-10-14 13:58:05 +03:00

test-autorelease.cpp

tests : avoid building get-model.cpp many times (#26317)

2026-07-30 19:34:04 +03:00

test-backend-ops.cpp

metal : optimize argmax and pool_1d (#30862)

2026-10-20 16:46:00 +03:00

test-backend-sampler.cpp

sampling : use greedy selection for eligible temperature-zero chains (#29797)

2026-10-07 13:34:18 +03:00

test-barrier.cpp

Fix race conditions in threadpool when dealing with dynamic/frequent n_threads changes (#17748)

2025-12-10 12:32:23 -08:00

test-batch-alloc.cpp

spec: properly handle mtmd input for mtp (#30257)

2026-10-10 11:22:38 +02:00

test-c.c

ggml : remove kompute backend (#14501)

2025-07-03 07:48:32 +03:00

test-chat-analysis.cpp

chat: replace output string with parts (#30389)

2026-10-14 01:03:56 +02:00

test-chat-auto-parser.cpp

chat: replace output string with parts (#30389)

2026-10-14 01:03:56 +02:00

test-chat-peg-parser.cpp

common/peg : handle invalid utf-8 sequences in the AST (#29161)

2026-09-20 06:51:40 -05:00

test-chat-template.cpp

chat: replace output string with parts (#30389)

2026-10-14 01:03:56 +02:00

test-chat.cpp

model: add Muse Spark Open (text, vision and audio) (#30616)

2026-10-15 23:27:12 +02:00

test-col2im-1d.cpp

ggml : add GGML_OP_COL2IM_1D (#24206)

2026-06-09 12:01:37 +03:00

test-conv-1d.cpp

ggml: fix conv_1d result layout for batched input (#28738)

2026-10-14 14:16:08 +03:00

test-double-float.cpp

ggml : minor naming changes (#8433)

2024-07-12 10:46:02 +03:00

test-export-graph-ops.cpp

tests: export-graph-ops: exit gracefully when called w/o arguments (#25619)

2026-07-14 13:15:41 +03:00

test-fusion.cpp

tests : catch vanished rows in the fusion baseline (#30618)

2026-10-16 09:35:19 +03:00

test-gbnf-validator.cpp

cmake : do not include ./src as public for libllama (#13062)

2025-04-24 16:00:10 +03:00

test-gguf-model-data.cpp

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

test-gguf.cpp

gguf : reject tensor size that wraps after padding (#26979)

2026-09-29 22:46:20 +02:00

test-grammar-integration.cpp

common : implement common_schema internal representation for JSON schemas (#28736)

2026-09-12 16:14:50 -05:00

test-grammar-llguidance.cpp

tool/ex/tests: consistently free ctx, then model (#18168)

2025-12-22 11:00:37 +01:00

test-grammar-parser.cpp

grammar : degrade max repetition >= 2000 to unbounded (#26613)

2026-08-05 07:39:10 -05:00

test-jinja.cpp

jinja : implement unique filter (#30819)

2026-10-19 12:18:24 -05:00

test-json-schema-to-grammar.cpp

json-schema : accept escaped hyphen in regex patterns (#29127)

2026-09-19 14:11:13 +02:00

test-json-schema.cpp

common : implement common_schema internal representation for JSON schemas (#28736)

2026-09-12 16:14:50 -05:00

test-llama-archs.cpp

tests : make MoE router selection independent of the backend noise (#30818)

2026-10-20 10:40:15 +03:00

test-llama-context.cpp

tests : consolidate context state tests into test-llama-context (#30023)

2026-10-13 16:21:55 +03:00

test-llama-grammar.cpp

common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)

2026-03-21 18:43:35 +01:00

test-log.cpp

common: Intentionally leak logger instance to fix hanging on Windows (#22273)

2026-04-29 10:58:43 +03:00

test-lora-conversion-inference.sh

cli: new CLI experience (#17824)

2025-12-10 15:28:59 +01:00

test-metal-graph-optimize.cpp

metal : few-row MMA mat-mul (#29869)

2026-10-05 08:29:13 +03:00

test-model-load-cancel.cpp

tests : avoid building get-model.cpp many times (#26317)

2026-07-30 19:34:04 +03:00

test-model-resolution.cpp

ui : Discover & Download Models from HF Hub (#29584)

2026-10-17 17:20:51 +02:00

test-mtmd-c-api.c

mtmd: add mtmd_tokenize_from_parts() (#28250)

2026-09-02 21:20:10 +02:00

test-mtmd-impl.cpp

mtmd : match the transformers Qwen-VL resize (#30736)

2026-10-20 01:14:40 +02:00

test-opt.cpp

tests : fix test-opt with GGML_BACKEND_DL (#15599)

2025-08-26 22:14:38 +02:00

test-peg-parser.cpp

chat : refactor API (#30210)

2026-10-09 10:06:22 -05:00

test-quant-type-selection.cpp

tests : fix typo in test-quant-type-selection for nemotron 3 nano (#28835)

2026-09-13 18:50:46 +02:00

test-quantize-be.sh

tests: add big-endian conversion tests (#30705)

2026-10-19 10:14:58 +02:00

test-quantize-fns.cpp

ggml-quants : avoid invalid rounding in qkx3 scale search (#29817)

2026-10-02 17:37:35 +03:00

test-quantize-perf.cpp

ci: run the x64 and arm ci on the github machines instead (#16183)

2025-09-25 08:06:06 +03:00

test-quantize-stats.cpp

cmake : introduce semantic versioning (#26839)

2026-08-12 14:15:03 +02:00

test-reasoning-budget.cpp

common : add support for multiple end sequences in the reasoning budget sampler (#25544)

2026-07-25 11:58:09 +02:00

test-rope.cpp

ggml-cpu: templateify ggml_compute_forward_rope_f32 and _f16 (#16805)

2025-11-11 13:33:24 +02:00

test-rpc-multi-server.cpp

rpc: include nb in the get_alloc_size cache key and floor the result at ggml_nbytes (#29283)

2026-09-25 10:35:09 +03:00

test-rpc-multi-server.sh

rpc: avoid serializing buffers from other servers (#26500)

2026-08-30 20:26:16 +03:00

test-rset-release.cpp

tests : avoid building get-model.cpp many times (#26317)

2026-07-30 19:34:04 +03:00

test-sampling.cpp

llama : add missing headers (#28566)

2026-09-08 12:59:53 +02:00

test-server-component.cpp

server : escape the special tokens without std::regex (#30243)

2026-10-14 01:17:11 +02:00

test-thread-safety.cpp

vulkan : fix concurrent first device init (#29766)

2026-10-15 10:37:35 +02:00

test-tiled-mulmat.cpp

ggml-cpu: tiled mul_mat for k-quants (#27851)

2026-09-26 08:38:57 +03:00

test-tokenizer-0.cpp

tool/ex/tests: consistently free ctx, then model (#18168)

2025-12-22 11:00:37 +01:00

test-tokenizer-0.py

requirements : update transformers to 5.5.1 (#21617)

2026-04-09 12:36:29 +02:00

test-tokenizer-0.sh

model : add Jina Embeddings v5 Nano (partial EuroBERT) support (#19826)

2026-02-26 12:14:09 +01:00

test-tokenizer-1-bpe.cpp

tool/ex/tests: consistently free ctx, then model (#18168)

2025-12-22 11:00:37 +01:00

test-tokenizer-1-spm.cpp

tool/ex/tests: consistently free ctx, then model (#18168)

2025-12-22 11:00:37 +01:00

test-tokenizer-random.py

requirements : update transformers to 5.5.1 (#21617)

2026-04-09 12:36:29 +02:00

test-tokenizers-repo.sh

devops: add s390x & ppc64le CI (#15925)

2025-09-27 02:03:33 +08:00

test-unicode.cpp

unicode : reject overlong UTF-8 and out-of-range codepoints (#30485)

2026-10-15 10:12:56 +03:00

testing.h

tests : link each test against only the libraries it uses (#30299)

2026-10-12 13:32:56 +03:00