mirror of
https://github.com/ggml-org/ggml.git
synced 2026-10-28 08:26:33 +08:00
Georgi Gerganov
da8e2a54b9
The release workflow only shows that the API/ABI check failed, but not what exactly changed, which makes failures hard to investigate. Preserve the API/ABI dumps and reports in APIABI_REPORT_DIR and upload them as a GitHub artifact, so they can be inspected after a failed run. Migrated from llama.cpp: https://github.com/ggml-org/llama.cpp/pull/30619 Assisted-by: pi:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB)
ggml
Tensor library for machine learning
Quick start
Build from source:
git clone https://github.com/ggml-org/ggml
cd ggml
mkdir build && cd build
cmake ..
cmake --build . --config Release -j 8
For a minimal, fully commented example (matrix multiplication), see examples/simple.
Description
The main goal of ggml is to be a simple, portable, and efficient tensor library for machine learning with minimal setup.
- Plain C/C++ implementation without any dependencies
- Cross-platform - x86, ARM, RISC-V, LoongArch, PowerPC, s390x, and WebAssembly
- SIMD-optimized kernels for x86, ARM, and RISC-V
- Broad backend support - CPU, GPU, NPU, and browser
- 2- to 8-bit integer quantization, plus MXFP4 and NVFP4 microscaling formats
- Zero memory allocations during runtime
Documentation
Contributing
- For changes to the core
ggmllibrary (including to the CMake build system), please open a PR in llama.cpp - doing so will make your PR more visible, better tested, and more likely to be reviewed