0 Fork 0

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-10-28 09:45:55 +08:00

Files

T

History

ppAlexa 8f97d82da3 tools : reject truncated GGUF tensor data in split and export tools (#30497 )

* The problem here in the repo is gguf-split can silently produce corrupted tensor output when the input GGUF file is truncated. The fix is to add tensor-data bounds checks and short-read checks in gguf-split.cpp and export-lora.cpp, and a regression test that checks truncated input is rejected and valid tensor data is preserved.#

* Bug : GGUF-split can silently produce corrupted tensor output when the input GGUF file is truncated. Fix : add short-read checks in gguf-split.cpp (in copy_file_to_file in split_strategy) and export-lora.cpp (in read_tensor_data of file_input) so that truncated input is rejected.

2026-10-19 09:27:46 +03:00

CMakeLists.txt

libs : rename libcommon -> libllama-common (#21936 )

2026-04-17 11:11:46 +03:00

export-lora.cpp

tools : reject truncated GGUF tensor data in split and export tools (#30497 )

2026-10-19 09:27:46 +03:00

README.md

docs: fix export-lora --lora-scaled syntax [no release] (#24703 )

2026-06-18 16:46:17 +02:00

README.md

export-lora

Apply LORA adapters to base model and export the resulting model.

usage: llama-export-lora [options]

options:
  -m,    --model FNAME                  model path from which to load base model
         --lora FNAME                   path to LoRA adapter (use comma-separated values to load multiple adapters)
         --lora-scaled FNAME:SCALE,...  path to LoRA adapter with user defined scaling (format: FNAME:SCALE,...)
  -o,    --output, --output-file FNAME  output file (default: 'ggml-lora-merged-f16.gguf')

For example:

./bin/llama-export-lora \
    -m open-llama-3b-v2.gguf \
    -o open-llama-3b-v2-english2tokipona-chat.gguf \
    --lora lora-open-llama-3b-v2-english2tokipona-chat-LATEST.gguf

Multiple LORA adapters can be applied by passing comma-separated values to --lora FNAME or --lora-scaled FNAME:SCALE,...:

./bin/llama-export-lora \
    -m your_base_model.gguf \
    -o your_merged_model.gguf \
    --lora-scaled lora_task_A.gguf:0.5,lora_task_B.gguf:0.5