Review: llama.cpp 10192+dfsg-2~exp1
Package Information
| Description | LLM inference in C/C++ - metapackage The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud. * Plain C/C++ implementation without any dependencies * Apple silicon is a first-class citizen - optimized via ARM NEON, Accelerate and Metal frameworks * AVX, AVX2, AVX512 and AMX support for x86 architectures * 1.5-bit, 2-bit, 3-bit, 4-bit, 5-bit, 6-bit, and 8-bit integer quantization for faster inference and reduced memory use * Custom CUDA kernels for running LLMs on NVIDIA GPUs (support for AMD GPUs via HIP and Moore Threads MTT GPUs via MUSA) * Vulkan and SYCL backend support * CPU+GPU hybrid inference to partially accelerate models larger than the total VRAM capacity The compute functionality is provided by ggml. By default, ggml's CPU backend is installed, but there are many other backends for CPUs and GPUs. This is a metapackage that either depends on all of the relevant binary packages. |
|---|---|
| Maintainer | Debian Deep Learning Team <debian-ai@lists.debian.org> |
| Changed By | Christian Kastner <ckk@debian.org> |
| Sponsor | ckk@debian.org |
| Distribution | experimental |
| Architecture | any all |
| VCS | git: https://salsa.debian.org/deeplearning-team/llama.cpp.git (browse) |
| Popcon Installs | 117 |
| Binary NEW | Yes (binary-only upload) |
| Tracker | https://tracker.debian.org/pkg/llama.cpp |
| Uploaded | 4 hours ago |
New Package Report
.changes
| Date | Fri, 31 Jul 2026 10:28:52 +0200 |
|---|---|
| Source | llama.cpp |
| Version | 10192+dfsg-2~exp1 |
| Changed-By | Christian Kastner |
| Architecture | source amd64 all |
| Distribution | experimental |
Changelog
llama.cpp (10192+dfsg-2~exp1) experimental; urgency=medium
.
* Factor out systemd services into their own package.
This keeps dependencies of llama.cpp-tools lean.
* Document one missing copyright attribution for Intel.dsc
| Section | libdevel |
|---|---|
| Priority | optional |
| Component | main |
| Package-List | libllama-dev deb libdevel optional arch=any libllama0 deb libs optional arch=any llama.cpp deb science optional arch=all llama.cpp-examples deb science optional arch=any llama.cpp-services deb science optional arch=all llama.cpp-tests deb science optional arch=any llama.cpp-tools deb science optional arch=any llama.cpp-tools-extra deb science optional arch=any python3-gguf deb python optional arch=all |
debian/copyright
Format: https://www.debian.org/doc/packaging-manuals/copyright-format/1.0/
Upstream-Name: llama.cpp
Upstream-Contact:
Source: https://github.com/ggml-org/llama.cpp
Files-Excluded: examples/llama.android/gradle/wrapper/gradle-wrapper.jar
ggml/CMakeLists.txt
ggml/include
ggml/src
models
tools/ui/src/lib/vendors
Comment:
We remove all of the embedded ggml except for ggml/cmake, which contains
functionality needed by the llama.cpp build. This is to avoid unnecessary
repetition of copyright statements.
.
DFSG compliance
---------------
We remove all of the model-related files, as some where generated from
external sources, such as huggingface data.
.
We remove some pre-built files of the Web UI, as well as of the Android
sources.
.
We remove vendor libraries of the Web UI, as we don't build the UI.
.
False positives
---------------
The following files contain the string "copyright", but these aren't
assertions, just part of documentation or output or other:
- docs/backend/CUDA-FEDORA.md
- examples/retrieval/README.md
- scripts/apple/validate-macos.sh
Files: *
Copyright: 2023-2026, The ggml authors
License: Expat
Files: common/base64.hpp
Copyright: Placed in the public domain
License: public-domain-1
Files: gguf-py/*
Copyright: 2023 Georgi Gerganov
License: Expat
Files: examples/gguf-hash/deps/xxhash/xxhash.*
Copyright: 2012-2023, Yann Collet
License: BSD-2-clause
Files: examples/llama.android/gradlew
Copyright: 2015, the original authors
License: Apache-2.0
Comment: The "original authors" seem to refer to the Gradle project, where this
script seems to originate from. See:
https://github.com/gradle/gradle/blob/master/gradlew
Files: scripts/install-oneapi.bat
Copyright: 2024, Intel Corporation
License: Expat
Files: tools/mtmd/legacy-models/minicpmv-convert-image-encoder-to-gguf.py
Copyright: 2024, Google AI and The HuggingFace Team
License: Apache-2.0
Files: vendor/nlohmann/*
Copyright: 2009, Florian Loitsch <https://florian.loitsch.com/>
2008-2009 Bjoern Hoehrmann <bjoern@hoehrmann.de>
2013-2025, Niels Lohmann <https://nlohmann.me>
2016-2021, Even Nemerson <evan@nemerson.com>
2017, The Abseil authors
License: Expat and Apache-2.0
Comment: The copyright year for the code by the Abseil authors is not mentioned
in the code. I have retrieved it from the upstream repository referenced in
the code comment.
Files: vendor/stb/*
Copyright: Placed in the public domain
Alternatively: 2017, Sean Barrett
License: public-domain-2 or Expat
Comment:
------------------------------------------------------------------------------
This software is available under 2 licenses -- choose whichever you prefer.
------------------------------------------------------------------------------
ALTERNATIVE A - MIT License
------------------------------------------------------------------------------
ALTERNATIVE B - Public Domain (www.unlicense.org)
------------------------------------------------------------------------------
Files: vendor/cpp-httplib/*
Copyright: 2026 Yuji Hirose
License: Expat
Files: vendor/miniaudio/*
Copyright: 2026, David Reid
License: public-domain-2 or MIT-no-attribution
Comment:
------------------------------------------------------------------------------
This software is available under 2 licenses -- choose whichever you prefer.
------------------------------------------------------------------------------
ALTERNATIVE A - Public Domain (www.unlicense.org)
------------------------------------------------------------------------------
ALTERNATIVE B - MIT No Attribution
------------------------------------------------------------------------------
Files: vendor/sheredom/subprocess.h
Copyright: Placed in the public domain
License: public-domain-2
Files: debian/*
Copyright: 2024-2026 Christian Kastner <ckk@debian.org>
2025-2026 Mathieu Baudier <mbaudier@argeo.org>
License: Expat
Files: debian/simplechat-legacy-ui/*
Copyright: 2023-2026, The ggml authors
License: Expat
Comment:
Upstream removed these themes in b8708. We have re-added copies of these
under debian/legacy-themes because we need at least one DFSG-compliant
theme for the server.
License: Expat
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
.
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
License: MIT-no-attribution
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so.
.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
License: BSD-2-clause
Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions are
met:
.
* Redistributions of source code must retain the above copyright
notice, this list of conditions and the following disclaimer.
* Redistributions in binary form must reproduce the above
copyright notice, this list of conditions and the following disclaimer
in the documentation and/or other materials provided with the
distribution.
.
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
"AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
License: Apache-2.0
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
.
http://www.apache.org/licenses/LICENSE-2.0
.
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
.
On Debian systems, the complete text of the Apache version 2.0 license
can be found in "/usr/share/common-licenses/Apache-2.0".
License: public-domain-1
This is free and unencumbered software released into the public domain.
.
Anyone is free to copy, modify, publish, use, compile, sell, or
distribute this software, either in source code form or as a compiled
binary, for any purpose, commercial or non-commercial, and by any
means.
.
In jurisdictions that recognize copyright laws, the author or authors
of this software dedicate any and all copyright interest in the
software to the public domain. We make this dedication for the benefit
of the public at large and to the detriment of our heirs and
successors. We intend this dedication to be an overt act of
relinquishment in perpetuity of all present and future rights to this
software under copyright law.
.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
IN NO EVENT SHALL THE AUTHORS BE LIABLE FOR ANY CLAIM, DAMAGES OR
OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE,
ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR
OTHER DEALINGS IN THE SOFTWARE.
.
For more information, please refer to <http://unlicense.org>
License: public-domain-2
This is free and unencumbered software released into the public domain.
.
Anyone is free to copy, modify, publish, use, compile, sell, or distribute this
software, either in source code form or as a compiled binary, for any purpose,
commercial or non-commercial, and by any means.
.
In jurisdictions that recognize copyright laws, the author or authors of this
software dedicate any and all copyright interest in the software to the public
domain. We make this dedication for the benefit of the public at large and to
the detriment of our heirs and successors. We intend this dedication to be an
overt act of relinquishment in perpetuity of all present and future rights to
this software under copyright law.
.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN
ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Comment: For more information, please refer to <http://unlicense.org/>
Review Information
accepted — allocated to awm 1 hour ago, started 1 hour ago, completed 1 hour ago.