GGUFCompressionLab
A small command-line laboratory that streams a GGUF file, estimates byte-level Shannon entropy and compares four general-purpose lossless compressors.
// Workflow
Measure first, then compare
- 01*.ggufSelect a non-empty local file
- 021 MiB → H(X)Stream bytes and estimate entropy
- 03size / ratioCompare generated outputs
// Algorithms
Four standard-library compressors
LZMA .xz
High compression ratio, generally slower.
GZIP .gz
Widely supported and balanced.
BZIP2 .bz2
Alternative block-sorting comparison.
ZLIB .zlib
Fast DEFLATE stream with a small wrapper.
// Boundaries
Explicit experimental scope
What it measures
- Original and compressed byte size
- Byte-frequency distribution
- Shannon entropy in bit per byte
- Compression ratio per algorithm
What it does not measure
- Tensor structure or model semantics
- Quantisation quality
- Inference speed or accuracy
- Specialised GGUF compression
// Release & licence
Readable, tested and reusable
MIT License
Source and documentation may be used, modified and redistributed while preserving the notice.
5 tests
Entropy, empty input and lossless round-trip for all four algorithms.
colorama + tqdm
Third-party owners and licence links are documented in the repository.
Disk usage
Running every algorithm creates four outputs beside the original and may take a long time on large models.
Verified source package
GGUFCompressionLab-1.0.0-source.zip
6,703 bytes
SHA-256
34c1ce293377…caab2cd
Verified after downloading the public release asset.