1. v4 / master, same method (median time ratio; 1.00 = no change) corpus size op | pglz | lz4 | round-to-round spread of master (pglz, lz4) docs 4000 load | 1.00 | 0.99 | 1.00, 1.00 docs 4000 read_all | 1.00 | 1.01 | 1.00, 1.00 docs 4000 slice | 1.00 | 1.02 | 1.01, 1.01 docs 4000 prefix | 1.02 | 1.03 | 1.00, 1.00 docs 32000 load | 1.00 | 1.03 | 1.00, 1.01 docs 32000 read_all | 0.99 | 1.03 | 1.03, 1.00 docs 32000 slice | 1.00 | 1.04 | 1.00, 1.02 docs 32000 prefix | 1.05 | 1.03 | 1.05, 1.00 docs 1000000 load | 1.00 | 1.01 | 1.00, 1.01 docs 1000000 read_all | 1.01 | 1.00 | 1.01, 1.00 docs 1000000 slice | 1.00 | 1.01 | 1.01, 1.03 docs 1000000 prefix | 1.00 | 0.96 | 1.00, 1.04 json 4000 load | 1.01 | 1.02 | 1.01, 1.02 json 4000 read_all | 1.02 | 1.02 | 1.02, 1.02 json 4000 slice | 1.00 | 1.02 | 1.00, 1.00 json 4000 prefix | 1.04 | 1.00 | 1.04, 1.00 json 32000 load | 1.01 | 1.05 | 1.00, 1.03 json 32000 read_all | 1.01 | 1.04 | 1.00, 1.00 json 32000 slice | 1.03 | 1.06 | 1.00, 1.00 json 32000 prefix | 1.00 | 1.08 | 1.05, 1.00 json 1000000 load | 1.00 | 0.99 | 1.00, 1.01 json 1000000 read_all | 1.00 | 1.00 | 1.00, 1.01 json 1000000 slice | 0.98 | 0.98 | 1.04, 1.00 json 1000000 prefix | 1.00 | 1.00 | 1.00, 1.00 random 4000 load | 1.02 | 1.02 | 1.02, 1.03 random 4000 read_all | 1.03 | 1.12 | 1.01, 1.02 random 4000 slice | 1.02 | 1.06 | 1.01, 1.02 random 4000 prefix | 1.03 | 1.02 | 1.01, 1.02 random 32000 load | 1.01 | 1.11 | 1.00, 1.02 random 32000 read_all | 1.00 | 0.99 | 1.02, 1.02 random 32000 slice | 1.00 | 1.00 | 1.00, 1.04 random 32000 prefix | 1.00 | 1.02 | 1.04, 1.08 random 1000000 load | 1.05 | 1.00 | 1.03, 1.02 random 1000000 read_all | 0.99 | 0.98 | 1.01, 1.02 random 1000000 slice | 1.00 | 1.00 | 1.00, 1.00 random 1000000 prefix | 1.05 | 1.00 | 1.10, 1.00 2. Methods on v4: stored size (% of raw), then median ms per operation corpus size | pglz | lz4 | zstd docs 4000 stored | 48.2% | 57.4% | 36.3% docs 4000 load ms | 1683 | 540 | 854 docs 4000 read_all ms | 224 | 105 | 228 docs 4000 slice ms | 140 | 88 | 227 docs 4000 prefix ms | 42 | 62 | 227 docs 32000 stored | 35.7% | 41.0% | 26.9% docs 32000 load ms | 2030 | 390 | 592 docs 32000 read_all ms | 196 | 76 | 146 docs 32000 slice ms | 120 | 57 | 172 docs 32000 prefix ms | 22 | 34 | 168 docs 1000000 stored | 30.8% | 32.8% | 21.0% docs 1000000 load ms | 2028 | 384 | 556 docs 1000000 read_all ms | 234 | 101 | 142 docs 1000000 slice ms | 103 | 38 | 59 docs 1000000 prefix ms | 11 | 23 | 29 json 4000 stored | 18.6% | 29.3% | 13.7% json 4000 load ms | 798 | 278 | 445 json 4000 read_all ms | 57 | 53 | 140 json 4000 slice ms | 44 | 43 | 142 json 4000 prefix ms | 24 | 23 | 140 json 32000 stored | 13.0% | 25.8% | 8.7% json 32000 load ms | 814 | 200 | 248 json 32000 read_all ms | 46 | 49 | 81 json 32000 slice ms | 34 | 38 | 122 json 32000 prefix ms | 19 | 27 | 111 json 1000000 stored | 12.1% | 18.0% | 4.6% json 1000000 load ms | 792 | 192 | 213 json 1000000 read_all ms | 78 | 78 | 94 json 1000000 slice ms | 26 | 26 | 35 json 1000000 prefix ms | 10 | 17 | 18 random 4000 stored | 137.8% | 137.8% | 78.1% random 4000 load ms | 1026 | 510 | 711 random 4000 read_all ms | 105 | 116 | 223 random 4000 slice ms | 86 | 91 | 225 random 4000 prefix ms | 84 | 86 | 223 random 32000 stored | 102.9% | 102.9% | 77.0% random 32000 load ms | 1394 | 366 | 370 random 32000 read_all ms | 56 | 56 | 140 random 32000 slice ms | 25 | 26 | 167 random 32000 prefix ms | 25 | 26 | 165 random 1000000 stored | 102.8% | 102.8% | 73.7% random 1000000 load ms | 1504 | 290 | 499 random 1000000 read_all ms | 89 | 88 | 168 random 1000000 slice ms | 11 | 11 | 113 random 1000000 prefix ms | 11 | 11 | 48