Skip to content

perf(core): Implement sparse LiveDocs to reduce memory by up to 8x #15413

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 13 commits into
base: main
Choose a base branch
from
+1,806 −13
Open

perf(core): Implement sparse LiveDocs to reduce memory by up to 8x #15413

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
e138ad2
Add LiveDocs interface for efficient deleted document iteration
salvatorecampagna Nov 8, 2025
3be6550
Implement sparse LiveDocs optimization for efficient deleted document…
salvatorecampagna Nov 10, 2025
b403cda
Add CHANGES.txt entry for sparse LiveDocs optimization
salvatorecampagna Nov 10, 2025
0f7add7
Fix forbidden API violations in benchmark classes
salvatorecampagna Nov 10, 2025
1fc7578
Fix TestScorerUtil.testLikelyFixedBits
salvatorecampagna Nov 10, 2025
f0b25d0
Fix google-java-format violation in LiveDocsPathologicalBenchmark
salvatorecampagna Nov 10, 2025
4997b52
Remove System.out usage from benchmark classes
salvatorecampagna Nov 10, 2025
42cfe28
bench: add memory metrics to LiveDocs JMH benchmarks
salvatorecampagna Nov 10, 2025
0037442
fix(core): use Locale.ROOT in LiveDocs toString() methods
salvatorecampagna Nov 10, 2025
eb03f2f
test(core): use Locale.ROOT in TestLiveDocs assertions
salvatorecampagna Nov 10, 2025
bcbd9f7
refactor: remove SparseLiveBits and clean up unused imports
salvatorecampagna Nov 10, 2025
2037fa1
refactor(core): make LiveDocs implementations final
salvatorecampagna Nov 10, 2025
20d2447
refactor: remove duplicate metrics from LiveDocsBenchmark
salvatorecampagna Nov 11, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions lucene/CHANGES.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -80,6 +80,8 @@ Optimizations

* GITHUB#15085, GITHUB#15092: Hunspell suggestions: Ensure candidate roots are not worse before updating. (Ilia Permiashkin)

* GITHUB#13084: Implement sparse LiveDocs format to reduce memory usage by up to 8x for segments with <=1% deletions. (Salvatore Campagna)

Bug Fixes
---------------------
* GITHUB#14049: Randomize KNN codec params in RandomCodec. Fixes scalar quantization div-by-zero
Expand Down
Loading