-
Notifications
You must be signed in to change notification settings - Fork 13.7k
rustdoc-search: adjust packing heuristics to save more space #145637
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
@bors try @rust-timer queue |
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
rustdoc-search: adjust packing heuristics to save more space
This comment has been minimized.
This comment has been minimized.
Finished benchmarking commit (b7f830d): comparison URL. Overall result: ❌ regressions - please read the text belowBenchmarking this pull request means it may be perf-sensitive – we'll automatically label it not fit for rolling up. You can override this, but we strongly advise not to, due to possible changes in compiler perf. Next Steps: If you can justify the regressions found in this try perf run, please do so in sufficient writing along with @bors rollup=never Instruction countOur most reliable metric. Used to determine the overall result above. However, even this metric can be noisy.
Max RSS (memory usage)Results (primary -3.9%)A less reliable metric. May be of interest, but not used to determine the overall result above.
CyclesResults (primary 18.2%, secondary 14.0%)A less reliable metric. May be of interest, but not used to determine the overall result above.
Binary sizeThis benchmark run did not return any relevant results for this metric. Bootstrap: 472.158s -> 470.896s (-0.27%) |
This upgrade causes stringdex to use fewer, larger files with the suffix-only children included more often. This is particularly aimed at reducing the number of files required by many-assoc-items. The cost of this change is that the browser has to download more data that it isn't using while walking the search tree, because branches of the search tree that it isn't using are in the files it downloads. When I tested against the wordnet dictionary, "indexing" required 12MiB of transfer, where it used to require 8MiB.
2fc9a3a
to
01c946a
Compare
@bors try @rust-timer queue |
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
rustdoc-search: adjust packing heuristics to save more space
This comment has been minimized.
This comment has been minimized.
Finished benchmarking commit (e946368): comparison URL. Overall result: ❌ regressions - please read the text belowBenchmarking this pull request means it may be perf-sensitive – we'll automatically label it not fit for rolling up. You can override this, but we strongly advise not to, due to possible changes in compiler perf. Next Steps: If you can justify the regressions found in this try perf run, please do so in sufficient writing along with @bors rollup=never Instruction countOur most reliable metric. Used to determine the overall result above. However, even this metric can be noisy.
Max RSS (memory usage)Results (secondary -0.2%)A less reliable metric. May be of interest, but not used to determine the overall result above.
CyclesResults (secondary 2.7%)A less reliable metric. May be of interest, but not used to determine the overall result above.
Binary sizeThis benchmark run did not return any relevant results for this metric. Bootstrap: 468.202s -> 466.275s (-0.41%) |
Okay, that seems like an acceptable tradeoff for the doc_files_count that this PR brings. |
These commits modify the If this was unintentional then you should revert the changes before this PR is merged. |
So it reduces the number of files on the disk but increases the network data usage? Not sure it's a good trace. :-/ Also, the previous PR already had up to 50% more instructions, so adding even more on top of it really doesn't seem that great. |
This upgrade causes stringdex to use fewer, larger files with the suffix-only children included more often. This is particularly aimed at reducing the number of files required by many-assoc-items.
The cost of this change is that the browser has to download more data that it isn't using while walking the search tree, because branches of the search tree that it isn't using are in the files it downloads. When I tested against the wordnet dictionary, a search for "indexing" required 12MiB of transfer, where it used to require 8MiB.
#144476 (comment)