Skip to content

Reduce SortExec memory usage by void constructing single huge batch #2132

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Apr 5, 2022
Merged

Reduce SortExec memory usage by void constructing single huge batch #2132

Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
6f83571
wip
yjshen Apr 1, 2022
4497d11
workable version
yjshen Apr 1, 2022
971ded6
sort to bench
yjshen Apr 1, 2022
acff377
use sort2
yjshen Apr 1, 2022
1e120de
Replace
yjshen Apr 2, 2022
ad361c1
revert unexpected changes
yjshen Apr 2, 2022
28f5f45
iter rework
yjshen Apr 2, 2022
e56919b
minor
yjshen Apr 2, 2022
75c6912
prepare
yjshen Apr 2, 2022
6bf7b9d
avoid evaluating sort columns twice
yjshen Apr 3, 2022
73ad8f0
revert unrelated changes
yjshen Apr 4, 2022
ad3a4d2
Update datafusion/core/src/physical_plan/sorts/sort.rs
yjshen Apr 5, 2022
e4bee9d
resolve comments
yjshen Apr 5, 2022
2325d1a
refactor a little bit
yjshen Apr 5, 2022
93f9d4d
assertion
yjshen Apr 5, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading