Donate Ray SQL to the DataFusion Project#1

Merged

andygrove merged 45 commits intoapache:mainfrom

austin362667:main

Sep 30, 2024

Commits on Sep 20, 2024

Initial commit

andygrove
authored and
austin362667
committed
Basic project structure

andygrove
authored and
austin362667
committed
gitignore

andygrove
authored and
austin362667
committed
Add protobuf plumbing (#2)

andygrove
authored and
austin362667
committed
Implement protobuf codec

andygrove
authored and
austin362667
committed
Wire up query execution (#4)

andygrove
authored and
austin362667
committed
query runs end to end (#5)

andygrove
authored and
austin362667
committed
re-organize python code (#6)

andygrove
authored and
austin362667
committed
Implement shuffle more fully (#7)

andygrove
authored and
austin362667
committed
update README (#8)

andygrove
authored and
austin362667
committed
Bug fix (#9)

andygrove
authored and
austin362667
committed
Support multiple shuffle partitions (#10)

andygrove
authored and
austin362667
committed
More shuffle fixes (#11)

andygrove
authored and
austin362667
committed
fix readme (#12)

andygrove
authored and
austin362667
committed
add perf chart (#13)

andygrove
authored and
austin362667
committed
Remove hard-coded temp dir (#14)

andygrove
authored and
austin362667
committed
bug fix (#15)

andygrove
authored and
austin362667
committed
New results (#16)

andygrove
authored and
austin362667
committed
Upgrade to DataFusion 17, fix a couple of bugs, add some tests (#18)

andygrove
authored and
austin362667
committed
Remove debug logging (#19)

andygrove
authored and
austin362667
committed
update README (#21)

andygrove
authored and
austin362667
committed
Make better use of futures (#23)

andygrove
authored and
austin362667
committed
Documentation & bug fixes (#24)

andygrove
authored and
austin362667
committed
Update README.md

andygrove
authored and
austin362667
committed
[WIP] Use Ray object store for shuffle exchange (#28)

frank-lsf
authored and
austin362667
committed
Fixes for Ray-based shuffle (#29)

frank-lsf
authored and
austin362667
committed
Small fixes for Context (#30)

frank-lsf
authored and
austin362667
committed
Make distributed execution work (#33)

frank-lsf
authored and
austin362667
committed
Upgrade to DataFusion 20 (#31)

andygrove
authored and
austin362667
committed
Add support for DDL statements, such as `CREATE VIEW` (#35)

andygrove
authored and
austin362667
committed
Use PyArrow for zero-copy interaction with the Ray Object Store (#36)

frank-lsf
authored and
austin362667
committed
Add Frank as author (#37)

andygrove
authored and
austin362667
committed
fix hyperlink of issue 22 in docs/README.txt (#40)

authored and
austin362667
committed
delta lake and iceberg table support (#43)

raviranak
authored and
austin362667
committed
Update DataFusion version to 28.0.0 (#41)

andygrove
authored and
austin362667
committed
Upgrade to DataFusion 33 (#45)

andygrove
authored and
austin362667
committed
Add basic GitHub workflow to compile code (#47)

andygrove
authored and
austin362667
committed
fix

andygrove
authored and
austin362667
committed
fix

andygrove
authored and
austin362667
committed
fix

andygrove
authored and
austin362667
committed
fix

andygrove
authored and
austin362667
committed
fix

andygrove
authored and
austin362667
committed
fix

andygrove
authored and
austin362667
committed
Add ASF license header
austin362667
committed
Remove ASF header for generated code
austin362667
committed