Blog: Embedding User-Defined Indexes in Apache Parquet Files (#79)

* draft blog for datafusion custom parquet index

* polish blog

* polish to add why we don't need new format

* Add clickbench rewriten case to improve parquet is good enough

* Update content/blog/datafusion-custom-parquet-index.md

Co-authored-by: Andrew Lamb <[email protected]>

* start addressing comments

* continue addressing comments

* continue polish doc

* address comments

* address comments

* Add frontmatter and images, start filling out parquet background

* tweak

* tiny fix

Signed-off-by: Jigao Luo <[email protected]>

* Custom Index --> User Defined Index

* Work on parquet background more

* Add the Outlooking section

Signed-off-by: Jigao Luo <[email protected]>

* Update custom index structure image, rename, updates

* Work on example

* tweak conclusion

* Wordsmith pass (thanks to Copilot / Claude 4.0 for the help)

* Update date to 2025-07-14

* tweak title

* Use Footer-metadata and fix typo (#2)

* Use Footer-metadata and fix typo

Signed-off-by: Jigao Luo <[email protected]>

* Footer Metadata

Signed-off-by: Jigao Luo <[email protected]>

---------

Signed-off-by: Jigao Luo <[email protected]>

* Update content/blog/2025-07-14-user-defined-parquet-indexes.md

Co-authored-by: Oleks V <[email protected]>

* Address comment

* address comments

* address comments

* Apply suggestions from code review

* Hone motivating example text

* Hone motivating example text

* hone

* Add note in example about files_to_scan

* more tweaks

* obsess

---------

Signed-off-by: Jigao Luo <[email protected]>
Co-authored-by: Andrew Lamb <[email protected]>
Co-authored-by: Jigao Luo <[email protected]>
Co-authored-by: Oleks V <[email protected]>

Author: 4 people