You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Small optimization in Parquet varint decoder (#8742)
# Which issue does this PR close?
- Part of #5853.
# Rationale for this change
Following the recent improvements in Thrift decoding, the percentage of
time spent decoding LEB128 encoded integers has increased.
# What changes are included in this PR?
This PR modifies the varint decoder to first test for integers that can
be encoded in a single byte (using zig-zag encoding, the maximum int
that can be encoded is 63). Many of the fields in the Parquet footer
(including all enum values) will be in this range, so optimizing for
this frequent occurrence makes sense.
# Are these changes tested?
Should be covered by existing tests
# Are there any user-facing changes?
No
0 commit comments