Add option to control predicate cache, documentation, ArrowReaderMetrics and tests

[alamb]

Which issue does this PR close?

• Part of Speed up Parquet filter pushdown v4 (Predicate evaluation cache for async_reader) apache/arrow-rs#7850

Merging this PR will update the apache PR apache#7850

Rationale for this change

We need a way to turn off predicate caching as an escape valve for users who run into problems with the cache. This PR adds an option to the ArrowReaderBuilder to control the predicate cache size.

In order to test that this setting actually works, I also wrote tests.

What changes are included in this PR?

Changes:

1. Add ArrowReaderMetrics struct that tracks the IO and CPU operations of the reader.
2. Add ArrowReaderBuilder::with_max_predicate_cache_size configuration option to control the predicate cache size.
3. Add ArrowReaderBuilder::with_metrics for configuring metrics
4. Add tests to ensure that the predicate cache is used correctly and that the metrics are reported accurately.
5. TODO: Hook up the cached reader in the sync reader

Are these changes tested?

Yes, all the new code is covered by tests

Are there any user-facing changes?

1. New config options
2. New API to get metrics from the arrow reader

[alamb]

FYI @XiangpengHao

[XiangpengHao]

Thank you, these are very nice improvements @alamb !