New CSV implementation by Jolanrensen · Pull Request #903 · Kotlin/dataframe

Commits on Nov 5, 2024

Parser can now parse Chars. Parser can now skipTypes, extra arg in ParserOptions. Fixed nullStrings not being recognized on old csv implementation by using `tryParse()` instead of specific `StringP…
Jolanrensen
committed
introducing new dataframe-csv module; preprocess KDocs is enabled. introduces `read(Csv|Tsv|Delim)(Str)` based on Deephaven, `write(Csv|Tsv|Delim)`, and `to(Csv|Tsv|Delim)Str` based on Apache commo…
Jolanrensen
committed
changed additionalCsv arguments to a lambda with the builder instance. This allows us to configure the builder first and then let users modify it to their heart's desire.
Jolanrensen
committed

Commits on Nov 11, 2024

Commits on Nov 12, 2024

Commits on Nov 18, 2024

Commits on Nov 19, 2024

working on review feedback
Jolanrensen
committed

Commits on Nov 20, 2024

removed ParserOptions.allTypesExcept; use convertTo in this case. Adapted both csv implementations to use convertTo. Addition of DataColumn<String>.convertTo overloads to allow for ParserOptions (f…
Jolanrensen
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

New CSV implementation#903

New CSV implementation#903
Jolanrensen merged 17 commits intomasterfrom
new-csv-implementation

Commits on Nov 5, 2024

Parser can now parse Chars. Parser can now skipTypes, extra arg in ParserOptions. Fixed nullStrings not being recognized on old csv implementation by using `tryParse()` instead of specific `StringP…

introducing new dataframe-csv module; preprocess KDocs is enabled. introduces `read(Csv|Tsv|Delim)(Str)` based on Deephaven, `write(Csv|Tsv|Delim)`, and `to(Csv|Tsv|Delim)Str` based on Apache commo…

changed additionalCsv arguments to a lambda with the builder instance. This allows us to configure the builder first and then let users modify it to their heart's desire.

Commits on Nov 11, 2024

updated fastDoubleParser to 2.0.1, removed minusSignIsFormatSymbol workaround :)

updated deephavenCsv to 0.15.0, added hasFixedWidthColumns and fixedColumnWidths parameters and updated tests

simplified ColType.DEFAULT implementation by a lot

Commits on Nov 12, 2024

removed @ExperimentalCsv annotation, as manually having to add a dependency is already like an opt-in

added Path support for new csv reader

Commits on Nov 18, 2024

Merge branch 'master' into new-csv-implementation

working on review feedback

disabling FastDoubleParser logs except for DelimCsvTsvTests

Commits on Nov 19, 2024

working on review feedback

Commits on Nov 20, 2024

removed ParserOptions.allTypesExcept; use convertTo in this case. Adapted both csv implementations to use convertTo. Addition of DataColumn<String>.convertTo overloads to allow for ParserOptions (f…

Commits on Nov 22, 2024

fixed my critical misuse of ParserOptions by completely neglecting the global setting `DataFrame.parser`.

Merge branch 'master' into new-csv-implementation

fixup! fixed my critical misuse of ParserOptions by completely neglecting the global setting `DataFrame.parser`.

fixed arrow test by making Parsers.locale requery Locale.getDefault() when no global locale was set.

New CSV implementation#903Jolanrensen merged 17 commits intomasterKotlin/dataframe:masterfrom new-csv-implementationKotlin/dataframe:new-csv-implementationCopy head branch name to clipboard

Commits

Commits on Nov 5, 2024

Commits on Nov 11, 2024

Commits on Nov 12, 2024

Commits on Nov 18, 2024

Commits on Nov 19, 2024

Commits on Nov 20, 2024

Commits on Nov 22, 2024

New CSV implementation#903
Jolanrensen merged 17 commits intomasterfrom
new-csv-implementation