Skip to content

Conversation

@rafaqz
Copy link
Owner

@rafaqz rafaqz commented Mar 8, 2025

all finialised breaking changes for the next breaking version

tiemvanderdeure and others added 3 commits March 9, 2025 00:29
)

* DimVector of NamedTuple is a NamedTuple table

* bugfix

* remove show

* fix ambiguity
… for `AbstractDimStack` (#903)

* add combine method

* test groupby and similar

* docs entry
@codecov
Copy link

codecov bot commented Mar 9, 2025

Codecov Report

❌ Patch coverage is 79.20000% with 130 lines in your changes missing coverage. Please review.
✅ Project coverage is 82.66%. Comparing base (6db30de) to head (fe0bda9).

Files with missing lines Patch % Lines
src/dimindices.jl 60.86% 54 Missing ⚠️
src/table_ops.jl 81.44% 18 Missing ⚠️
src/array/indexing.jl 70.27% 11 Missing ⚠️
src/stack/indexing.jl 33.33% 10 Missing ⚠️
src/tables.jl 88.23% 10 Missing ⚠️
src/groupby.jl 90.47% 6 Missing ⚠️
src/array/array.jl 90.56% 5 Missing ⚠️
src/stack/stack.jl 91.07% 5 Missing ⚠️
src/utils.jl 42.85% 4 Missing ⚠️
src/array/methods.jl 33.33% 2 Missing ⚠️
... and 5 more
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #946      +/-   ##
==========================================
- Coverage   86.90%   82.66%   -4.24%     
==========================================
  Files          55       57       +2     
  Lines        5338     5631     +293     
==========================================
+ Hits         4639     4655      +16     
- Misses        699      976     +277     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

* add preservedims keyword to DimTable

* add tests

* Apply suggestions from code review

Co-authored-by: Anshul Singhvi <[email protected]>

* tests, and fix DimSlices

* better table docs

* cleanup

* test

* indexing overhaul

* fix similar and broadcast for basicdimarray

* bugfix rebuildsliced

* more indexing cleanup

* cleanup similar and gubfix indexing

* bugfixes

* uncomment

* fix doctests

* just dont doctest unreproducable failures, for now

* combine new Tables integrations

* bugfix and cleanup show

* bugfix and more tests for preservedims and mergedims

---------

Co-authored-by: Anshul Singhvi <[email protected]>
rafaqz and others added 3 commits June 28, 2025 19:11
* iterate values where no layer is missing

* add tests

* add skipmissing to reference
* Table Materializer Methods

* Made col Optional for DimArray

* Apply suggestions from code review

Co-authored-by: Rafael Schouten <[email protected]>

* Handle coordinates with different loci

* replaced At() with Contains() in _coords_to_ords

* Added optional selectors and public methods for table materializer

* Updated table constructors for DimArray and DimStack

* Updated DimArray and DimStack docs to include table materializer methods

* Table materializer test cases

* export table materializer methods

* Added Random to tables.jl test cases

* Update src/array/array.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Removed exports

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Replaced selector type with instance.

* Table materializer can now infer dimensions from the coordinates.

* Update src/stack/stack.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/array/array.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/table_ops.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Added support for guessing the dimension ordering and span for Dates and DateTimes

* Replaced LinRange with StepRangeLen in _build_dim

* Added Tables.istable check to DimArray constructor

* Update src/array/array.jl

* merge materialize2

* fix scuffed merge

* filter instead of indexing in test for clarity

* fix DimSlices doc

* fix ambiguities

* bugfixes

* do checks and call Tables.columns before constructing stack from table

* test dimensions are automatically detected when constructing dimstack

* comments not docstrings for internals

* check for columnaccess if dims are passed

* add type argument to dimarray_from_table

* allow passing name to DimStack

* add a section to the documentation

* use Tables.columnnames instead of keys

* make DimArray work with all tables that are abstractarrays

* do not treat dimvectors as tables

* simplify get_column

---------

Co-authored-by: Rafael Schouten <[email protected]>
Co-authored-by: Tiem van der Deure <[email protected]>
@rafaqz
Copy link
Owner Author

rafaqz commented Aug 11, 2025

@tiemvanderdeure could you possibly resolve the broadcast.jl conflicts locally and PR them? (merge main into broken and just keep the changes to broadcast.jl)

There is now the BasicDimArray broadcast style, and your changes clash, and I'm not totally accross the new broadcast changes to know what to keep.

I can resolve the other conflicts afterwards

@rafaqz
Copy link
Owner Author

rafaqz commented Aug 15, 2025

Ok CHANGELOG.jl added, closing #983

After this I want to merge to main and bump a new breaking version, if there are any reviews or complaints about that get them in in the next 24 hours!

tiemvanderdeure and others added 4 commits August 17, 2025 11:35
* add _similar dispatch for abstractdimarray

* update tests

* Update src/array/array.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update src/array/array.jl

Co-authored-by: Rafael Schouten <[email protected]>

---------

Co-authored-by: Rafael Schouten <[email protected]>
* standardise interface methods and remove index

* update Changelog

* cleanup

* move const

* cleanup

* remove index from test

* dont export index

* last index

* tweaks

* more tweaks

* fix tests

---------

Co-authored-by: Raf Schouten <[email protected]>
* Forward name keyword in groupby

* Add test for setting groupby name explicitly

* Update src/groupby.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Update test/groupby.jl

Co-authored-by: Rafael Schouten <[email protected]>

* Add Changelog entry

* Mention name keyword in docstring

---------

Co-authored-by: Rafael Schouten <[email protected]>
@felixcremer
Copy link
Collaborator

Do you want to also merge the other breaking branches as well or what is your timeline for the breaking release?

@rafaqz
Copy link
Owner Author

rafaqz commented Aug 21, 2025

I'm not sure they will all make it, or how long it's worth waiting

* Remove rtol from At selector

* Remove explicit rtol from test

* Remove unused type parameter

* fix At constructors

---------

Co-authored-by: Rafael Schouten <[email protected]>
@tiemvanderdeure
Copy link
Collaborator

I just ran some tests locally on this branch and a bunch of them fail because 3-argument At now isn't defined anymore. I guess it's we just get rid of the 3rd argument and that's it?

I want to give the instantiate thing another shot. I just tested with Rasters and it just needs some minor changes to work. I figured I might as well make it on a branch from this branch, so we don't run into the merge conflicts again (and I suspect I might be able to get rid of the BasicDimensionalStyle introduced in #917). But now I'm getting these unrelated test errors

@felixcremer
Copy link
Collaborator

Do you have an idea why code coverage drops so significantly? It seems to be a lot of indirect changes but the test changes seem to be mainly removing index. I am wondering whether we are not hitting certain dispatch routes not anymore.

@felixcremer
Copy link
Collaborator

This change incorporates the PRs:
#876 #839 #903 #917 #1009 #1041 #739 #1082 #1083 #1087 #1084 #1062

tiemvanderdeure and others added 2 commits October 15, 2025 19:46
…tions (#1113)

* do 0.6, 0.7.2 broke for us (#1099)

* Fix tests on julia 1.12 (#1110)

* use isequal instead of === to compare NaN

* drop all and broadcast

* specify DimensionalData.Dimensions to make reference unique in docs

* drop convert method for name to abstractstring

* remove `merge` method for dimstack with iterators of pairs

* add to changelog

---------

Co-authored-by: Lazaro Alonso <[email protected]>
@rafaqz
Copy link
Owner Author

rafaqz commented Oct 16, 2025

@codecov-ai-reviewer test

@codecov-ai
Copy link
Contributor

codecov-ai bot commented Oct 16, 2025

On it! Codecov is generating unit tests for this PR.

@codecov-ai
Copy link
Contributor

codecov-ai bot commented Oct 16, 2025

Sentry has determined that unit tests are not necessary for this PR.

@rafaqz
Copy link
Owner Author

rafaqz commented Oct 16, 2025

lol, codecov is lazy on this one

@tiemvanderdeure
Copy link
Collaborator

Should we make a plan for which PR's we still want to include and when we want to release this? Just so it doesn't drag on forever

@rafaqz
Copy link
Owner Author

rafaqz commented Oct 26, 2025

@tiemvanderdeure isn't it just your broadcast PR? I'm not waiting for anything else

@tiemvanderdeure
Copy link
Collaborator

There are a few open PRs that are marked breaking like #847 #926 #991 and possibly including refdims in tables by default #1119. Are we including any of those as well or is that for the next breaking release?

I think #1118 is already safe to merge - but I can make a Rasters branch for DD 0.30 later today and run tests to double check.

@rafaqz
Copy link
Owner Author

rafaqz commented Oct 26, 2025

Yeah please test in Rasters first.

Those branches are all breaking but none of them are ready, so they can wait.

* implement `instantiate` - get rid of BasicDimensionalStyle

* fix setindex! for opaquearray to make some error messages clearer

* fix materialize!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants