Skip to content

Conversation

@cburroughs
Copy link
Contributor

acryl-datahub [1] contains many different extras for interactions with different data sources (postgres, S3, etc.). All of them together is

300 transitive dependencies and I think counts as "big" in the
context of dependency sets.

[1] https://pypi.org/project/acryl-datahub/

acryl-datahub [1] contains many different extras for interactions with
different data sources (postgres, S3, etc.).  All of them together is
>300 transitive dependencies and I think counts as "big" in the
context of dependency sets.

[1] https://pypi.org/project/acryl-datahub/
@notatallshaw notatallshaw merged commit a54270f into notatallshaw:main Oct 19, 2024
@notatallshaw
Copy link
Owner

Thanks! Not a package I was familiar with, I'll check in it's resolution output, and see if any pending optimization improves it, next time I'm near a computer.

@notatallshaw
Copy link
Owner

FYI pypa/pip#13017 for pip produces a slightly different resolution and install.

It slightly reduces the number of requirements and packages processed:

Difference for scenario scenarios/big-packages.toml - acryl-datahub-all:
        Not the same install files.
        Number of requirements processed: 335 -> 334
        Number of packages processed: 510 -> 504

And 1 package gets a different version install, nbformat 5.10.3 -> 5.10.4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants