-
Notifications
You must be signed in to change notification settings - Fork 68
feat(models): add configurable residual connections in enc-proc-dec #670
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Co-authored-by: Harrison Cook <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks Mario for addressing the comments from my side it's okey, let's see if @HCookie has any other remaining comments and then merge! almost there🚀
HCookie
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nvm, github confused me
Description
This is a follow-up to PR #451 . The branch has been moved to anemoi-core (so we can now run integration tests), and rebased with main.
BaseResidualConnection. It currently supports 3 options:SkipConnection,TruncatedConnection, andNoConnection.SparseProjectorclass which handles the projection logic. This class could be used in the future for the multi-scale loss or other use cases.What problem does this change solve?
Encapsulation of residual connection functionality.
As a contributor to the Anemoi framework, please ensure that your changes include unit tests, updates to any affected dependencies and documentation, and have been tested in a parallel setting (i.e., with multiple GPUs). As a reviewer, you are also responsible for verifying these aspects and requesting changes if they are not adequately addressed. For guidelines about those please refer to https://anemoi.readthedocs.io/en/latest/
By opening this pull request, I affirm that all authors agree to the Contributor License Agreement.
📚 Documentation preview 📚: https://anemoi-training--670.org.readthedocs.build/en/670/
📚 Documentation preview 📚: https://anemoi-graphs--670.org.readthedocs.build/en/670/
📚 Documentation preview 📚: https://anemoi-models--670.org.readthedocs.build/en/670/