Skip to content

deprecation of delayed and static scaling from torchao.float8 #1680

@vkuzo

Description

@vkuzo

Summary

We plan to deprecate delayed and static scaling from torchao.float8 training codebase due to lack of real world use cases for delayed/static scaling (dynamic scaling is required for higher accuracy).

Deprecation timeline

  • v0.9.0: display deprecation warning
  • v0.10.0: deprecate

Alternatives

Use dynamic scaling

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions