fix: try and remove all noqa's after packaging

[sbillinge]

initial work to get pre-commit to pass required a bunch of noqa's but try and get rid of as many as possible after scikit-packaging is further along