Python MacOS arm64 release binaries

[lutzroeder]

Describe the bug

ONNX Runtime does not install using pip on M1.

System information

• OS Platform and Distribution (e.g., Linux Ubuntu 16.04): macOS 11.2.1
• ONNX Runtime installed from (source or binary): pip
• Python version: 3.9.1

To Reproduce

~: uname -v
Darwin Kernel Version 20.3.0: Thu Jan 21 00:06:51 PST 2021; root:xnu-7195.81.3~1/RELEASE_ARM64_T8101
~: which python3
/opt/homebrew/bin/python3
~: which pip
/opt/homebrew/bin/pip
~: python3 --version
Python 3.9.1
~: pip install onnxruntime
ERROR: Could not find a version that satisfies the requirement onnxruntime
ERROR: No matching distribution found for onnxruntime

[snnn]

What kind of tag we should publish? Does pypi have a standard for that?

[lutzroeder]

@ronaldoussoren is there some official guidance? Guessing that macosx_v_universal2 would be more convenient vs. macosx_v_arm64 and macosx_v_x64_86? See also pypa/packaging#319.

[snnn]

Is it in the latest pip release? What's the version requirement of pip to support it?

[ronaldoussoren]

pip 21.0.1 can install universal2 wheels (I've just verified this on my machine). For my own projects I currently publish an x86_64 wheel as before and a universal2 wheel for folks with M1 systems. I intend to drop the x86_64 wheels from releases later this year.

My personal preference is to have universal2 wheels. That reduces the amount of different wheels needed, and more importantly makes it a lot easier to build applications that can be used on both Intel and M1 Macs using tools like py2app and pyinstaller.

For projects with huge wheels such as tensorflow (which wheels well over 150MB) having per-architecture wheels is likely better due to disk usage considerations.

[snnn]

@ronaldoussoren Thank you for the information, it is really helpful. We will look into it.

Currently we are preparing the release for 1.7. The deadline is soon. Likely this feature won't be in that release. Sorry.

[lutzroeder]

onnx/onnx#3129

[sarim-zafar]

any update on this?

[snnn]

I'm working on it.

[snnn]

Reference:

1. https://developer.apple.com/documentation/apple-silicon/building-a-universal-macos-binary
2. add support for macos 11.0, arm64, universal2 pypa/packaging#319

I think we can do cross-compiling on a Mac X86 hardware. Anybody knows more details? What should I do?

[snnn]

Let me try to leverage https://cibuildwheel.readthedocs.io/en/stable/options/

[hossein1387]

what is the plan to support Onnxruntime on M1 chip?

[OlegTheCat]

Being able to run ONNX on M1 Macs is very desired. Currently, there's no ability to do development with ONNX on these laptops. So instead, I have to use a virtual machine or rent a cloud x64 instance, which impedes productivity or creates additional costs.

[snnn]

I will submit a PR and publish a test package tomorrow.