[Profiling] Add python scripts to generate per-op profiling from etdumps

[mcr229]

I've been doing a lot of profiling out in open source, and that generally involves generating an etdump after running the model. I find this script very useful for generating a CSV of the per-op profiling numbers after getting an etdump. Currently the profiling flow looks like this for me:

# Build executor_runner with profiling enabled
cmake --preset profiling
cmake --build cmake-out --target executor_runner

# run and profile my model
./executor_runner --model_path="my_model" --etdump_path="path_to_et_dump"

# generate op profiling .csv from my last run
python devtools/scripts/generate_profiling_csv.py --etdump_path="path_to_et_dump" --output="op_profiling.csv"

This generates some nice CSVs for investigating the per-op profiling times. See some of the commits in this stack for profiling info.

[mcr229]

Stack from ghstack (oldest at bottom):

• [KleidiAI] turn on SME2 by default #13233
• [KleidiAI] Always attempt activation packing #13232
• -> [Profiling] Add python scripts to generate per-op profiling from etdumps #13302
• Add csv and etdump files to gitignore #13301

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13302

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures

As of commit 55d189a with merge base a84b3c9 ():

NEW FAILURES - The following jobs have failed:

• Build documentation / build (buck2) / Build doc (gh)
  At least one of the pre-conditions you specified did not hold
• pull / unittest / linux / linux-job (gh)
  backends/xnnpack/test/ops/test_conv1d.py::TestConv1d::test_qs8_conv1d_batchnorm_seq
• pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
  RuntimeError: Command docker exec -t 33ea5a9c03c62017bdb5d38369ce1b53131cbc6ff0a41924a8e9abb587f7de72 /exec failed with exit code 1
• pull / unittest-editable / macos / macos-job (gh)
  backends/xnnpack/test/ops/test_conv1d.py::TestConv1d::test_qs8_conv1d_batchnorm_seq

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[Gasoonjia]

LGTM. Thanks for adding scripts!

Please add some comments and/or a .md file demonstrating how to use your script

[meta-cla]

Hi @mcr229!

Thank you for your pull request.

We require contributors to sign our Contributor License Agreement, and yours needs attention.

You currently have a record in our system, but the CLA is no longer valid, and will need to be resubmitted.

Process

In order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA.

Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with CLA signed. The tagging process may take up to 1 hour after signing. Please give it that time before contacting us about it.

If you have received this in error or have any questions, please contact us at [email protected]. Thanks!