Test on multiple linux distros

[bording]

Since #1621 will have CI in flux, once that work is done, we should start getting the linux tests running on multiple distros, to validate that the native binaries work properly.

We should be able to do this by running the tests from docker images.

Ideally, we'd be able to cover as many of these as possible.