Support multiple quorums on a single LighthouseServer using gRPC metadata-based room assignment#189

Open

MattKotzbauer wants to merge 7 commits intometa-pytorch:mainfrom

MattKotzbauer:HTTP/2_Multi_Room_Lighthouse

Commits on May 5, 2025

Initial attempt at gRPC metadata-based room assignment to support multiple quorums on a single LighthouseServer (https://github.com/pytorch/torchft/issues/173)

Matt Kotzbauer
authored and
Matt Kotzbauer
committed
Merge branch 'main' into HTTP/2_Multi_Room_Lighthouse
MattKotzbauer
authored

Commits on May 7, 2025

Interceptor attached via LighthouseClient constructor rather than using add_room_header for each RPC call
Matt Kotzbauer
committed

Commits on May 18, 2025

Tonic-level routing changed to tower-level in src/router.rs - Server::builder calls (in src/bin/lighthouser.rs, src/lib.rs) and torchft/multi_quorum_test.py modified to reflect change.
Matt Kotzbauer
committed

Commits on May 22, 2025

Edits to tower-based routing: src/router.rs room return type changed to Arc<Lighthouse>, Lighthouse::new now takes id prefix, test relocated to lighthouse_test.py and now uses coordination API, Lig…

Matt Kotzbauer
authored and
Matt Kotzbauer
committed

Commits on May 29, 2025