Conformance Tests Should Support Configurable Timeouts

[robscott]

When running conformance tests, it can be helpful to adjust timeouts to understand what is causing a test failure. As part of making conformance tests configurable, we should also document any maximum timeouts that are acceptable for a conformant implementation.

[abhijit-dev82]

HI Rob,

Can this be achieved by adding a new"TimeOut" Field to struct ConformanceTest and then use the same in the below functions or default value if not provided in the test case.

• kubernetes.GatewayStatusMustHaveListeners()
• awaitConvergence()

[bowei]

My $0.02 is that all the timeouts should be pulled out to a struct and we document what is expected for a conformant implementation.

This allows implementations that need tuning to do it easily without having to modify the mainline test code.

[robscott]

Hey @abhijit-dev82, thanks for asking about this! I had actually been chatting with @wstcliyu about this yesterday and they had volunteered to work on this, but we missed commenting here to track that.

/assign @wstcliyu

[k8s-ci-robot]

@robscott: GitHub didn't allow me to assign the following users: wstcliyu.

Note that only kubernetes-sigs members, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time.
For more information please see the contributor guide

In response to this:

Hey @abhijit-dev82, thanks for asking about this! I had actually been chatting with @wstcliyu about this yesterday and they had volunteered to work on this, but we missed commenting here to track that.

/assign @wstcliyu

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[wstcliyu]

/assign