[AUTOCUT] Gradle Check Flaky Test Report for RemoteStoreKafkaIT

[opensearch-ci-bot]

Flaky Test Report for RemoteStoreKafkaIT

Noticed the RemoteStoreKafkaIT has some flaky, failing tests that failed during post-merge actions and timer trigerred run on main branch.

Details

Git Reference	Merged Pull Request	Build Details	Test Name
main	null	58898 60364 62476 62597 63248 63612	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testErrorStrategy org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testOffsetUpdateOnBlockErrorPolicy org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testRemoteSnapshotRestore org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore
82ebf3b	19074	62412	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore
2f416d3	19032	62279	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion
5fd0a36	18808	61327	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion
a8b1734	18087	57282	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion
4c76c1d	18027	57085	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion
ddb4354	17893	56370	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testErrorStrategy
e8b975d	17750	55870	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore
6b976ea	17836	55861	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore
17289b7	17663	54990	org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testSegmentReplicationWithRemoteStore

The other pull requests, besides those involved in post-merge actions, that contain failing tests with the RemoteStoreKafkaIT class are:

• 17631
• 18333
• 18405
• 18944
• 18693
• 17752
• 17764
• 17273
• 17712
• 17771
• 17815
• 17941
• 19046
• 17336
• 17495
• 17575
• 17612
• 17615
• 17619
• 17679
• 17699
• 17729
• 17733
• 17757
• 17791
• 17843
• 17912
• 18054
• 18063
• 18153
• 18161
• 18169
• 18195
• 18197
• 18229
• 18254
• 18288
• 18312
• 18331
• 18504
• 18602
• 18649
• 18702
• 18748
• 18877
• 18879
• 18889
• 19199
• 19320

For more details on the failed tests refer to OpenSearch Gradle Check Metrics dashboard.

[krisfreedain]

Catch all triage - 1

[andrross]

@yupeng9 @varunbharadwaj Can one of you take a look here? These tests have been pretty flaky. Here's an example:

https://build.ci.opensearch.org/job/gradle-check/57507/consoleText

REPRODUCE WITH: ./gradlew ':plugins:ingestion-kafka:internalClusterTest' --tests "org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion" -Dtests.seed=99C705639E2EC4B4 -Dtests.security.manager=false -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=bem-ZM -Dtests.timezone=SystemV/AST4ADT -Druntime.java=21

RemoteStoreKafkaIT > testPauseAndResumeIngestion FAILED
    java.lang.AssertionError: expected:<2> but was:<4>
        at __randomizedtesting.SeedInfo.seed([99C705639E2EC4B4:473224DAFADE6AA]:0)
        at org.junit.Assert.fail(Assert.java:89)
        at org.junit.Assert.failNotEquals(Assert.java:835)
        at org.junit.Assert.assertEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:633)
        at org.opensearch.plugin.kafka.RemoteStoreKafkaIT.testPauseAndResumeIngestion(RemoteStoreKafkaIT.java:216)

[yupeng9]

ack, will take a look