Query [id = 4cac97ca-ef89-49e9-8e58-6d995de51bef, runId = 4aa53743-5291-4977-84e6-39e522497653] terminated with exception: Timeout of 3000ms expired before the position for partition failOnDataLoss-12-0 could be determined


      org.apache.spark.sql.streaming.StreamingQueryException: Timeout of 3000ms expired before the position for partition failOnDataLoss-12-0 could be determined
=== Streaming Query ===
Identifier: [id = 4cac97ca-ef89-49e9-8e58-6d995de51bef, runId = 4aa53743-5291-4977-84e6-39e522497653]
Current Committed Offsets: {KafkaV2[SubscribePattern[failOnDataLoss.*]]: {"failOnDataLoss-0":{"0":7}}}
Current Available Offsets: {KafkaV2[SubscribePattern[failOnDataLoss.*]]: {"failOnDataLoss-0":{"0":7}}}

Current State: ACTIVE
Thread State: RUNNABLE

Logical Plan:
WriteToMicroBatchDataSource org.apache.spark.sql.execution.streaming.sources.ForeachWriterTable$$anon$1$$anon$2@1ec8002
+- SerializeFromObject [input[0, int, false] AS value#22907]
   +- MapElements org.apache.spark.sql.kafka010.KafkaSourceStressForDontFailOnDataLossSuite$$Lambda$5188/450904819@1b03ae56, class scala.Tuple2, [StructField(_1,StringType,true), StructField(_2,StringType,true)], obj#22906: int
      +- DeserializeToObject newInstance(class scala.Tuple2), obj#22905: scala.Tuple2
         +- Project [cast(key#22881 as string) AS key#22895, cast(value#22882 as string) AS value#22896]
            +- StreamingDataSourceV2Relation [key#22881, value#22882, topic#22883, partition#22884, offset#22885L, timestamp#22886, timestampType#22887], org.apache.spark.sql.kafka010.KafkaSourceProvider$KafkaScan@5d20211d, KafkaV2[SubscribePattern[failOnDataLoss.*]]

      at org.apache.spark.sql.execution.streaming.StreamExecution.org$apache$spark$sql$execution$streaming$StreamExecution$$runStream(StreamExecution.scala:353)
      at org.apache.spark.sql.execution.streaming.StreamExecution$$anon$1.run(StreamExecution.scala:244)
      Cause: org.apache.kafka.common.errors.TimeoutException: Timeout of 3000ms expired before the position for partition failOnDataLoss-12-0 could be determined
      at