K2D is written in Scala with Spark and uses Spark-structured streaming. It consumes 1-minute micro-batches from Kafka and then writes the data to S3 as a Delta Lake table. Downstream Spark consumers ...