From 1c16aca16c9191180ba5a5de430e70b67838a800 Mon Sep 17 00:00:00 2001 From: Jolan Rensen Date: Mon, 13 Mar 2023 11:57:31 +0100 Subject: [PATCH] added hint about the existence about the Kotlin Spark API in the I/O docs of DataFrame. --- docs/StardustDocs/topics/io.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/docs/StardustDocs/topics/io.md b/docs/StardustDocs/topics/io.md index c9fbfc65a7..bfc1b89ef4 100644 --- a/docs/StardustDocs/topics/io.md +++ b/docs/StardustDocs/topics/io.md @@ -2,3 +2,8 @@ When you work with data, you have to [read](read.md) it from disk or from remote URLs and [write](write.md) it on disk. This section describes how to do it. For now, CSV, TSV, JSON, XLS, XLSX, Apache Arrow formats are supported. + +Working with [Apache Spark](https://spark.apache.org/) directly from Kotlin DataFrame is not possible at the time of +writing. However, there is a [Kotlin Spark API](https://github.com/Kotlin/kotlin-spark-api) which we can recommend in +the meantime. If you do want to work with data from Spark in Kotlin DataFrame, we recommend exporting your data to CSV or +the Apache Arrow format and then reading it back into a [DataFrame](DataFrame.md).