-
Notifications
You must be signed in to change notification settings - Fork 254
Open
Labels
feature requestNew feature or requestNew feature or request
Description
I wish we can support noop format when writing dataframe.
eg:
>>> data = [("Alice", 34), ("Bob", 45), ("Cathy", 29)]
>>> columns = ["Name", "Age"]
>>> df = spark.createDataFrame(data, columns)
>>> df.write.format("noop").mode("overwrite").save()
Fallback message:
! <OverwriteByExpressionExec> cannot run on GPU because GPU does not currently support the operator class org.apache.spark.sql.execution.datasources.v2.OverwriteByExpressionExec
Copilot
Metadata
Metadata
Assignees
Labels
feature requestNew feature or requestNew feature or request