Skip to content

[FEA] Support noop format #13074

@viadea

Description

@viadea

I wish we can support noop format when writing dataframe.

eg:

>>> data = [("Alice", 34), ("Bob", 45), ("Cathy", 29)]
>>> columns = ["Name", "Age"]
>>> df = spark.createDataFrame(data, columns)
>>> df.write.format("noop").mode("overwrite").save()

Fallback message:

! <OverwriteByExpressionExec> cannot run on GPU because GPU does not currently support the operator class org.apache.spark.sql.execution.datasources.v2.OverwriteByExpressionExec

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions