Skip to main content

Spark mode - CSV source

Read

Dataset<Row> sparkDataset = spark.read()
.option("delimiter", ";")
.option("header", "true")
.csv("folder_path");
SparkDataset dataset = new SparkDataset(sparkDataset);

See all supported options in the official documentation.

Write

The CSV format is not recommended for writing Trevas Datasets (see here)