options (DataFrameReader)

Adds input options for the underlying data source.

Syntax

options(**options)

Parameters

Returns

DataFrameReader

Examples

Read a CSV file with nullValue and header options set.

import tempfile
with tempfile.TemporaryDirectory(prefix="options") as d:
    df = spark.createDataFrame([{"age": 100, "name": "Alice"}])
    df.write.option("header", True).mode("overwrite").format("csv").save(d)

    spark.read.options(
        nullValue="Alice",
        header=True
    ).format('csv').load(d).show()
    # +---+----+
    # |age|name|
    # +---+----+
    # |100|NULL|
    # +---+----+