Merk
Tilgang til denne siden krever autorisasjon. Du kan prøve å logge på eller endre kataloger.
Tilgang til denne siden krever autorisasjon. Du kan prøve å endre kataloger.
Prints the (logical and physical) plans to the console for debugging purposes.
Syntax
explain(extended: Optional[Union[bool, str]] = None, mode: Optional[str] = None)
Parameters
| Parameter | Type | Description |
|---|---|---|
extended |
bool, optional | default False. If False, prints only the physical plan. When this is a string without specifying the mode, it works as the mode is specified. |
mode |
str, optional | specifies the expected output format of plans. simple: Print only a physical plan. extended: Print both logical and physical plans. codegen: Print a physical plan and generated codes if they are available. cost: Print a logical plan and statistics if they are available. formatted: Split explain output into two sections: a physical plan outline and node details. |
Examples
df = spark.createDataFrame(
[(14, "Tom"), (23, "Alice"), (16, "Bob")], ["age", "name"])
df.explain()
# == Physical Plan ==
# *(1) Scan ExistingRDD[age...,name...]
df.explain(extended=True)
# == Parsed Logical Plan ==
# ...
# == Analyzed Logical Plan ==
# ...
# == Optimized Logical Plan ==
# ...
# == Physical Plan ==
# ...
df.explain(mode="formatted")
# == Physical Plan ==
# * Scan ExistingRDD (...)
# (1) Scan ExistingRDD [codegen id : ...]
# Output [2]: [age..., name...]
# ...