Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Incomplete
-
2.1.1
-
None
Description
In SPARK-20460, we refactored some existing checks for column name duplication. The master currently allows name duplication for temporary views like an example below though, IMO we better prevent it along with permanent views (the master prevents the case for the permanent views).
scala> Seq((1, 1)).toDF("a", "a").createOrReplaceTempView("t") scala> sql("SELECT * FROM t").show +---+---+ | a| a| +---+---+ | 1| 1| +---+---+
Attachments
Issue Links
- relates to
-
SPARK-28252 local/global temp view should not accept duplicate column names
- In Progress