0

我有一个DataFrame这里是架构。的element数是未知的,但一些元素(例如element1element3)的必须存在性和唯一性火花数据帧的转换

root 
|-- context: struct (nullable = true) 
|---|-- key: string (nullable = true) 
| |-- data: struct (nullable = true) 
| | |-- dimensions: array (nullable = true) 
| | | |-- element: struct (containsNull = true) 
| | | | |-- element1: string (nullable = true) 
| | | | |-- element2: string (nullable = true) 
| | | | |-- element3: string (nullable = true) 
| | | | |-- ***  : string (nullable = true) 
| | | | |-- elementN: string (nullable = true) 

我怎样才能把它转换为模式也是这样吗?

root 
|-- context: struct (nullable = true) 
|---|-- key: string (nullable = true) 
|---|-- element1: string (nullable = true) 
|---|-- element3: string (nullable = true) 

非常感谢。

回答