Answered by : joyous-jaguar-6wwhony0g21b

# convert student ID to list using
# flatMap
print(dataframe.select('student ID').
      rdd.flatMap(lambda x: x).collect())

Source : https://www.geeksforgeeks.org/converting-a-pyspark-dataframe-column-to-a-python-list/ | Last Update : Thu, 03 Mar 22

Answered by : cristian-agudelo

from pyspark.sql import Row li=[1,2,3,4] rdd1 = sc.parallelize(li) row_rdd = rdd1.map(lambda x: Row(x)) df=sqlContext.createDataFrame(row_rdd,['numbers']).show()

Source : https://stackoverflow.com/questions/48448473/pyspark-convert-a-standard-list-to-data-frame | Last Update : Thu, 21 Jul 22