create dataframe pyspark

Solutions on MaxInterview for create dataframe pyspark by the best coders in the world

showing results for - "create dataframe pyspark"
Clare
12 Jan 2021
1from datetime import datetime, date
2import pandas as pd
3from pyspark.sql import Row
4
5df = spark.createDataFrame([
6    Row(a=1, b=2., c='string1', d=date(2000, 1, 1), e=datetime(2000, 1, 1, 12, 0)),
7    Row(a=2, b=3., c='string2', d=date(2000, 2, 1), e=datetime(2000, 1, 2, 12, 0)),
8    Row(a=4, b=5., c='string3', d=date(2000, 3, 1), e=datetime(2000, 1, 3, 12, 0))
9])
10df
11