Hive Data to Pandas数据框

Question

Python新手。

我如何将数据从配置单元保存到熊猫数据框。

with pyhs2.connect(host, port=20000,authMechanism="PLAIN",user,password, 
       database) as conn: 
    with conn.cursor() as cur: 
     #Show databases 
     print cur.getDatabases() 

     #Execute query 
     cur.execute(query) 

     #Return column info from query 
     print cur.getSchema() 

     #Fetch table results 
     for i in cur.fetch(): 
      print i 
     **columnNames = [a['columnName'] for a in cur.getSchema()] 
     print columnNames 
     df1=pd.DataFrame(cur.fetch(),columnNames)** 

尝试使用列名称。没有工作。

请注意。建议一些事。

Answer 1

正如我之前提取数据并试图再次获取数据帧一样。

cur.execute(query) 
val=cur.fetchall() 
columnNames = [a['columnName'] for a in cur.getSchema()] 
df=pd.DataFrame(data=val,columns=columnNames) 
#print df 
return df 

Answer 2

你可以试试这个：（我敢肯定它会工作）

res = cur.getSchema() 
description = list(col['columnName'] for col in res) ## for getting the column names of the table 

headers = [x.split(".")[1] for x in description] # for splitting the list if the column name contains a period 

df= pd.DataFrame(cur.fetchall(), columns = headers) 

df.head(n = 20)