计数2个元素星火

Question

如何计算火花中的2列？

我测试一下。但是，这不是好办法..

joinDF = logDF.join(logDF2,"day_number") 
compareNumberRequestTraffic = joinDF.groupBy("day_number") \ 
    .agg(functions.count("request","request2")) \ 
    .show() 

我有错误：

() takes exactly 1 argument (2 given) 

我想吨对产出

day_number  count(request)  count(request2) 
2015-01-03    5     7 

非常感谢

Answer 1

不要写用2个参数计数，但2个计数在agg函数中

joinDF = logDF.join(logDF2,"day_number") 
compareNumberRequestTraffic = joinDF.groupBy("day_number") \ 
    .agg(functions.count("request"), functions.count("request2")) \ 
    .show()