2017-02-11 110 views
2

我在Mac上使用Spyder,Spyder上的Python版本是2.7。几个月前,我一直在使用下面的代码来刮掉推文,但现在我发现它不再有效。首先,我可以不再使用:TypeError:file()至多需要3个参数(给出4个参数)

from urllib.request import url open 

现在使用

from urllib2 import url open 

但是,我不能运行,下面的代码,并出现以下错误:“打开(“%s_tweets.csv '%SCREEN_NAME, 'W',换行符='”,编码= 'UTF-8-SIG')为f:类型错误:文件()采用至多3个参数(4给出)”

import sys 
from urllib2 import urlopen 

default_encoding = 'utf-8' 

import tweepy #https://github.com/tweepy/tweepy 
import csv 

#Twitter API credentials 
consumer_key = "" 
consumer_secret = "" 
access_key = "" 
access_secret = "" 

screenNamesList = [] 

def redirect(url): 
page = urlopen(url) 
return page.geturl() 

def get_all_tweets(screen_name): 
#Twitter only allows access to a users most recent 3240 tweets with this method 

#authorize twitter, initialize tweepy 
auth = tweepy.OAuthHandler(consumer_key, consumer_secret) 
auth.set_access_token(access_key, access_secret) 
api = tweepy.API(auth, wait_on_rate_limit = True) 

#initialize a list to hold all the tweepy Tweets 
alltweets = [] 

#make initial request for most recent tweets (200 is the maximum allowed count) 
new_tweets = api.user_timeline(screen_name = screen_name,count=200) 

#save most recent tweets 
alltweets.extend(new_tweets) 

#save the id of the oldest tweet less one 
oldest = alltweets[-1].id - 1 

#keep grabbing tweets until there are no tweets left to grab 
while len(new_tweets) > 0: 
    #print "getting tweets before %s" % (oldest) 

    #all subsiquent requests use the max_id param to prevent duplicates 
    new_tweets = api.user_timeline(screen_name = screen_name,count=200,max_id=oldest) 

    #save most recent tweets 
    alltweets.extend(new_tweets) 

    #update the id of the oldest tweet less one 
    oldest = alltweets[-1].id - 1 

    #print "...%s tweets downloaded so far" % (len(alltweets)) 

#transform the tweepy tweets into a 2D array that will populate the csv 
outtweets = [[tweet.id_str, tweet.created_at, tweet.text, tweet.retweet_count, tweet.coordinates, tweet.favorite_count, tweet.author.followers_count, tweet.author.description, tweet.author.location, tweet.author.name] for tweet in alltweets] 

#write the csv 

with open('%s_tweets.csv' % screen_name, 'w', newline='', encoding='utf-8-sig') as f: 
    writer = csv.writer(f) 
    writer.writerow(["id", "created_at", "text", "retweet_count", "coordinates", "favorite_count", "followers_count", "description", "location", "name"]) 
    writer.writerows(outtweets) 

pass 


if __name__ == '__main__': 
#pass in the username of the account you want to download 
for i, user in enumerate(screenNamesList): 
    get_all_tweets(screenNamesList[i]) 
    i+=1 

回答

5

此代码是针对python 3的,其中open获取新参数:

  • 编码
  • 换行符

在Python 2,只有3个参数的可能:

open(name[, mode[, buffering]])

buffering是不是你想要的。其他人无处可寻。

您可以通过使用

with open('%s_tweets.csv' % screen_name, 'wb') as f: 

打开二进制补丁手柄csv模块的“空行”错误解决这一点。使用python 3(只有“旧”版本,最新版本不需要),你必须通过newline="",因为你不能以二进制格式打开一个csv文件。

为了处理编码和换行符,你可以只是做描述here

from io import open 

,并留下您的代码保持不变的其余部分。好吧,你几乎必须为你的标题添加前缀unicode,如下所示:

writer.writerow([u"id", u"created_at", u"text", u"retweet_count", u"coordinates", u"favorite_count", u"followers_count", u"description", u"location", u"name"]) 
+0

非常好,谢谢 - 它有效。但是,我能做些什么来在某处添加“encoding ='utf-8-sig'”。或者,我应该尝试在Python 3中运行Spyder吗? – bayrah

+0

检查我的编辑。我认为你可以用'io'模块来处理python 2.7。 –

+0

谢谢。它给出了错误:write()参数1必须是unicode,而不是str之后的“writer.writerow([”id“,”created_at“,”text“,”retweet_count“,”coordinates“,”favorite_count“,”followers_count“ ,“description”,“location”,“name”]) “ – bayrah

相关问题