0
我有以下代码可以在movie_review语料库中打印15个最常见的事件。在NLTK电影评论语料库中标记
import nltk
import random
from nltk.corpus import movie_reviews
documents =[]
for category in movie_reviews.categories():
for fileid in movie_reviews.fileids(category):
documents.append((list(movie_reviews.words(fileid)), category))
random.shuffle(documents)
all_words =[]
for w in movie_reviews.words():
all_words.append(w.lower())
all_words =nltk.FreqDist(all_words)
print(all_words.most_common(15))
我得到以下输出:
[(u',', 77717), (u'the', 76529), (u'.', 65876), (u'a', 38106), (u'and', 35576), (u'of', 34123), (u'to', 31937), (u"'", 30585), (u'is', 25195), (u'in', 21822), (u's', 18513), (u'"', 17612), (u'it', 16107), (u'that', 15924), (u'-', 15595)]
为什么字母 'u' 的标签来吗?我该如何解决这个问题?
有没有什么办法可以得到这封信和它的发生? –