使用NLTK或Python

Question

如何删除停止的话让我有我想从使用

stopwords.words('english') 

去除停止词我挣扎如何使用这个我的代码内只是单纯地拿出一个数据集这些字。我的单词的列表，从这个数据集已经，我用的比较这个列表，而删除停用词挣扎的一部分。 任何帮助表示赞赏。

Answer 1

我想你必须从中要删除禁用词字（WORD_LIST）的列表。你可以做这样的事情：

filtered_word_list = word_list[:] #make a copy of the word_list 
for word in word_list: # iterate over word_list 
    if word in stopwords.words('english'): 
    filtered_word_list.remove(word) # remove word from filtered_word_list if it is a stopword 

Answer 2

from nltk.corpus import stopwords 
# ... 
filtered_words = [word for word in word_list if word not in stopwords.words('english')] 

Answer 3

你也可以做一组差异，例如：

list(set(nltk.regexp_tokenize(sentence, pattern, gaps=True)) - set(nltk.corpus.stopwords.words('english'))) 

Answer 4

import sys 
print ("enter the string from which you want to remove list of stop words") 
userstring = input().split(" ") 
list =["a","an","the","in"] 
another_list = [] 
for x in userstring: 
    if x not in list:   # comparing from the list and removing it 
     another_list.append(x) # it is also possible to use .remove 
for x in another_list: 
    print(x,end=' ') 

    # 2) if you want to use .remove more preferred code 
    import sys 
    print ("enter the string from which you want to remove list of stop words") 
    userstring = input().split(" ") 
    list =["a","an","the","in"] 
    another_list = [] 
    for x in userstring: 
     if x in list:   
      userstring.remove(x) 
    for x in userstring:   
     print(x,end = ' ') 
    #the code will be like this 

Answer 5

你可以使用这个功能，你应该注意，您需要降低所有单词

from nltk.corpus import stopwords 

def remove_stopwords(word_list): 
     processed_word_list = [] 
     for word in word_list: 
      word = word.lower() # in case they arenet all lower cased 
      if word not in stopwords.words("english"): 
       processed_word_list.append(word) 
     return processed_word_list 

Answer 6

使用filter：

from nltk.corpus import stopwords 
# ... 
filtered_words = list(filter(lambda word: word not in stopwords.words('english'), word_list)) 

Answer 7

排除所有类型的禁用词包括NLTK停止字，你可以做这样的事情：

from many_stop_words import get_stop_words 
from nltk.corpus import stopwords 

stop_words = list(get_stop_words('en'))   #About 900 stopwords 
nltk_words = list(stopwords.words('english')) #About 150 stopwords 
stop_words.extend(nltk_words) 

output = [w for w in word_list if not w in stop_words]