如何检查，看看是否在内容文件存在于目录中的文件中的内容

Question

我有了几行文本文件，让说：

cat 
dog 
rabbit 

我想遍历目录来检查是否有任何文本文件包含上述列表中的项目。

我尝试了许多不同的方法。我不想发布任何内容，因为我想要一个新的开始......思路清晰。我对下面的代码进行了处理，以至于我甚至不知道发生了什么，并且我完全失去了意义。 :(

#! /usr/bin/python 

''' 
The purpose of this program 
is to search the OS file system 
in order to find a txt file that contain the nagios host entries 
''' 

import os 

host_list = open('/path/path/list', 'r') 

host = host_list.read() 
##for host in host_remove.read(): 

host_list.close() 
#print host 

for root, dirs, files in os.walk("/path/path/somefolder/"): 
    for file in files: 
     if file.endswith(".txt"): 

      check_file = os.path.join(root, file) 
      #print check_file 


      if host.find(check_file): #in check_file: 

       print host.find(check_file)      
       #print host+" is found in "+check_file 
       #print os.path.join(root, file) 
      else: 
       break 

Answer 1

the shell command的模拟：

$ find /path/somefolder/ -name \*.txt -type f -exec grep -wFf /path/list {} + 

在Python中：

#!/usr/bin/env python 
import os 
import re 
import sys 

def files_with_matched_lines(topdir, matched): 
    for root, dirs, files in os.walk(topdir, topdown=True): 
     dirs[:] = [d for d in dirs if not d.startswith('.')] # skip "hidden" dirs 
     for filename in files: 
      if filename.endswith(".txt"): 
       path = os.path.join(root, filename) 
       try: 
        with open(path) as file: 
         for line in file: 
          if matched(line): 
           yield path 
           break 
       except EnvironmentError as e: 
        print >>sys.stderr, e 

with open('/path/list') as file: 
    hosts = file.read().splitlines() 
matched = re.compile(r"\b(?:%s)\b" % "|".join(map(re.escape, hosts))).search 
for path in files_with_matched_lines("/path/somefolder/", matched): 
    print path 

Answer 2

Python是方式，方法矫枉过正这个任务只需使用grep：。

$ grep -wFf list_of_needles.txt some_target.txt 

如果你确实需要使用Python，裹grep呼叫subprocess或类似

Answer 3

我对J.F. Sebastian提供的algorytms做了一些小的修改。 更改将要求用户输入。它也将运行在没有问题的窗口上。

#!/usr/bin/env python 
import os 
import re 
import sys 

contents = raw_input("Please provide the full path and file name that contains the items you would like to search for \n") 
print "\n" 
print "\n" 
direct = raw_input("Please provide the directory you would like to search. \ 
Use C:/, if you want to search the root directory on a windows machine\n") 

def files_with_matched_lines(topdir, matched): 
    for root, dirs, files in os.walk(topdir, topdown=True): 
     dirs[:] = [d for d in dirs if not d.startswith('.')] # skip "hidden" dirs 
     for filename in files: 
      if filename.endswith(".txt"): 
       path = os.path.join(root, filename) 
       try: 
        with open(path) as file: 
         for line in file: 
          if matched(line): 
           yield path 
           break 
       except EnvironmentError as e: 
        print >>sys.stderr, e 

with open(contents) as file: 
    hosts = file.read().splitlines() 
matched = re.compile(r"\b(?:%s)\b" % "|".join(map(re.escape, hosts))).search 
for path in files_with_matched_lines(direct, matched): 
    print path