美丽的汤通过网址循环显示数据

Question

我正在使用美丽的汤来刮这个网址 http://www.gbgb.org.uk/resultsRace.aspx?id=1839041它工作正常，显示所有字段的required.However它只显示夹具结果卡上的一个种族，我想提取整个赛事会议，其中9至14场比赛的变化在这里是整个会议的网址http://www.gbgb.org.uk/resultsMeeting.aspx?id=135488。 有没有什么方法可以循环，完整的比赛卡和显示卡上所有比赛的内容。下面是一场比赛的代码。

from urllib import urlopen 

from bs4 import BeautifulSoup 
html = urlopen("http://www.gbgb.org.uk/resultsRace.aspx?id=1839041") 

bsObj = BeautifulSoup(html) 
nameList = bsObj. findAll("div", {"class": "track"}) 
for name in nameList: 
print(name. get_text()) 

nameList = bsObj. findAll("div", {"class": "date"}) 
for name in nameList: 
print(name. get_text()) 

nameList = bsObj. findAll("div", {"class": "datetime"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("div", {"class": "grade"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("div", {"class": "distance"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("div", {"class": "prizes"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("li", {"class": "first essential fin"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("li", {"class": "essential greyhound"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("li", {"class": "trap"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("li", {"class": "sp"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("li", {"class": "timeSec"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("li", {"class": "timeDistance"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("li", {"class": "essential trainer"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("li", {"class": "first essential comment"}) 
for name in nameList: 
print(name. get_text()) 
nameList = bsObj. findAll("div", {"class": "resultsBlockFooter"}) 
for name in nameList: 
print(name. get_text()) 

Answer 1

你只需要迭代结果块。标签略有不同，但本质上是相同的。我在Chrome中使用检查元素功能，使得HTML抓取变得容易。

from urllib import urlopen 

from bs4 import BeautifulSoup 
baseURL = 'http://www.gbgb.org.uk/resultsMeeting.aspx?id=135488' 
html = urlopen(baseURL) 
bsObj = BeautifulSoup(html, 'lxml') 
nameList = bsObj.findAll("div", {"class": "resultsBlock"}) 
for i in nameList: 
    # just the trap info, the rest is similar 
    nameList2 = i.findAll("li", {"class": "trap"}) 
    for j in nameList2: 
     print(j.get_text())