2013-04-25 63 views
0

我已经在网络中进行了高级搜索并获得了一些结果。对于每个结果我都有兴趣提取2个字段,“Referencia:”和“CIF”。从R的网页中顺序检索数据

#This is the url with the results of the search 
url="http://www.boe.es/buscar/boe.php?campo%5B1%5D=DOC&dato%5B1%5D=edicto+auto+declaracion+concurso+CIF 
&campo%5B6%5D=FPU&dato%5B6%5D%5B0%5D=25%2F04%2F2013&dato%5B6%5D%5B1%5D=30%2F04%2F2013 
&sort_field%5B0%5D=fpu&sort_order%5B0%5D=desc&sort_field%5B1%5D=ref&sort_order%5B1%5D=asc&accion=Buscar" 

#This is the url of one of the results. 
example=http://www.boe.es/buscar/doc.php?id=BOE-B-2013-15895 

的CIF字段通常形式X00000000或X00000000与X=c("A","B")0=0:9 和该Referencia场的是BOE-B-2013-15895中实施例和CIF B-32210196

莫非你帮我从R做起?

+0

退房R中 – 2013-04-25 20:22:59

+0

的XML库也可以添加更多的信息,像一个示例表要到出现在R? – 2013-04-25 20:24:05

+0

@绿色恶魔感谢你的包装。示例表格粘贴在上面和上面的链接上。它只是标有“Datos generales del concurso”的框。 – nopeva 2013-04-26 06:11:21

回答

1

要获取内容,请查看httr包。您可以使用类似

content (GET (url)) 
+0

@感谢杰夫艾伦我用这个命令得到了很多代码。也许你可以提供一个简单的例子来检索一段数据。 – nopeva 2013-04-26 07:36:44

1

1)这是一块蛋糕拿到Referencia

substrRight <- function(x, n){ 
    sapply(x, function(xx) 
    substr(xx, (nchar(xx)-n+1), nchar(xx))) 
} 

library(XML) 
u<-"http://www.boe.es/buscar/boe.php?campo%5B1%5D=DOC&dato%5B1%5D=edicto+auto+declaracion+concurso+CIF%20&campo%5B6%5D=FPU&dato%5B6%5D%5B0%5D=25%2F04%2F2013&dato%5B6%5D%5B1%5D=30%2F04%2F2013%20&sort_field%5B0%5D=fpu&sort_order%5B0%5D=desc&sort_field%5B1%5D=ref&sort_order%5B1%5D=asc&accion=Buscar" #link 
doc1<-htmlParse(u) 'get html' 
kbbRoot <- xmlRoot(doc1) #parse it into xml 
els<-getNodeSet(kbbRoot,"//*[contains(concat(' ', @class, ' '), concat(' ', 'resultado-busqueda-link-defecto', ' '))]") #get all links by xpath 
links<-sapply(els, function(el) xmlGetAttr(el, "href")) #get inner (start with .../) 
links<-sapply(links, function(x) substr(x,start=3,stop=nchar(x))) #delete ../ 
links<-sapply(links, function(x) paste("http://www.boe.es", x,sep=""))#generate correct link 
Referencia<-sapply(links, function(x) substrRight(x,16)) # get referencia from links 

2)CIF复杂得多。你必须使用正则表达式。不幸的是,我并不擅长。所以请问论坛上的其他人:“应该使用正则表达式来从字符串中获得CIF值?”

CIFRA<-function (u){ 
    doc1<-htmlParse(u)#get html 
    kbbRoot <- xmlRoot(doc1)# parse it 
    els<-getNodeSet(kbbRoot,"//*[contains(concat('', @class,''), concat('', 'parrafo', ''))]")#select text 
    l<-sapply(els, xmlValue) #analyse each sentences 
    x<-regexpr(pattern="[A-Z][0-9]+",text=l)#Try to find CIF by using RegEXP 
    #regexp return position in string 
    ind<-which.max(x) #'number of row with CIF' 
    st<- x[ind]-3 #start position 
    en<-st+attr(x, "match.length")[ind]-1 #finish 
    res<-substring(l[ind],st,en) #select text between start and finish 
} 

CIF < -sapply(链接功能(X)奇弗拉(X))