我在java上使用openNLP API来处理我正在处理的项目。事情是,在我的程序中,我只处理单词而没有对应关系。 代码:openNLP java - 多项葡萄牙语NER
String line = input.nextLine();
InputStream inputStreamTokenizer = new FileInputStream("/home/bruno/openNLP/apache-opennlp-1.7.2-src/models/pt-token.bin");
TokenizerModel tokenModel = new TokenizerModel(inputStreamTokenizer);
//Instantiating the TokenizerME class
TokenizerME tokenizer = new TokenizerME(tokenModel);
String tokens[] = tokenizer.tokenize(line);
InputStream inputStream = new FileInputStream("/home/bruno/openNLP/apache-opennlp-1.7.2-src/models/pt-sent.bin");
SentenceModel model = new SentenceModel(inputStream);
//Instantiating the SentenceDetectorME class
SentenceDetectorME detector = new SentenceDetectorME(model);
//Detecting the sentence
String sentences[] = detector.sentDetect(line);
//Loading the NER-location model
//InputStream inputStreamLocFinder = new FileInputStream("/home/bruno/openNLP/apache-opennlp-1.7.2-src/models/en-ner-location.bin");
//TokenNameFinderModel model = new TokenNameFinderModel(inputStreamLocFinder);
//Loading the NER-person model
InputStream inputStreamNameFinder = new FileInputStream("/home/bruno/TryOllie/data/pt-ner-floresta.bin");
TokenNameFinderModel model2 = new TokenNameFinderModel(inputStreamNameFinder);
//Instantiating the NameFinderME class
NameFinderME nameFinder2 = new NameFinderME(model2);
//Finding the names of a location
Span nameSpans2[] = nameFinder2.find(tokens);
//Printing the spans of the locations in the sentence
//for(Span s: nameSpans)
//System.out.println(s.toString()+" "+tokens[s.getStart()]);
Set<String> x = new HashSet<String>();
x.add("event");
x.add("artprod");
x.add("place");
x.add("organization");
x.add("person");
x.add("numeric");
SimpleTokenizer simpleTokenizer = SimpleTokenizer.INSTANCE;
Span[] tokenz = simpleTokenizer.tokenizePos(line);
Set<String> tk = new HashSet<String>();
for(Span tok : tokenz){
tk.add(line.substring(tok.getStart(), tok.getEnd()));
}
for(Span n: nameSpans2)
{
if(x.contains(n.getType()))
System.out.println(n.toString()+ " -> " + tokens[n.getStart()]);
}
输出我得到的是:
Ficheiro com extensao: file.txt
[1..2) event -> choque[3..4) event -> cadeia[6..7) artprod -> viaturas[13..14) event -> feira[16..18) place -> Avenida[20..21) place -> Porto[24..25) event -> incêndio[2..3) event -> acidente[5..6) artprod -> viaturas[44..45) organization -> JN[46..47) person -> António[47..48) place -> Campos[54..60) organization -> Batalhão[1..2) event -> acidente[6..8) numeric -> 9[11..12) place -> Porto-Matosinhos[21..22) event -> ocorrência[29..30) artprod -> .[4..5) organization -> Sapadores[7..10) organization -> Bombeiros[14..15) numeric -> 15
什么即时试图做的是一个多学期NER,像安东尼坎波斯是一个人,不是人 - >安东尼奥和地点 - > Campos或组织 - > Universidade Nova de Lisboa
林打破了文成句子,记号化每一个字,所以我的程序只能看每个字分开,这哪里是我的问题在于,我必须来标记,但我需要看单词,例如找到Antonio Antonio Campos作为一个人找到,而不是Antonio作为一个人,Campos作为一个地方,或另一个人...... 这同样适用于像Fernando Pessoa大学这样的组织,我想找到它作为一个组织,而不是大学作为组织,费尔南多作为人和佩索阿作为其他人 – Break
好吧,我明白你的问题,但这是如何**斯坦福NLP **的工作。 NER只在完成这个过程之后才工作(tokenize,ssplit,pos,引理)。所以很明显NER只处理一个小字。可能是这[链接](https://stanfordnlp.github.io/CoreNLP/dependencies.html)给你的想法。 –
所以,我只能看单个单词,这意味着我无法解决我与那个NER的问题? – Break