Logstash - JDBC - MYSQL配置错误

https://www.youtube.com/watch?v=ZnI_rlrei1s

我试图使用logstash使用JDBC发送到elasticsearch服务器获取我的本地主机的MySQL（使用laravel代客MySQL的）。

这是我的配置：

# file: db.conf 
input { 
jdbc { 
    # MySQL jdbc connection string to our database, mydb 
    jdb_connection_string => "jdbc:mysql://localhost:3306/dragon" 
    # The user we wish to execute our statement as 
    jdbc_user => "root" 
    # The user password 
    jdbc_password => "" 
    # The path to our downloaded jdbc driver 
    jdbc_driver_library => "/Users/muaz/downloads/logstash/mysql-connector-java-5.1.39-bin.jar" 
    # The name of the deliver clas for MySQL 
    jdbc_driver_class => "com.mysql.jdbc.Driver" 
    # Our query 
    statement = "SELECT * from Receipt" 
} 
} 
output { 
# stdout { codec => json_lines } 
elasticsearch { 
    # protocol = https 
    index => "power_receipt" 
    document_type => "Receipt" 
    document_id => "%{id}" 
    host => "https://search-power-yidhfhkidiiddcccyhyrijaagamu.ap-southeast-1.es.amazonaws.com" 
} 
}

，我又把它使用命令（logstash文件夹）运行：

./bin/logstash agent -f db.conf

它产生：

fetched an invalid config {:config=>"# file: db.conf\ninput {\n\tjdbc {\n\t\t# MySQL jdbc connection string to our database, mydb\n\t\tjdb_connection_string => \"jdbc:mysql://localhost:3306/dragon\"\n\t\t# The user we wish to execute our statement as \n\t\tjdbc_user => \"root\"\n\t\t# The user password\n\t\tjdbc_password => \"\"\n\t\t# The path to our downloaded jdbc driver\n\t\tjdbc_driver_library => \"/Users/muaz/downloads/logstash/mysql-connector-java-5.1.39-bin.jar\"\n\t\t# The name of the deliver clas for MySQL\n\t\tjdbc_driver_class => \"com.mysql.jdbc.Driver\"\n\t\t# Our query\n\t\tstatement = \"SELECT * from Receipt\"\n\t}\n}\noutput {\n\t# stdout { codec => json_lines }\n\telasticsearch {\n\t\t# protocol = https\n\t\tindex => \"slurp_receipt\"\n\t\tdocument_type => \"Receipt\"\n\t\tdocument_id => \"%{id}\"\n\t\thost => \"https://search-power-yidhfhkidiiddcccyhyrijaagamu.ap-southeast-1.es.amazonaws.com\"\n\t}\n}\n\n\n", :reason=>"Expected one of #, => at line 15, column 13 (byte 521) after # file: db.conf\ninput {\n\tjdbc {\n\t\t# MySQL jdbc connection string to our database, mydb\n\t\tjdb_connection_string => \"jdbc:mysql://localhost:3306/dragon\"\n\t\t# The user we wish to execute our statement as \n\t\tjdbc_user => \"root\"\n\t\t# The user password\n\t\tjdbc_password => \"\"\n\t\t# The path to our downloaded jdbc driver\n\t\tjdbc_driver_library => \"/Users/muaz/downloads/logstash/mysql-connector-java-5.1.39-bin.jar\"\n\t\t# The name of the deliver clas for MySQL\n\t\tjdbc_driver_class => \"com.mysql.jdbc.Driver\"\n\t\t# Our query\n\t\tstatement ", :level=>:error}

如何解决呢？

谢谢

来源

2016-08-22 معاذ الغفاري

你有你的jdbc输入的最后一行一个错字

statement = "SELECT * from Receipt"

应该在你的elasticsearch输出读

statement => "SELECT * from Receipt"

而且你需要更改

host => "https://search-power-yidhfhkidiiddcccyhyrijaagamu.ap-southeast-1.es.amazonaws.com"

到

hosts => ["https://search-power-yidhfhkidiiddcccyhyrijaagamu.ap-southeast-1.es.amazonaws.com"]

来源

2016-08-22 08:16:03 Val

其固定，但我得到新的错误： INFO：I/O异常（java.net.SocketException异常）处理请求以{}当抓 - >的http：//搜索加电yidhfhkidiiddcccyhyrijaagamu.ap-southeast-1.es.amazonaws.com:989：Connection reset 2016年8月22日下午5:07:42 org.apache.http.impl.execchain.RetryExec执行 –

我得到了新的错误：search-power -yidhfhkidiiddcccyhyrijaagamu.ap-southeast-1.es.amazonaws.com:989无法响应{：class =>“Manticore :: ClientProtocolException”，：：level =>：error} –

上面的错误已得到修复，现在出现新问题：星期二8月23日12:13:37 MYT 2016 WARN：建立SSL连接而不需要服务器不建议进行身份验证。根据MySQL 5.5.45+，5.6.26+和5.7.6+的要求，如果未设置显式选项，则必须默认建立SSL连接。为了符合不使用SSL的现有应用程序，verifyServerCertificate属性设置为'false'。 –

Logstash - JDBC - MYSQL配置错误

回答

相关问题