2017-06-28 114 views
1

我正试图在mySQL数据库中插入scraped items('title')。(Python 3.6)TypeError:无法将字节连接到元组

这是我spider.py文件的片段,刮“标题”内容:

#get more details 
def parse_detail_page(self, response): 
    item = response.meta["item"] 

    #title 
    title = response.xpath(".//*[@id='titletextonly']/text()").extract()[0] 
    item["title"] = title 

    return item 

这是我pipelines.py文件:

import pymysql.cursors 

class mySQLTest(object): 

    def __init__(self): 
     self.conn = pymysql.connect(host='localhost', 
          user='root', 
          password='', 
          db='testDB', 
          charset='utf8mb4', 
          cursorclass=pymysql.cursors.DictCursor) 
     self.cursor = self.conn.cursor() 


    def process_item (self, item, spider): 
     sql = "INSERT INTO items (title) VALUES (%s)", (item['title']) 
     self.cursor.execute(sql) 
     self.conn.commit() 

     return item 

我遇到了以下错误:

Traceback (most recent call last): 
    File "/Users/venv1/lib/python3.6/site-packages/twisted/internet/defer.py", line 653, in _runCallbacks 
    current.result = callback(current.result, *args, **kw) 
    File "/Users/venv1/tutorial/tutorial/pipelines.py", line 31, in process_item 
    self.cursor.execute(sql) 
    File "/Users/venv1/lib/python3.6/site-packages/pymysql/cursors.py", line 166, in execute 
    result = self._query(query) 
    File "/Users/sandysu/PyCharmProjects/venv1/lib/python3.6/site-packages/pymysql/cursors.py", line 322, in _query 
    conn.query(q) 
    File "/Users/venv1/lib/python3.6/site-packages/pymysql/connections.py", line 855, in query 
    self._execute_command(COMMAND.COM_QUERY, sql) 
    File "/Users/venv1/lib/python3.6/site-packages/pymysql/connections.py", line 1091, in _execute_command 
    packet = prelude + sql[:packet_size-1] 
TypeError: can't concat bytes to tuple 

这是什么类型错误:不能Concat的字节元组是什么意思?它应该如何解决?

+0

如果你使用:'SQL = “INSERT INTO项目(标题)VALUES(” +项目[ '标题'] +“)”'而不是? – nikpod

+0

'sql =“INSERT INTO items(title)VALUES({0})”。format(item ['title'])' – user3450049

+0

@ user3450049 - 你能澄清{0}的用途吗?我尝试了你的建议并得到了这个错误:pymysql.err.ProgrammingError:(1064,“你的SQL语法有错误;检查与你的MariaDB服务器版本相对应的手册, s/s电器 - h/w地板 - 可用:7月1日在1号线) 作为参考,'标题'scraped读取如下:'AAA主要位置 - s/s电器 - h/w地板 - Avail :7月1日'。 – slsu

回答

0

这是能够最终将数据插入到数据库中的语法:

def process_item (self, item, spider): 
    sql = "INSERT INTO items (title) VALUES (%s)" 
    data = item['title'] 

    self.cursor.execute(sql, data) 
    self.conn.commit() 

    return item 
相关问题