MySQL查询优化

Question

请你帮我优化这个查询。我花了很多时间，并且仍然无法将其改写成足够快的速度（比如说运行在秒钟之内，而不是现在的分钟）。

查询：

SELECT m.my_id, m.my_value, m.my_timestamp 
    FROM (
    SELECT my_id, MAX(my_timestamp) AS most_recent_timestamp 
     FROM my_table 
     WHERE my_timestamp < '2011-03-01 08:00:00' 
     GROUP BY my_id 
) as tmp 
LEFT OUTER JOIN my_table m 
ON tmp.my_id = m.my_id AND tmp.most_recent_timestamp = m.my_timestamp 
ORDER BY m.my_timestamp; 

MY_TABLE定义如下：

CREATE TABLE my_table (
    my_id INTEGER NOT NULL, 
    my_value VARCHAR(4000), 
    my_timestamp TIMESTAMP default CURRENT_TIMESTAMP NOT NULL, 
    INDEX MY_ID_IDX (my_id), 
    INDEX MY_TIMESTAMP_IDX (my_timestamp), 
    INDEX MY_ID_MY_TIMESTAMP_IDX (my_id, my_timestamp) 
); 

该查询的目标是选择最近的my_value每个my_id一些时间戳之前。 my_table包含约1亿个条目，并且需要大约8分钟才能完成。

解释：

 
+----+-------------+-------------+-------+------------------------------------------------+-------------------------+---------+---------------------------+-------+---------------------------------------+ 
| id | select_type | table  | type | possible_keys         | key      | key_len | ref      | rows | Extra         | 
+----+-------------+-------------+-------+------------------------------------------------+-------------------------+---------+---------------------------+-------+---------------------------------------+ 
| 1 | PRIMARY  | <derived2> | ALL | NULL           | NULL     | NULL | NULL      | 90721 | Using temporary; Using filesort  | 
| 1 | PRIMARY  | m   | ref | MY_ID_IDX,MY_TIMESTAMP_IDX,MY_ID_TIMESTAMP_IDX | MY_TIMESTAMP_IDX  | 4  | tmp.most_recent_timestamp | 1 | Using where       | 
| 2 | DERIVED  | my_table | range | MY_TIMESTAMP_IDX        | MY_ID_MY_TIMESTAMP_IDX | 8  | NULL      | 61337 | Using where; Using index for group-by | 
+----+-------------+-------------+-------+------------------------------------------------+-----------------------+---------+---------------------------+------+---------------------------------------+ 

Answer 1

我注意到在解释计划中，优化器使用MY_ID_MY_TIMESTAMP_IDX索引为子查询，但不是外部查询。

您可以使用索引提示进行加速。我还更新了ON子句以使用其别名引用tmp.most_recent_timestamp。

SELECT m.my_id, m.my_value, m.my_timestamp 
    FROM (
    SELECT my_id, MAX(my_timestamp) AS most_recent_timestamp 
     FROM my_table 
     WHERE my_timestamp < '2011-03-01 08:00:00' 
     GROUP BY my_id 
) as tmp 
LEFT OUTER JOIN my_table m use index (MY_ID_MY_TIMESTAMP_IDX) 
ON tmp.my_id = m.my_id AND tmp.most_recent_timestamp = m.my_timestamp 
ORDER BY m.my_timestamp; 

Answer 2

一招得到一个最新记录可以一起与“限1”连同"self" join

财产以后这样的（未测试）使用order by，而不是max aggregation：

SELECT m.my_id, m.my_value, m.my_timestamp 
FROM my_table m 
WHERE my_timestamp < '2011-03-01 08:00:00' 
ORDER BY m.my_timestamp DESC 
LIMIT 1 
; 

更新以上不会因为分组工作是必需的...
其他解决方案具有WHERE-IN-SubSelect而不是您使用的JOIN。
可能会更快。请用您的数据进行测试。

SELECT m.my_id, m.my_value, m.my_timestamp 
FROM my_table m 
WHERE (m.my_id, m.my_timestamp) IN (
    SELECT i.my_id, MAX(i.my_timestamp) 
    FROM my_table i 
    WHERE i.my_timestamp < '2011-03-01 08:00:00' 
    GROUP BY i.my_id 
) 
ORDER BY m.my_timestamp; 

Answer 3

如果我理解正确的话，你应该能够删除嵌套的选择完全由my_timestamp下降where子句移动到主查询，订单和限制1.

SELECT my_id, my_value, max(my_timestamp) 
FROM my_table 
WHERE my_timestamp < '2011-03-01 08:00:00' 
GROUP BY my_id 

*编辑 - 增加了最大和组