2014-11-14 116 views
0

我有一个问题,我一直在试图解决过去几天。 我有一个网站,我抓取新闻,并完美的作品。 但是,最近我遇到了我的analyzer_script问题,因为它似乎超过了我的虚拟主机设置的时间限制。显然,大约1分钟有一个max_execution时间,而且我的脚本比这更长。因为我在公共服务器上托管我的网站,所以我无法在php.ini脚本中调整它。 我能做什么?我需要重写我的脚本吗?max_execution时间限制php

我感谢您的帮助! 我的脚本如下:

<?php 
    $array = array(); 
    $sub_array = array(); 
    $analyzer_ids = array(); 

$res5 = mysqli_query($con,"SELECT id,status FROM statuz ORDER BY id DESC LIMIT 1"); 
$row5 = mysqli_fetch_array($res5); 

$status = $row5['status']; 
$status_id = $row5['id']; 

if($status == 2) { 

    $res1 = mysqli_query($con,"SELECT tag, id FROM tags"); 
    while($row1 = mysqli_fetch_array($res1)) { 
     $tag = $row1['tag']; 
     $id = $row1['id']; 

     $res2 = mysqli_query($con,"SELECT sub_tag FROM sub_tags WHERE tag_id = '$id'"); 
     while($row2 = mysqli_fetch_array($res2)) { 
      $sub_tag = $row2['sub_tag']; 
      $sub_tag = strtolower($sub_tag); 
      $sub_array[] = $sub_tag; 
     } 

     $array[] = array('tag_id' => $id, 'tag' => $tag, 'sub_tag' => $sub_array); 
     $sub_array = array(); 
    } 

    mysqli_query($con,"INSERT INTO analyzer_queue (crawler_id, status) 
    (SELECT id,0 FROM crawlers)"); 

    $initial_res = mysqli_query($con,"SELECT crawler_id,id FROM analyzer_queue WHERE status = '0'"); 
    while($initial_row = mysqli_fetch_array($initial_res)) { 

     $analyzer_id = $initial_row['id']; 
     $start_crawler_id = $initial_row['crawler_id']; 
     mysqli_query($con,"UPDATE analyzer_queue SET status = '1' WHERE crawler_id = '$start_crawler_id' ORDER BY id DESC LIMIT 1"); 
     $analyzer_ids[] = $analyzer_id; 

       $res = mysqli_query($con,"SELECT cr.title, cr.content, cr.id 
       FROM crawler_results cr 
       INNER JOIN crawlers c 
       ON c.newspaper_id = cr.newspaper_id 
       WHERE c.id = '$start_crawler_id' 
       AND status = '3' 
       LIMIT 10"); 
       while($row = mysqli_fetch_array($res)) { 

        $article_id = $row['id']; 
        $title = $row['title']; 
        $content = $row['content']; 

        $content = strip_tags($content); 
        $content = strtolower($content); 
        $title = strtolower($title); 


        $count = array(); 
        foreach ($array as $tag) { 
         $regex = '/(?:\b' . preg_quote($tag['tag'], '/'); 
         foreach ($tag['sub_tag'] as $sub) { 
          $regex .= '\b)|(?:\b' . preg_quote($sub, '/'); 
         } 
         $regex .= '\b)/i'; 
         $count_content = preg_match_all($regex, $content, $count_content); 
         $count_title = preg_match_all($regex, $title, $count_title); 
         $count_total[$tag['tag']] = $count_content + $count_title; 
         $total_count = $count_total[$tag['tag']]; 

         $tag_name = $tag['tag']; 

         $res5 = mysqli_query($con,"SELECT id FROM tags WHERE tag = '$tag_name'"); 
         $row5 = mysqli_fetch_array($res5); 

         $tag_id = $row5['id']; 


         if($total_count != 0) { 
          mysqli_query($con,"INSERT INTO article_tags (article_id,tag_id,count_tags) VALUES('$article_id','$tag_id','$total_count')"); 
         } 

         echo$count_total[$tag['tag']]; 
         echo"<br /><br />"; 
        } 

        echo"<pre>"; 
        print_r($count_total); 
        echo"</pre>"; 

        mysqli_query($con,"UPDATE crawler_results SET status = '2', analyzer_id = '$analyzer_id' WHERE id = '$article_id'"); 
       } 
       mysqli_query($con,"UPDATE analyzer_queue SET status = '2' WHERE crawler_id = '$start_crawler_id' ORDER BY id DESC LIMIT 1"); 

     } 
     mysqli_query($con,"UPDATE crawler_results SET status = '4' WHERE analyzer_id NOT IN (".implode(',',$analyzer_ids).")"); 
     mysqli_query($con,"UPDATE statuz SET status = '3' WHERE id = '$status_id'"); 
     print_r($analyzer_ids); 

} else { 
    echo"Not ready yet"; 
} 




?> 
+0

当使用'mysqli'你应该使用参数化查询,而['bind_param'](http://php.net/manual/en/mysqli- stmt.bind-param.php)将用户数据添加到您的查询中。 **不要**使用字符串插值来实现此目的,因为您将创建严重的[SQL注入漏洞](http://bobby-tables.com/)。 – tadman 2014-11-14 21:02:27

回答

0

试试这个:

ini_set('max_execution_time', 0); 

The original Post

+0

完美KrustyBox!这是非常快的!我接受谁的答案? oliakaoil提供了更多的细节,但你快了3分钟。 – 2014-11-14 21:41:24

+0

我的代码就是你需要的。我比@oliakaoil少点... :) – KrustyBox 2014-11-15 01:53:49

1

你可以在你的脚本是这样的顶部使用ini_set

ini_set('max_execution_time' , 300); 

以上调用将脚本的最大执行时间为5分钟。这里的文档页面:

http://php.net/manual/en/function.ini-set.php

如果你的主机允许的话,您也可以考虑通过运行cron或其他一些调度守护这个脚本。运行在cli上下文中的PHP脚本通常没有执行时间限制,或者更高的执行时间限制。

+0

非常感谢你回答我的问题,快速oliakaoil!不幸的是KrustyBox比你快3分钟,但你在答案中提供了更多细节。我该怎么办? – 2014-11-14 21:40:14

+0

不客气。我在回答“我该做什么”问题时最不客观:-),所以我会弃权。 – oliakaoil 2014-11-14 21:55:08