2010-07-16 13 views
2

我正在嘗試將平面文件中的738627條記錄讀入MySQl。該腳本似乎運行良好,但給我上述內存錯誤。PHP內存耗盡錯誤,糟糕的代碼或只是增加內存限制?

文件的樣本是:

#export_dategenre_idapplication_idis_primary 
#primaryKey:genre_idapplication_id 
#dbTypes:BIGINTINTEGERINTEGERBOOLEAN 
#exportMode:FULL 
127667880285760002817317350 
127667880285760002818261461 
127667880285760002825372301 
127667880285760002827785570 
127667880285760002827930241 
127667880285760002827987861 
127667880285760002828089791 
127667880285760002828168361 
127667880285760002828192041 
127667880285760002829144541 
127667880285760002829351511 

我試圖用增加

ini_set("memory_limit","80M"); 

允許的內存,它仍然失敗。我是否一直保持這種狀態直到運行?

的代碼完全是

<?php 
    ini_set("memory_limit","80M"); 
    $db = mysql_connect("localhost", "uname", "pword"); 
    // test connection 
    if (!$db) { 
     echo "Couldn't make a connection!"; 
     exit; 
    } 
    // select database 
    if (!mysql_select_db("dbname",$db)) 

    { 
     echo "Couldn't select database!"; 
     exit; 
    } 
    mysql_set_charset('utf8',$db); 

    $delimiter = chr(1); 
    $eoldelimiter = chr(2) . "\n"; 
    $fp = fopen('genre_application','r'); 
    if (!$fp) {echo 'ERROR: Unable to open file.</table></body></html>'; exit;} 

$loop = 0; 
while (!feof($fp)) { 
    $loop++; 
    $line = stream_get_line($fp,128,$eoldelimiter); //use 2048 if very long lines 
if ($line[0] === '#') continue; //Skip lines that start with # 
    $field[$loop] = explode ($delimiter, $line); 
    $fp++; 
$export_date = $field[$loop][0]; 
$genre_id = $field[$loop][1]; 
$application_id = $field[$loop][2]; 

$query = "REPLACE into genre_apps 
(export_date, genre_id, application_id) 
VALUES ('$export_date','$genre_id','$application_id')"; 
print "SQL-Query: ".$query."<br>"; 
     if(mysql_query($query,$db)) 
     { 
      echo " OK !\n"; 
     } 
     else 
      { 
       echo "Error<br><br>"; 
       echo mysql_errno() . ":" . mysql_error() . "</font></center><br>\n"; 
      } 

    } 

    fclose($fp); 
    ?> 

回答

2

你的環填充無故(其寫入到不同小區在每個循環迭代)可變$field,從而使用更多的存儲與每一個線路。

您可以更換:

$field[$loop] = explode ($delimiter, $line); 
$export_date = $field[$loop][0]; 
$genre_id = $field[$loop][1]; 
$application_id = $field[$loop][2]; 

有了:

list($export_date, $genre_id, $application_id) = explode($delimiter, $line); 

爲了提高性能,你可以採取的插入使用REPLACE INTO通過分組N行到一個查詢幾條線的能力優勢。

+0

謝謝你,讓腳本完整:) – kitenski 2010-07-16 14:37:32