2012-03-17 38 views
1

首先,我搜索了相關的答案,有幾個 - 但找不到什麼特別的東西,我正在尋找。我相信有更好的方法!PHP CSV - MYSQL計時

基本上,我正在尋找一些建議,我有一個腳本,其中將服務器上的CSV文件轉換爲MYSQL數據庫。但是,CSV文件是20mb,腳本只是超時。我修改了我的php.ini,所以它不應該超時,但相反它會導致500內部服務器錯誤。有沒有一種方法,我可以保持頁面的生活,並沒有超時(會jquery做這樣的事情) - 如果沒有,我知道我過去曾使用像大型SQL文件的shell執行,有沒有替代使用類似的東西這個?建議真的會被讚賞。我的編程知識的心不是真的太好了,所以請耐心等待

這裏是我使用的腳本:

<?php 
$databasehost = "localhost"; 
$databasename = "test"; 
$databasetable = "sample"; 
$databaseusername ="test"; 
$databasepassword = ""; 
$fieldseparator = ","; 
$lineseparator = "\n"; 
$csvfile = "filename.csv"; 
/********************************/ 
/* Would you like to add an ampty field at the beginning of these records? 
/* This is useful if you have a table with the first field being an auto_increment integer 
/* and the csv file does not have such as empty field before the records. 
/* Set 1 for yes and 0 for no. ATTENTION: don't set to 1 if you are not sure. 
/* This can dump data in the wrong fields if this extra field does not exist in the table 
/********************************/ 
$addauto = 0; 
/********************************/ 
/* Would you like to save the mysql queries in a file? If yes set $save to 1. 
/* Permission on the file should be set to 777. Either upload a sample file through ftp and 
/* change the permissions, or execute at the prompt: touch output.sql && chmod 777 output.sql 
/********************************/ 
$save = 1; 
$outputfile = "output.sql"; 
/********************************/ 


if(!file_exists($csvfile)) { 
     echo "File not found. Make sure you specified the correct path.\n"; 
     exit; 
} 

$file = fopen($csvfile,"r"); 

if(!$file) { 
     echo "Error opening data file.\n"; 
     exit; 
} 

$size = filesize($csvfile); 

if(!$size) { 
     echo "File is empty.\n"; 
     exit; 
} 

$csvcontent = fread($file,$size); 

fclose($file); 

$con = @mysql_connect($databasehost,$databaseusername,$databasepassword) or die(mysql_error()); 
@mysql_select_db($databasename) or die(mysql_error()); 

$lines = 0; 
$queries = ""; 
$linearray = array(); 

foreach(split($lineseparator,$csvcontent) as $line) { 

     $lines++; 

     $line = trim($line," \t"); 

     $line = str_replace("\r","",$line); 

     /************************************ 
     This line escapes the special character. remove it if entries are already escaped in the csv file 
     ************************************/ 
     $line = str_replace("'","\'",$line); 
     /*************************************/ 

     $linearray = explode($fieldseparator,$line); 

     $linemysql = implode("','",$linearray); 

     if($addauto) 
      $query = "insert into $databasetable values('','$linemysql');"; 
     else 
      $query = "insert into $databasetable values('$linemysql');"; 

     $queries .= $query . "\n"; 

     @mysql_query($query); 
} 

@mysql_close($con); 

if($save) { 

     if(!is_writable($outputfile)) { 
      echo "File is not writable, check permissions.\n"; 
     } 

     else { 
      $file2 = fopen($outputfile,"w"); 

      if(!$file2) { 
        echo "Error writing to the output file.\n"; 
      } 
      else { 
        fwrite($file2,$queries); 
        fclose($file2); 
      } 
     } 

} 

echo "Found a total of $lines records in this csv file.\n"; 


?> 
+0

瞭解如何使用像fgetcsv函數() – 2012-03-17 19:46:02

回答

2

,而不是處理的CSV手動,你應該能夠用做在一個MySQL命令LOAD DATA INFILE。這將把處理轉移到MySQL,並且應該意味着PHP不會超時。如果它仍然超時,則可以始終從shell運行相同的命令。

+0

請原諒我的知識缺乏,但可以在LOAD DATA INFILE在PHP編寫? – 2012-03-17 19:49:45

+0

@BushellConsultancy當然,這只是一個MySQL命令,您應該可以使用任何PHP-MySQL庫在數據庫服務器上運行它。 – liquorvicar 2012-03-17 20:01:56

+0

非常感謝,根據您的結果進行了一些搜索,我完成了工作。如果有其他人想知道:$ query =「LOAD DATA LOCAL INFILE'aw2_dap_combined_all_csv.csv'INTO TABLE mobile FIELDS TERMINATED BY','LINES TERMINATED BY'\ n'」; – 2012-03-17 21:03:33

1

不解析自己的CSV

使用PHP的內置函數fgetcsv()