2011-09-12 88 views
5

我有以下腳本從我的服務器上的csv文件導入數據,該腳本正常工作。從外部FTP站點導入csv文件

我需要將文件的位置從我的服務器更改爲需要驗證的FTP服務器。 FTP服務器上的csv文件名將根據生成的時間戳進行調整。導入到MySQL數據庫後,需要刪除FTP服務器上的文件。

然後我需要使用cron作業安排這項工作,每5分鐘運行一次。

任何援助將不勝感激。

謝謝。


<?php 

/********************************/ 
/* Code at http://legend.ws/blog/tips-tricks/csv-php-mysql-import/ 
/* Edit the entries below to reflect the appropriate values 
/********************************/ 
$databasehost = "localhost"; 
$databasename = "dbname"; 
$databasetable = "dbtable"; 
$databaseusername ="username"; 
$databasepassword = "password"; 
$fieldseparator = ","; 
$lineseparator = "\n"; 
$csvfile = "filenamewithtimestamp.csv"; 
/********************************/ 
/* Would you like to add an empty field at the beginning of these records? 
/* This is useful if you have a table with the first field being an auto_increment integer 
/* and the csv file does not have such as empty field before the records. 
/* Set 1 for yes and 0 for no. ATTENTION: don't set to 1 if you are not sure. 
/* This can dump data in the wrong fields if this extra field does not exist in the table 
/********************************/ 
$addauto = 0; 
/********************************/ 
/* Would you like to save the mysql queries in a file? If yes set $save to 1. 
/* Permission on the file should be set to 777. Either upload a sample file through ftp and 
/* change the permissions, or execute at the prompt: touch output.sql && chmod 777 output.sql 
/********************************/ 
$save = 0; 
$outputfile = "output.sql"; 
/********************************/ 


if(!file_exists($csvfile)) { 
    echo "File not found. Make sure you specified the correct path.\n"; 
    exit; 
} 

$file = fopen($csvfile,"r"); 

if(!$file) { 
    echo "Error opening data file.\n"; 
    exit; 
} 

$size = filesize($csvfile); 

if(!$size) { 
    echo "File is empty.\n"; 
    exit; 
} 

$csvcontent = fread($file,$size); 

fclose($file); 

$con = @mysql_connect($databasehost,$databaseusername,$databasepassword) or die(mysql_error()); 
@mysql_select_db($databasename) or die(mysql_error()); 

$lines = 0; 
$queries = ""; 
$linearray = array(); 

foreach(split($lineseparator,$csvcontent) as $line) { 

    $lines++; 

    $line = trim($line," \t"); 

    $line = str_replace("\r","",$line); 

    /************************************ 
    This line escapes the special character. remove it if entries are already escaped in the csv file 
    ************************************/ 
    $line = str_replace("'","\'",$line); 
    /*************************************/ 

    $linearray = explode($fieldseparator,$line); 

    $linemysql = implode("','",$linearray); 

    if($addauto) 
     $query = "insert into $databasetable values('','$linemysql');"; 
    else 
     $query = "insert into $databasetable values('$linemysql');"; 

    $queries .= $query . "\n"; 

    @mysql_query($query); 
} 

@mysql_close($con); 

if($save) { 

    if(!is_writable($outputfile)) { 
     echo "File is not writable, check permissions.\n"; 
    } 

    else { 
     $file2 = fopen($outputfile,"w"); 

     if(!$file2) { 
      echo "Error writing to the output file.\n"; 
     } 
     else { 
      fwrite($file2,$queries); 
      fclose($file2); 
     } 
    } 

} 

echo "Found a total of $lines records in this csv file.\n All records imported"; 


?> 

+1

只是一個隨機點,可能值得看看fgetcsv和fputcsv PHP函數。 –

回答

2

我以爲我只是張貼解決了我的問題的代碼;它從外部FTP站點將csv文件下載到本地服務器上。然後它將csv文件導入到我的本地mysql數據庫表中。一旦導入ftp服務器上的文件被刪除。我使用cronjob在cpanel中安排這項工作。

我不能讚揚腳本,我剛剛修改了另一個站點上發現的腳本。我確信有一些更好的方法可以做一些錯誤檢查。不過,這是我用我有限的技能可以做的最好的。

我希望這可以幫助未來的遊客有同樣的問題。感謝所有那些幫助我的人。 這裏是我使用的代碼:

<?php 

$source = "DespGoods.csv"; 
$target = fopen("DespGoods.csv", "w"); 
$conn = ftp_connect("ftp.server.com") or die("Could not connect"); 

ftp_login($conn,"ftpusername","ftppassword"); 
ftp_fget($conn,$target,$source,FTP_ASCII); 

echo "file downloaded.\n"; 

/********************************/ 
/* Code at http://legend.ws/blog/tips-tricks/csv-php-mysql-import/ 
/* Edit the entries below to reflect the appropriate values 
/********************************/ 
$dbhost = "localhost"; 
$dbname = "dbname"; 
$dbtable = "despgoods"; 
$dbusername ="dbusername"; 
$dbpassword = "dbpassword"; 
$fieldseparator = ","; 
$lineseparator = "\n"; 
$csvfile = "DespGoods.csv"; 
/********************************/ 
/* Would you like to add an ampty field at the beginning of these records? 
/* This is useful if you have a table with the first field being an auto_increment 
/* integer and the csv file does not have such as empty field before the records. 
/* Set 1 for yes and 0 for no. ATTENTION: don't set to 1 if you are not sure. 
/* This can dump data in the wrong fields if this extra field does not 
/* exist in the table. 
/********************************/ 
$addauto = 0; 
/********************************/ 
/* Would you like to save the mysql queries in a file? If yes set $save to 1. 
/* Permission on the file should be set to 777. Either upload a sample file 
/* through ftp and change the permissions, or execute at the prompt: 
/*  touch output.sql && chmod 777 output.sql 
/********************************/ 
$save = 0; 
$outputfile = "output.sql"; 
/********************************/ 

if(!file_exists($csvfile)) { 
    echo "File not found. Make sure you specified the correct path.\n"; 
    exit; 
} 

$file = fopen($csvfile,"r"); 
if(!$file) { 
    echo "Error opening data file.\n"; 
    exit; 
} 

$size = filesize($csvfile); 
if(!$size) { 
    echo "File is empty.\n"; 
    exit; 
} 

$csvcontent = fread($file,$size); 
fclose($file); 

$con = @mysql_connect($dbhost,$dbusername,$dbpassword) or die(mysql_error()); 
@mysql_select_db($dbname) or die(mysql_error()); 

$lines = 0; 
$queries = ""; 
$linearray = array(); 

foreach(split($lineseparator,$csvcontent) as $line) { 
    $lines++; 
    $line = trim($line," \t"); 
    $line = str_replace("\r","",$line); 

    /************************************ 
    /* This line escapes the special character. 
    /* Remove it if entries are already escaped in the csv file 
    /************************************/ 
    $line = str_replace("'","\'",$line); 
    /*************************************/ 

    $linearray = explode($fieldseparator,$line); 
    $linemysql = implode("','",$linearray); 

    if($addauto) { 
     $query = "insert into $dbtable values('','$linemysql');"; 
    } 
    else { 
     $query = "insert into $dbtable values('$linemysql');"; 
    } 
    $queries .= $query . "\n"; 
    @mysql_query($query); 
} 

@mysql_close($con); 
if($save) { 
    if(!is_writable($outputfile)) { 
     echo "File is not writable, check permissions.\n"; 
    } 
    else { 
     $file2 = fopen($outputfile,"w"); 

     if(!$file2) { 
      echo "Error writing to the output file.\n"; 
     } 
     else { 
      fwrite($file2,$queries); 
      fclose($file2); 
     } 
    } 
} 

echo "Found a total of $lines records in this csv file.\n"; 

$source = "DespGoods.csv"; 
$target = fopen("DespGoods.csv", "w"); 
$conn = ftp_connect("ftp.server") or die("Could not connect"); 

ftp_login($conn,"ftpusername","ftppassword"); 
ftp_delete($conn,$source); 
ftp_close($conn); 

echo "file deleted"; 
mysql_close($con); 

?>