在PHP（Codeigniter）中插入Mongodb插入少量數據後插入緩慢

Question

在Mongodb插入少量數據後插入變慢，我使用batch_insert插入。插入時，我還需要檢查一些條件。

要插入20k數據本身需要1個多小時。

在temporary_table我有1L的數據

$batchSize = 20; 
$documents = array(); 
$count = count($pending_contacts_data); 
$count =1; 
$temporary_data = array(); 

for($i=0;$i<$count;$i++){ 

    $multiple_temporary_data = $this->mongo_db->select('*')->where(array('contact_id'=>(int)4,'status'=>1))->limit(10000)->get('temporary_table'); 
    $temporary_data = array_merge($temporary_data,$multiple_temporary_data); 
} 

$count1 = count($temporary_data); 
$documents = array(); 
for ($i=0; $i<$count1; $i++) 
{ 

    $obj_id[] = $temporary_data[$i]->_id; 
    $test_email = $this->mongo_db->select('*')->where(array('encrypted_email'=>$temporary_data[$i]->encrypted_email))->get('email_table'); 

    if(empty($test_email)){ 
    $document = array('email_id'=>$temporary_data[$i]->email, 
         'encrypted_email'=>$temporary_data[$i]->encrypted_email, 
         'encrypted_key'=>$temporary_data[$i]->encrypted_key, 
         'encrypted_iv'=>$temporary_data[$i]->encrypted_iv, 
         'status'=>(int)1, 
         'opend_supression_status'=>'' 
        ); 
     array_push($documents, $document); 

    if ((($i % $batchSize) === 0)) { 

      $insert = $this->mongo_db->batch_insert('opend_contacts_email_new1',$documents); 
      $update_temporary =$this->mongo_db->where_in('_id',$obj_id)->set(array('status'=>13))->update_all('temporary_data'); 
      $documents = array(); 
    } 
    } 
} 

Answer 1

出了什麼問題與您的代碼是第500個元素每個新項目擔任單批後插入。 $文檔只是其餘循環的一個元素的數組。 ü應該已經使用了模運算%

$count = 20000; 
$batchSize = 50; 

for ($i=1; $i<=$count; ++$i){ 

    $test_email = $this->mongo_db->select('*')->where(array('email_id'=>$temporary_data[$i]->email_id))->get('email_table'); 

    if(empty($test_email)){ 
    $document = array('email_id'=>$temporary_data[$i]->email, 
          'encrypted_email'=>$temporary_data[$i]->encrypted_email, 
          'encrypted_key'=>$temporary_data[$i]->encrypted_key, 
          'encrypted_iv'=>$temporary_data[$i]->encrypted_iv, 
          'status'=>(int)1, 
          'suppression_status'=>'' 
    ); 
    array_push($documents, $document); 

    if (($i % $batchSize) === 0) {   
      $insert = $this->mongo_db->batch_insert('email_table',$documents); 
      $documents = array(); 
    } 
    } 
}