在Azure存儲中刪除批處理操作

Question

我一直在嘗試爲Azure存儲實體的刪除操作實現DAO方法。使用TableOperation刪除可以。

TableOperation deleteEntity = TableOperation.delete(entity); 

但是，當我嘗試使用批處理操作，它不被支持。

任何建議來解決這個問題是高度讚賞。

Answer 1

但是，當我嘗試使用批量操作，它不支持。

我認爲你可以將你的項目按分區鍵進行分組，然後執行TableBatchOperation。

在這裏，我寫了通過C＃語言的一個輔助類爲實現這一目的，你可以參考一下吧：

public class TableBatchHelper<T> where T : ITableEntity 
{ 
    const int batchMaxSize = 100; 

    public static IEnumerable<TableBatchOperation> GetBatchesForDelete(IEnumerable<T> items) 
    { 
     var list = new List<TableBatchOperation>(); 
     var partitionGroups = items.GroupBy(arg => arg.PartitionKey).ToArray(); 
     foreach (var group in partitionGroups) 
     { 
      T[] groupList = group.ToArray(); 
      int offSet = batchMaxSize; 
      T[] entities = groupList.Take(offSet).ToArray(); 
      while (entities.Any()) 
      { 
       var tableBatchOperation = new TableBatchOperation(); 
       foreach (var entity in entities) 
       { 
        tableBatchOperation.Add(TableOperation.Delete(entity)); 
       } 
       list.Add(tableBatchOperation); 
       entities = groupList.Skip(offSet).Take(batchMaxSize).ToArray(); 
       offSet += batchMaxSize; 
      } 
     } 
     return list; 
    } 

    public static async Task BatchDeleteAsync(CloudTable table, IEnumerable<T> items) 
    { 
     var batches = GetBatchesForDelete(items); 
     await Task.WhenAll(batches.Select(table.ExecuteBatchAsync)); 
    } 
} 

然後，你可能在你執行批處理刪除如下：

await TableBatchHelper<ClassName>.BatchDeleteAsync(cloudTable,items); 

或

var batches = TableBatchHelper<ClassName>.GetBatchesForDelete(entities); 
Parallel.ForEach(batches, new ParallelOptions() 
{ 
    MaxDegreeOfParallelism = 5 
}, (batchOperation) => 
    { 
     try 
     { 
      table.ExecuteBatch(batchOperation); 
      Console.WriteLine("Writing {0} records", batchOperation.Count); 
     } 
     catch (Exception ex) 
     { 
      Console.WriteLine("ExecuteBatch throw a exception:" + ex.Message); 
     } 
    }); 

Answer 2

public void deleteLocationsForDevice(String id) { 
    logger.info("Going to delete location data for Device [{}]", id); 

    // Create a filter condition where the partition key is deviceId. 
    String partitionFilter = TableQuery.generateFilterCondition(
      PARTITION_KEY, 
      TableQuery.QueryComparisons.EQUAL, 
      id); 

    // Specify a partition query, using partition key filter. 
    TableQuery<AzureLocationData> partitionQuery = 
      TableQuery.from(AzureLocationData.class) 
        .where(partitionFilter); 



    if (partitionQuery != null) { 
     for (AzureLocationData entity : cloudTable.execute(partitionQuery)) { 

      TableOperation deleteEntity = TableOperation.delete(entity); 
      try { 
       cloudTable.execute(deleteEntity); 
       logger.info("Successfully deleted location records with : " + entity.getPartitionKey()); 
      } catch (StorageException e) { 
       e.printStackTrace(); 
      } 

     } 

    } else { 
     logger.debug("No records to delete!"); 
    } 

    // throw new UnsupportedOperationException("AzureIotLocationDataDao Delete Operation not supported"); 
} 

Answer 3

不，這是沒有使用塊操作的代碼。以下是包含塊操作的代碼。對不起，沒有提及

TableBatchOperation batchOperation = new TableBatchOperation(); 
    List<TableBatchOperation> list = new ArrayList<>(); 

    if (partitionQuery != null) { 
     for (AzureLocationData entity : cloudTable.execute(partitionQuery)) { 

      batchOperation.add(TableOperation.delete(entity)); 
      list.add(batchOperation); //exception thrown line 
     } 
     try { 
      cloudTable.execute((TableOperation) batchOperation); 
     } catch (StorageException e) { 
      e.printStackTrace(); 
      } 
      }