2017-08-23 84 views
1

我一直在爲此工作了幾天,無法超越這個錯誤。我在這個管道中有2項活動。第一個活動將數據從ODBC連接複製到成功的Azure數據庫。第二個活動將數據從Azure表傳輸到另一個Azure表,並保持失敗。Azure數據工廠複製活動

的錯誤信息是: 複製活動遇到無效參數:「UnknownParameterName」,詳細信息:用相同的密鑰已經被添加的項目..

我看不出有任何的參數無效或未知參數名稱。我已多次使用其添加活動代碼模板並自行重寫了這些內容,但在運行時部署時不會收到任何錯誤。以下是JSON管道代碼。

只有第二個活動接收到錯誤。

謝謝。

源數據集

{ 
"name": "AnalyticsDB-SHIPUPS_06shp-01src_AZ-915PM", 
"properties": { 
    "structure": [ 
     { 
      "name": "UPSD_BOL", 
      "type": "String" 
     }, 
     { 
      "name": "UPSD_ORDN", 
      "type": "String" 
     } 
    ], 
    "published": false, 
    "type": "AzureSqlTable", 
    "linkedServiceName": "Source-SQLAzure", 
    "typeProperties": {}, 
    "availability": { 
     "frequency": "Day", 
     "interval": 1, 
     "offset": "04:15:00" 
    }, 
    "external": true, 
    "policy": {} 
} 

}

目的數據集

{ 
"name": "AnalyticsDB-SHIPUPS_06shp-02dst_AZ-915PM", 
"properties": { 
    "structure": [ 
     { 
      "name": "SHIP_SYS_TRACK_NUM", 
      "type": "String" 
     }, 
     { 
      "name": "SHIP_TRACK_NUM", 
      "type": "String" 
     } 
    ], 
    "published": false, 
    "type": "AzureSqlTable", 
    "linkedServiceName": "Destination-Azure-AnalyticsDB", 
    "typeProperties": { 
     "tableName": "[olcm].[SHIP_Tracking]" 
    }, 
    "availability": { 
     "frequency": "Day", 
     "interval": 1, 
     "offset": "04:15:00" 
    }, 
    "external": false, 
    "policy": {} 
} 

}

管道

{ 
"name": "SHIPUPS_FC_COPY-915PM", 
"properties": { 
    "description": "copy shipments ", 
    "activities": [ 
     { 
      "type": "Copy", 
      "typeProperties": { 
       "source": { 
        "type": "RelationalSource", 
        "query": "$$Text.Format('SELECT COMPANY, UPSD_ORDN, UPSD_BOL FROM \"orupsd - UPS interface Dtl\" WHERE COMPANY = \\'01\\'', WindowStart, WindowEnd)" 
       }, 
       "sink": { 
        "type": "SqlSink", 
        "sqlWriterCleanupScript": "$$Text.Format('delete imp_fc.SHIP_UPS_IntDtl_Tracking', WindowStart, WindowEnd)", 
        "writeBatchSize": 0, 
        "writeBatchTimeout": "00:00:00" 
       }, 
       "translator": { 
        "type": "TabularTranslator", 
        "columnMappings": "COMPANY:COMPANY, UPSD_ORDN:UPSD_ORDN, UPSD_BOL:UPSD_BOL" 
       } 
      }, 
      "inputs": [ 
       { 
        "name": "AnalyticsDB-SHIPUPS_03shp-01src_FC-915PM" 
       } 
      ], 
      "outputs": [ 
       { 
        "name": "AnalyticsDB-SHIPUPS_03shp-02dst_AZ-915PM" 
       } 
      ], 
      "policy": { 
       "timeout": "1.00:00:00", 
       "concurrency": 1, 
       "executionPriorityOrder": "NewestFirst", 
       "style": "StartOfInterval", 
       "retry": 3, 
       "longRetry": 0, 
       "longRetryInterval": "00:00:00" 
      }, 
      "scheduler": { 
       "frequency": "Day", 
       "interval": 1, 
       "offset": "04:15:00" 
      }, 
      "name": "915PM-SHIPUPS-fc-copy->[imp_fc]_[SHIP_UPS_IntDtl_Tracking]" 
     }, 
     { 
      "type": "Copy", 
      "typeProperties": { 
       "source": { 
        "type": "SqlSource", 
        "sqlReaderQuery": "$$Text.Format('select distinct ups.UPSD_BOL, ups.UPSD_BOL from imp_fc.SHIP_UPS_IntDtl_Tracking ups LEFT JOIN olcm.SHIP_Tracking st ON ups.UPSD_BOL = st.SHIP_SYS_TRACK_NUM WHERE st.SHIP_SYS_TRACK_NUM IS NULL', WindowStart, WindowEnd)" 
       }, 
       "sink": { 
        "type": "SqlSink", 
        "writeBatchSize": 0, 
        "writeBatchTimeout": "00:00:00" 
       }, 
       "translator": { 
        "type": "TabularTranslator", 
        "columnMappings": "UPSD_BOL:SHIP_SYS_TRACK_NUM, UPSD_BOL:SHIP_TRACK_NUM" 
       } 
      }, 
      "inputs": [ 
       { 
        "name": "AnalyticsDB-SHIPUPS_06shp-01src_AZ-915PM" 
       } 
      ], 
      "outputs": [ 
       { 
        "name": "AnalyticsDB-SHIPUPS_06shp-02dst_AZ-915PM" 
       } 
      ], 
      "policy": { 
       "timeout": "1.00:00:00", 
       "concurrency": 1, 
       "executionPriorityOrder": "NewestFirst", 
       "style": "StartOfInterval", 
       "retry": 3, 
       "longRetryInterval": "00:00:00" 
      }, 
      "scheduler": { 
       "frequency": "Day", 
       "interval": 1, 
       "offset": "04:15:00" 
      }, 
      "name": "915PM-SHIPUPS-AZ-update->[olcm]_[SHIP_Tracking]" 
     } 
    ], 
    "start": "2017-08-22T03:00:00Z", 
    "end": "2099-12-31T08:00:00Z", 
    "isPaused": false, 
    "hubName": "adf-tm-prod-01_hub", 
    "pipelineMode": "Scheduled" 
} 

}

回答

0

你見過這個link

他們得到同樣的錯誤信息,並建議使用AzureTableSink代替SqlSink

"sink": { 
        "type": "AzureTableSink", 
        "writeBatchSize": 0, 
        "writeBatchTimeout": "00:00:00" 
       } 

它將使你的感覺也因爲你的第二個副本活動是天青天青

0

這可能是一個紅色的鯡魚但我很確定「tableName」是一個sqlSource的typeProperties中的require條目。您的輸入數據集缺少此項。欣賞你在sqlReaderQuery中的加入,所以可能最好在那裏放一個虛擬(但真實的)表名。 順便說一句,不清楚爲什麼你在查詢中使用$$ Text.Format和WindowStart/WindowEnd,如果你沒有將這些值轉換到查詢中;你可以把查詢放在雙引號之間。

相關問題