2015-03-03 112 views
0

我試圖將數據推送到AWS S3。我有用戶在(http://druid.io/docs/0.7.0/Tutorial:-The-Druid-Cluster.html)的例子,但將common.runtime.properties如下德魯伊未存儲到AWS S3

druid.storage.type=s3 
druid.s3.accessKey=AKIAJWTETHZDEQLHQ7AQ 
druid.s3.secretKey=tcTtvGXcqLmmMbo2hRunzlSA1P2X0O0bjVf537Nt 
druid.storage.bucket=testfeed 
druid.storage.baseKey=sample 

下面是用於實時節點日誌

2015-03-02T15:03:44809 INFO [主] io.druid.guice.JsonConfigurator - 已加載的類[class io.druid.query.QueryConfig]從 道具[druid.query。] as [[email protected]] 2015-03-02T15 :03:44,843 INFO [main] io.druid.guice.JsonConfigurator - 加載的類[class io.druid.query.search.search.SearchQueryConfig] from道具[druid.query.search。]爲 [[email protected]] 2015-03-02T15:03:44,861 INFO [main] io.druid.guice.JsonConfigurator - 從 道具 加載的類[類io.druid.query.groupby.GroupByQueryConfig] [druid.query.groupBy。]作爲 [[email protected]] 2015-03-02T15:03: 44874 INFO [主要] org.skife.config.ConfigurationObjectFactory - 分配值 [億]爲[druid.processing.buffer.sizeBytes]上 [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()] 2015-03- 02T15:03:44,878 INFO [main] org.skife.config.ConfigurationObjectFactory - 分配值[2] [druid.processing.numThreads]上 [io.druid.query.DruidProcessingConfig#getNumThreads()] 2015-03-02T15:03:44878 INFO [主要] org.skife.config.ConfigurationObjectFactory - 使用方法 [$ {base_path} .columnCache.sizeBytes] [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()] 2015-03-02T15:03:44,880 INFO [main] org.skife。 config.ConfigurationObjectFactory - 爲 [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]分配[$ {base_path} .formatString]的默認值 [processing-%s] 2015-03-02T15:03:44,956 INFO [main] io.druid.guice.JsonConfigurator - 加載的c lass [class io.druid.query.topn.TopNQueryConfig] from props [druid.query.topN。] as [[email protected]] 2015-03-02T15:03:44,960 INFO [main] io.druid.guice.JsonConfigurator - 從 道具[druid.storage。]加載的類[class io.druid.segment.loading.LocalDataSegmentPusherConfig]作爲 [[email protected] ] 2015-03-02T15:03:44,967信息[main] io.druid.guice.JsonConfigurator - 加載的類[class io.druid.client.DruidServerConfig]從 props [druid.server。] as [io。 [email protected]] 2015-03-02T15:03:44,971 INFO [main] io.druid.guice.Jso nConfigurator - 加載的類[類 io.druid.server.initialization.BatchDataSegmentAnnouncerConfig]從 道具[druid.announcer。]作爲 [[email protected]ff2a544] 2015-03-02T15:03 :44,984 INFO [main] io.druid.guice.JsonConfigurator - 已加載的類[class io.druid.server.initialization.ZkPathsConfig] from props [druid.zk.paths。] as [io.druid.server.initialization .zkPathsConfig @ 58d3f4be] 2015-03-02T15:03:44,990 INFO [main] io.druid.guice.JsonConfigurator - 加載的類[class io。druid.curator.CuratorConfig]從 道具[druid.zk.service]爲[[email protected]]

回答

0

我得到了這個問題。我錯過了common.runtime.properties中的s3擴展。一旦添加數據開始推到s3。

+0

你可以發表一個片段來說明看起來像什麼嗎? – user766353 2015-03-18 22:32:21

+0

其實我沒有實現任何代碼。遵循上面提到的例子。 – user2611300 2015-03-19 12:58:28

+0

@ user766353這裏是添加s3擴展的行:'druid.extensions.coordinates = [「io.druid.extensions:druid-s3-extensions:0.6.173」]'我運行的是德魯伊版本0.6.173,make確定你改變了你的版本。 – 2015-06-25 15:29:41