2017-02-02 41 views
1

我試圖使用Cloudera Manager 5來啓用Oozie HA。該過程非常簡單。我所要做的就是爲配置的負載均衡器提供一個主機名:端口,Cloudera Manager將創建一個額外的Oozie服務器。 我在主機XXX.XXX.XXX.246上已經有一個Oozie服務器,而我的其他Oozie服務器應該在主機XXX.XXX.XXX.247上。應該在主機XXX.XXX.XXX.248上配置HAProxy。對於負載均衡器的主機名:端口,我選擇了XXX.XXX.XXX.248:11000。 haproxy.cfg文件:使用HAProxy負載平衡器的Oozie HA配置

timeout connect   10s 
timeout client   1m 
timeout server   1m 
timeout http-keep-alive 10s 
timeout check   10s 
maxconn     3000 

frontend main *:80 

    acl url_static  path_beg  -i /static /images /javascript  /stylesheets 
acl url_static  path_end  -i .jpg .gif .png .css .js 

use_backend static   if url_static 
default_backend    app 

backend static 
balance  roundrobin 
server  static 127.0.0.1:4331 check 

backend app 
balance  roundrobin 
mode http 
stats enable 
stats uri /haproxy?stats 
option httpclose 
option forwardfor 
server oozie1 XXX.XXX.XXX.246:80 check 
server oozie2 XXX.XXX.XXX.247:80 check 

當我嘗試啓動Oozie的服務器,我得到以下異常:

java.lang.NoSuchFieldError: EXTERNAL_PROPERTY 
at org.codehaus.jackson.map.introspect.JacksonAnnotationIntrospector._findTypeResolver(JacksonAnnotationIntrospector.java:777) 
at org.codehaus.jackson.map.introspect.JacksonAnnotationIntrospector.findPropertyTypeResolver(JacksonAnnotationIntrospector.java:214) 
at org.codehaus.jackson.map.ser.BeanSerializerFactory.findPropertyTypeSerializer(BeanSerializerFactory.java:370) 
at org.codehaus.jackson.map.ser.BeanSerializerFactory._constructWriter(BeanSerializerFactory.java:772) 
at org.codehaus.jackson.map.ser.BeanSerializerFactory.findBeanProperties(BeanSerializerFactory.java:586) 
at org.codehaus.jackson.map.ser.BeanSerializerFactory.constructBeanSerializer(BeanSerializerFactory.java:430) 
at org.codehaus.jackson.map.ser.BeanSerializerFactory.findBeanSerializer(BeanSerializerFactory.java:343) 
at org.codehaus.jackson.map.ser.BeanSerializerFactory.createSerializer(BeanSerializerFactory.java:287) 
at org.codehaus.jackson.map.ser.StdSerializerProvider._createUntypedSerializer(StdSerializerProvider.java:782) 
at org.codehaus.jackson.map.ser.StdSerializerProvider._createAndCacheUntypedSerializer(StdSerializerProvider.java:735) 
at org.codehaus.jackson.map.ser.StdSerializerProvider.findValueSerializer(StdSerializerProvider.java:344) 
at org.codehaus.jackson.map.ser.StdSerializerProvider.findTypedValueSerializer(StdSerializerProvider.java:420) 
at org.codehaus.jackson.map.ser.StdSerializerProvider._serializeValue(StdSerializerProvider.java:601) 
at org.codehaus.jackson.map.ser.StdSerializerProvider.serializeValue(StdSerializerProvider.java:256) 
at org.codehaus.jackson.map.ObjectMapper._configAndWriteValue(ObjectMapper.java:2566) 
at org.codehaus.jackson.map.ObjectMapper.writeValue(ObjectMapper.java:2056) 
at org.apache.oozie.util.FixedJsonInstanceSerializer.serialize(FixedJsonInstanceSerializer.java:65) 
at org.apache.curator.x.discovery.details.ServiceDiscoveryImpl.internalRegisterService(ServiceDiscoveryImpl.java:201) 
at org.apache.curator.x.discovery.details.ServiceDiscoveryImpl.registerService(ServiceDiscoveryImpl.java:186) 
at org.apache.oozie.util.ZKUtils.advertiseService(ZKUtils.java:217) 
at org.apache.oozie.util.ZKUtils.<init>(ZKUtils.java:141) 
at org.apache.oozie.util.ZKUtils.register(ZKUtils.java:154) 
at org.apache.oozie.service.ZKLocksService.init(ZKLocksService.java:70) 
at org.apache.oozie.service.Services.setServiceInternal(Services.java:386) 
at org.apache.oozie.service.Services.setService(Services.java:372) 
at org.apache.oozie.service.Services.loadServices(Services.java:305) 
at org.apache.oozie.service.Services.init(Services.java:213) 
at org.apache.oozie.servlet.ServicesLoader.contextInitialized(ServicesLoader.java:46) 
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210) 
at org.apache.catalina.core.StandardContext.start(StandardContext.java:4709) 
at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:802) 
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779) 
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:583) 
at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:944) 
at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:779) 
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:505) 
at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1322) 
at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:325) 
at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142) 
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1068) 
at org.apache.catalina.core.StandardHost.start(StandardHost.java:822) 
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1060) 
at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463) 
at org.apache.catalina.core.StandardService.start(StandardService.java:525) 
at org.apache.catalina.core.StandardServer.start(StandardServer.java:759) 
at org.apache.catalina.startup.Catalina.start(Catalina.java:595) 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
at java.lang.reflect.Method.invoke(Method.java:606) 
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) 
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) 

我不知道該配置的一部分是錯的,什麼原因導致的問題。我將不勝感激任何幫助。謝謝!

回答

0

我只是想給一個更新。問題是CDH 5.x並不常見。 由於與Oozie和Hive使用的Jackson版本不兼容,並且根據瓶子被加載到Oozie類路徑中的順序,Oozie可能無法從前面提到的異常開始。 解決方案,如果您使用的包裹,如下:

  1. 刪除或移動/opt/cloudera/parcels/CDH/lib/oozie/libserver/hive-exec.jar和/ opt/Cloudera公司/包裹/ CDH/lib目錄/ Oozie的/ libtools /蜂房exec.jar。
  2. 從Cloudera倉庫下載hive-exec-core.jar並將其放入/ opt/cloudera/parcels/CDH/lib/oozie/libserver /和/ opt/cloudera/parcels/CDH/lib/oozie/libtools /。
  3. 從maven回購下載kryo-2.22.jar並將其放入/ opt/cloudera/parcels/CDH/lib/oozie/libserver /和/ opt/cloudera/parcels/CDH/lib/oozie/libtools /。

現在,haproxy配置和Oozie HA啓用應該很簡單。