org.apache.flume.conf.ConfigurationException: HBase major version number must be less than 2 for hbase-sink
环境:
apache-flume-1.9.0-bin
hbase-2.1.2
hadoop-3.1.2
apache-hive-3.1.1-bin
zookeeper-3.4.13
问题:
bin/flume-ng agent --conf conf/ --name agent --conf-file conf/flume-hbase.conf -Dflume.root.logger=DEBUG,console
启动flume将数据汇入hbase中,出现以下错误:
2019-03-05 17:04:04,378 (conf-file-poller-0) [ERROR - org.apache.flume.sink.hbase.HBaseVersionCheck.hasVersionLessThan2(HBaseVersionCheck.java:40)] Invalid HBase version:2.1.2
2019-03-05 17:04:04,379 (conf-file-poller-0) [ERROR - org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:469)] Sink hbase-sink has been removed due to an error during configuration
org.apache.flume.conf.ConfigurationException: HBase major version number must be less than 2 for hbase-sink.
at org.apache.flume.sink.hbase.HBaseSink.configure(HBaseSink.java:203)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:453)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:106)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:145)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
解决方法:
- 下载hive-2.3.4,并且解压,
- 将
apache-hive-2.3.4-bin/lib下所有hbase-*.jar复制到apache-flume-1.9.0-bin/lib下
转载于:https://my.oschina.net/lwenhao/blog/3018265
