HBase major version number must be less than 2 for hbase-sink

时间 2019-11-24

标签 hbase version number sink 栏目 Hadoop 繁體版

原文原文链接

org.apache.flume.conf.ConfigurationException: HBase major version number must be less than 2 for hbase-sink

环境：

apache-flume-1.9.0-bin
hbase-2.1.2
hadoop-3.1.2
apache-hive-3.1.1-bin
zookeeper-3.4.13

问题：

bin/flume-ng agent --conf conf/ --name agent --conf-file conf/flume-hbase.conf -Dflume.root.logger=DEBUG,console

启动flume将数据汇入hbase中，出现如下错误：java

2019-03-05 17:04:04,378 (conf-file-poller-0) [ERROR - org.apache.flume.sink.hbase.HBaseVersionCheck.hasVersionLessThan2(HBaseVersionCheck.java:40)] Invalid HBase version:2.1.2
2019-03-05 17:04:04,379 (conf-file-poller-0) [ERROR - org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:469)] Sink hbase-sink has been removed due to an error during configuration
org.apache.flume.conf.ConfigurationException: HBase major version number must be less than 2 for hbase-sink.
	at org.apache.flume.sink.hbase.HBaseSink.configure(HBaseSink.java:203)
	at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
	at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:453)
	at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:106)
	at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:145)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

解决方法：

下载hive-2.3.4，而且解压，
将apache-hive-2.3.4-bin/lib下全部hbase-*.jar复制到apache-flume-1.9.0-bin/lib下