sqoop2的安装-执行-问题

1、安装shell

1.解压
2.引入环境变量
vi ~/.bashrc
export SQOOP_HOME=/home/hadoop/sqoop/sqoop-1.99.7-bin-hadoop200
export PATH=$PATH:$SQOOP_HOME/bin
export SQOOP_SERVER_EXTRA_LIB=$SQOOP_HOME/extra
export CATALINA_BASE=$SQOOP_HOME/server
export LOGDIR=$SQOOP_HOME/logs/
3.修改配置文件
cd /apps/sqoop/server/conf
a:
vi sqoop.properties
org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/apps/hadoop-2.8.1/etc/hadoopapache

b:
vi catalina.properties
common.loader=${catalina.base}/lib,${catalina.base}/lib/*.jar,${catalina.home}/lib,${catalina.home}/lib/*.jar,${catalina.home}/../lib/*.jar,/apps/hadoop-2.8.1/share/hadoop/common/*.jar,/apps/hadoop-2.8.1/share/hadoop/common/lib/*.jar,/apps/hadoop-2.8.1/share/hadoop/hdfs/*.jar,/apps/hadoop-2.8.1/share/hadoop/hdfs/lib/*.jar,/apps/hadoop-2.8.1/share/hadoop/mapreduce/*.jar,/apps/hadoop-2.8.1/share/hadoop/mapreduce/lib/*.jar,/apps/hadoop-2.8.1/share/hadoop/tools/lib/*.jar,/apps/hadoop-2.8.1/share/hadoop/yarn/*.jar,/apps/hadoop-2.8.1/share/hadoop/yarn/lib/*.jar,/apps/hadoop-2.8.1/share/hadoop/httpfs/tomcat/lib/*.jartomcat

2、执行bash

1.Start or stop the sqoop server
sqoop.sh server start/stop
2.Start the sqoop shell
sqoop.sh client
3、问题app

问题: org.apache.sqoop.common.SqoopException: GENERIC_JDBC_CONNECTOR_0005:No column is found to partition data
解决:
而后我对个人sqoop  job作了updateoop

有以下信息
Schema name: datamart
Table name:table_name
Table SQL statement:
Table column names:
Partition column name:
Null value allowed for the partition column:
Boundary query:server

Partition column name分区的列名,正好我把表table_name的分布键  id  加了上去,而后start job --jid 1
执行成功hadoop

相关文章
相关标签/搜索