如何配置hive链接mysql,把mysql做为元数据库?java
文章目录
1.增长mysql数据库的链接配置
2.修改临时文件夹的路径
3.修改 hive-config.sh
4.下载MySQL JDBC驱动
5.在HDFS中建立目录和设置权限
6.初始化元数据库mysql
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist=true&useSSL=false</value>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
<description>Driver class name for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
<description>username to use against metastore database</description>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>password</value>
<description>password to use against metastore database</description>
</property>
复制代码
找到如下2个配置,并改成正确的路径:sql
<property>
<name>hive.exec.local.scratchdir</name>
<value>/home/lee/iotmp</value>
<description>Local scratch space for Hive jobs</description>
</property>
<property>
<name>hive.downloaded.resources.dir</name>
<value>/home/lee/iotmp</value>
<description>Temporary local directory for added resources in the remote file system.</description>
</property>
复制代码
这里由于我当前用户是hduser,因此我在hduser的目录下建立一个iotmp文件夹,并受权:shell
$ mkdir -p /home/lee/iotmp
$ chmod -R 775 /home/lee/iotmp
复制代码
进入到 hive 的 bin 目录下 ....../hive/bin/数据库
$ vi hive-config.sh
复制代码
在该文件的最前面加入如下配置:jvm
//你的JAVA_HOME
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
//你的HADOOP_HOME
export HADOOP_HOME=/usr/local/hadoop
//你的HIVE_HOME
export HIVE_HOME=/usr/local/hive
复制代码
$ wget http://central.maven.org/maven2/mysql/mysql-connector-java/5.1.41/mysql-connector-java-5.1.41.jar
复制代码
下载完后,把jar包复制到..../hive/lib目录下面maven
启动Hadoop,在Hadoop中建立hive须要用到的目录并设置好权限:oop
$ hadoop fs -mkdir /tmp
$ hadoop fs -mkdir -p /home/lee/hive/warehouse
$ hadoop fs -chmod g+w /tmp
$ hadoop fs -chmod g+w /home/lee/hive/warehouse
复制代码
进入 你的hive lib 目录,个人是在/home/lee/hive/lib,初始化Hive元数据对应的MySQL数据库:spa
$ schematool -initSchema -dbType mysql
复制代码