Linux下hive安装及测试

前提：提前在linux下安装好了hadoop和mysql并且已经启动。

apache-hive-2.1.1-bin.tar.gz

mysql-connector-java-5.1.7-bin.jar

1、将下载好的apache-hive-2.1.1-bin.tar.gz导入自己新建的hive目录下。

2、解压：

tar -xzvf apache-hive-2.1.1-bin.tar.gz

3、在/etc/profile下增加如下环境变量配置：

# Hive environment  (#代表注释)

export HIVE_HOME=/opt/software/hive/apache-hive-2.1.1-bin

export PATH=$HIVE_HOME/bin:$HIVE_HOME/conf:$PATH

语言 方法

9663 V57kf1ADtc

hmsdh抖音搜不到用户

1916 2011/12/19 20:29:35

4、使环境变量生效

5、设置mysql关联hive

(1)修改配置文件

创建hive-site.xml文件 在hive/conf/目录下创建hive-site.xml文件

<?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration> <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist=true</value> </property> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>root</value> </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>root</value> </property> <property> <name>hive.metastore.schema.verification</name> <value>false</value> <description> Enforce metastore schema version consistency. True: Verify that version information stored in metastore matches with one from Hive jars. Also disable automatic schema migration attempt. Users are required to manully migrate schema after Hive upgrade which ensures proper metastore schema migration. (Default) False: Warn if the version information stored in metastore doesn't match with one from in Hive jars. </description> </property> </configuration>

(2)将mysql-connector-Java-5.1.15-bin.jar拷贝到/opt/software/hive/apache-hive-2.1.1-bin下的lib下即可

6、数据库初始化

bin/schematool -initSchema -dbType mysql

7、bin/hive

8、启动数据库，并输入show databases;

9、测试

（1）创建数据库create database db_hive_test;

（2）创建测试表

use db_hive_test;

create table student(id int,name string) row format delimited fields terminated by '\t';

（3）返回linux新建student.txt 文件写入数据(id，name 按tab键分隔)

（4）load data local inpath '/home/hadoop/student.txt' into table  db_hive_test.student

（5）操作

10、安装遇到的错误

[root@master bin]# ./schematool -initSchema -dbType mysqlCannot find hadoop installation: $HADOOP_HOME or $HADOOP_PREFIX must be set or hadoop must be in the path

解决办法：

在hive-env.sh里加入如下内容：

export HADOOP_HOME=/opt/softWare/hadoop/hadoop-2.7.3