Shulou(Shulou.com)06/01 Report--

This article mainly introduces Hive data warehouse example analysis, with a certain reference value, interested friends can refer to, I hope you read this article after a lot of gains, the following let Xiaobian take you to understand.

Interaction mode-user interface: CLI (linux command line), WUI (hive web page), Client (connect remote service HiveServer2, eg: JDBC, ODBC)

Hive command line mode:

1. Enter bin execution./ hiv

2. Configure Hive environment variables and directly execute the command: hive --service cli or hive

Hive's web model:

Run hive -service hwi and visit http://master:9999/hwi after startup

Hive's Remote Services:

Default port: 10000, execute startup command: nobup hive --service hiveserver2 &

Metadata storage: hive stores metadata in mysql or Derby, etc. Metadata mainly depends on MetastoreDB service

Hive data model includes tables, external tables, partitions, buckets

Parser, compiler, optimizer: HQL syntax parsing done by MapReduce

Data storage: stored in HDFS

HiveQL: Used to analyze and process structured data stored in HDFS, it does not support transactions and update operations, and the delay is relatively large.

Database operations: create internal tables, create external tables (external keywords, delete tables only delete metadata information, not delete data), create static partition tables, create dynamic partition tables, create tables with data (create table xx as select xx from table)

Data import: local and HDFS import, single table insert, multi-table insert

Data export: Export data to local and HDFS

HiveQL queries: Compatible with most SQL syntax, no updates and transactions

Thank you for reading this article carefully. I hope that the article "Sample Analysis of Data Warehouse in Hive" shared by Xiaobian will be helpful to everyone. At the same time, I hope that everyone will support it more, pay attention to the industry information channel, and more relevant knowledge is waiting for you to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.