Example Analysis of data Warehouse in Hive
This article mainly introduces Hive data warehouse example analysis, with a certain reference value, interested friends can refer to, I hope you read this article after a lot of gains, the following let Xiaobian take you to understand.
Interaction mode-user interface: CLI (linux command line), WUI (hive web page), Client (connect remote service HiveServer2, eg: JDBC, ODBC)
Hive command line mode:
1. Enter bin execution./ hiv
2. Configure Hive environment variables and directly execute the command: hive --service cli or hive
Hive's web model:
Run hive -service hwi and visit http://master:9999/hwi after startup
Hive's Remote Services:
Default port: 10000, execute startup command: nobup hive --service hiveserver2 &
Metadata storage: hive stores metadata in mysql or Derby, etc. Metadata mainly depends on MetastoreDB service
Hive data model includes tables, external tables, partitions, buckets
Parser, compiler, optimizer: HQL syntax parsing done by MapReduce
Data storage: stored in HDFS
HiveQL: Used to analyze and process structured data stored in HDFS, it does not support transactions and update operations, and the delay is relatively large.
Database operations: create internal tables, create external tables (external keywords, delete tables only delete metadata information, not delete data), create static partition tables, create dynamic partition tables, create tables with data (create table xx as select xx from table)
Data import: local and HDFS import, single table insert, multi-table insert
Data export: Export data to local and HDFS
HiveQL queries: Compatible with most SQL syntax, no updates and transactions
Thank you for reading this article carefully. I hope that the article "Sample Analysis of Data Warehouse in Hive" shared by Xiaobian will be helpful to everyone. At the same time, I hope that everyone will support it more, pay attention to the industry information channel, and more relevant knowledge is waiting for you to learn!
