Shulou(Shulou.com)06/01 Report--

Today, I will talk to you about how to analyze non-relational database HBSAE. Many people may not know much about it. In order to make you understand better, the editor has summarized the following contents for you. I hope you can get something according to this article.

Hbase usage scenario: there are billions of columns and thousands of read and write data operations in a very short period of time

Applications with a large number of writes per day and relatively small number of reads do not need complex query conditions to query data. HBase only supports queries based on rowkey.

Read and write process: clinet-wal-memstore-Hfile

Concepts: Hmaster, RegionServer, Region, HFile

Cluster configuration: CPU: 8x24 core, power: constant, good heat dissipation, memory: 8x48g, disk: SATA driver, (7200r/min), network (small cluster 1G/s, large cluster 10G/s)

Capacity planning: the disk capacity is 25% or 50% more than the actual storage capacity

Estimation formula: t = (Schror) * 1.25 (temporary files estimated)

S: storage capacity, R: number of replicas, T: space required by the cluster

Using NTP (Network time Protocol) to ensure the punctuality of all nodes in the cluster

Hbase operation:

Read "get get 't1" recording "rowkey001", "f1ambigucol1".

Write "put put 't1" recording "rowkey001" F1 "" F1 "" col1 "value01'"

Scan 'tablename', {LIMIT = > 2} for the first two lines

Delete 't1recording, recording rowkey001recording, recording, and recording, deleting, recording, writing, etc.

Hbase can be used as hive external table data

Permission control: ACL

Data backup:

1. Offline backup: distcp command hadoop distcp hdfs://jiqun1:9000/hbase hdfs://jiqun2:9000/hbasebackup/backup1

2. Online backup: Hbase snapshot-both online and offline

3. Use Export and Import for backup and recovery

Java operation HBase

Basic addition, deletion, modification and query HTable class. Hbase storage is all bytes, and the size of Hbase cell data cannot exceed 20m.

Filter function-filter through RegionServer

Hbase provides restful and thrift service interfaces internally, which can be opened by command.

Other Nosql databases: redis supports transactions, MongoDB does not support transactions

After reading the above, do you have any further understanding of how to analyze the non-relational database HBSAE? If you want to know more knowledge or related content, please follow the industry information channel, thank you for your support.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.