Shulou(Shulou.com)06/01 Report--

This article mainly explains "the way of data migration of hbase". The content of the explanation is simple and clear, and it is easy to learn and understand. Please follow the editor's train of thought to study and learn "the way of data migration of hbase".

Migration of hbase

1 copy table mode

Bin/hbase org.apache.hadoop.hbase.mapreduce.CopyTable-- peer.adr=zookeeper1,zookeeper2,zookeeper3:/hbase 'testtable'

Currently, versions prior to 0.92 do not support multiple versions of replication, while 0.94 already supports multiple versions of replication. Of course, this operation needs to add the conf/mapred-site.xml in the hbase directory, and you can copy the hadoop.

2,Export/Import

Bin/hbase org.apache.hadoop.hbase.mapreduce.Export testtable / user/testtable [versions] [starttime] [stoptime]

Bin/hbase org.apache.hadoop.hbase.mapreduce.Import testtable / user/testtable

I think cross-version migration is a good choice, and copytable does not support multiple versions, while export supports multiple versions, which is more practical than copytable.

3. Directly copy the files corresponding to hdfs

First copy the hdfs file, such as bin/hadoop distcp hdfs://srcnamenode:9000/hbase/testtable/ hdfs://distnamenode:9000/hbase/testtable/

Then execute bin/hbase org.jruby.Main bin/add_table.rb / hbase/testtable on the destination hbase

After generating meta information, restart hbase

This operation is a simple way to turn off writing to hbase, execute all flush tables (described above), and then copy distcp.

Thank you for reading, the above is the content of "data migration mode of hbase". After the study of this article, I believe you have a deeper understanding of the data migration mode of hbase, and the specific use needs to be verified in practice. Here is, the editor will push for you more related knowledge points of the article, welcome to follow!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.