In addition to Weibo, there is also WeChat
Please pay attention
WeChat public account
Shulou
2025-09-26 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Database >
Share
Shulou(Shulou.com)06/01 Report--
I. requirements
Create a table with the snappy compression attribute in the Hbase database.
Log in to the hbase database to perform table creation
Hbase (main): 016 dcs:t_dev_history', 0 > create 'dcs:t_dev_history', {NAME = > faint, DATA_BLOCK_ENCODING = >' PREFIX_TREE', BLOOMFILTER = > 'ROW', REPLICATION_SCOPE = >' 0mm, VERSIONS = > '1mm, COMPRESSION = >' SNAPPY', MIN_VERSIONS = > '0mm, TTL = >' 2678400mm, KEEP_DELETED_CELLS = > 'FALSE', BLOCKSIZE = >' 65536th, IN_MEMORY = > 'false', BLOCKCACHE = >' true'}
Channel 6: open failed: administratively prohibited: open failed
None of the previously created tables use snappy compression. It is suspected that snappy is not installed.
3. Check all hbase nodes
The Master1 node snappy is installed correctly
[hadoop@hadoop-test-Master1 lib] $cd $HBASE_HOME/lib/native/Linux-amd64-64 /
[hadoop@hadoop-test-Master1 Linux-amd64-64] $ls
Libhadoop.a libhadoopsnappy.so.0 libhadoop.so.1.0.0 libhdfs.so libpython2.7.so libsnappy.so.1
Libhadooppipes.a libhadoopsnappy.so.0.0.1 libhadooputils.a libhdfs.so.0.0.0 libpython2.7.so.1.0 libsnappy.so.1.2.0
Libhadoopsnappy.so libhadoop.so libhdfs.a libjvm.so libsnappy.so
Incorrect installation of Master2 node snappy. Guess the wrong path of scp during installation.
[hadoop@hadoop-test-Master2 ~] $cd / var/lib/hbase/lib/native/-found no Linux-amd64-64 directory
[hadoop@hadoop-test-Master2 native] $ls
Libhadoop.a libhadoopsnappy.so.0 libhadoop.so.1.0.0 libhdfs.so libpython2.7.so libsnappy.so.1
Libhadooppipes.a libhadoopsnappy.so.0.0.1 libhadooputils.a libhdfs.so.0.0.0 libpython2.7.so.1.0 libsnappy.so.1.2.0
Libhadoopsnappy.so libhadoop.so libhdfs.a libjvm.so
Libsnappy.so
IV. Processing process
1. Transfer the file to the specified node
Scp-rp Linux-amd64-64 hadoop-test-Master2:/var/lib/hbase/lib/native/
Scp-rp Linux-amd64-64 hadoop-test-Node1:/var/lib/hbase/lib/native/
two。 Then restart the hbase cluster
. / stop-hbase.sh
. / start-hbase.sh
3. Table recreated successfully.
5. Summary
As a dba, the relevant operations must be verified, must be verified, must have a rigorous attitude.
Many problems encountered are not technical problems at all, but some people never pay attention and muddle along.
Compression is a good way to save space in hadoop and hbase and is worth advocating, especially when funds are tight.
Snappy needs to be installed separately, not included with the installation hadoop, so you need to pay attention to it.
Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.
Views: 0
*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.
The market share of Chrome browser on the desktop has exceeded 70%, and users are complaining about
The world's first 2nm mobile chip: Samsung Exynos 2600 is ready for mass production.According to a r
A US federal judge has ruled that Google can keep its Chrome browser, but it will be prohibited from
Continue with the installation of the previous hadoop.First, install zookooper1. Decompress zookoope
About us Contact us Product review car news thenatureplanet
More Form oMedia: AutoTimes. Bestcoffee. SL News. Jarebook. Coffee Hunters. Sundaily. Modezone. NNB. Coffee. Game News. FrontStreet. GGAMEN
© 2024 shulou.com SLNews company. All rights reserved.