Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

What if hive throws the wrong Wrong FS after configuring HDFS HA

Shulou Source: shulou.com Published: 2022-06-01 15:53:38 10月01日 Update

Editor to share with you after the configuration of HDFS HA hive throw wrong Wrong FS how to do, I believe that most people do not understand, so share this article for your reference, I hope you can learn a lot after reading this article, let's go to know it!

1. Question:

In CDH5.x or Apache environment, when HA of NameNode is configured, Hive does not query data normally.

The following exception occurs in the Hive query:

FAILED: SemanticException Unable to determine if hdfs://hadoop-01:8020/user/hive/warehouse/t1

Is encrypted: java.lang.IllegalArgumentException: Wrong FS: hdfs://hadoop-01:8020/user/hive/warehouse/t1, expected: hdfs://nameservice1

two。 Resolve:

The problem with Hive metadata, there are two tables in the Hive database:

DBS: the total path of the Hive data warehouse

SDS: Hive the path corresponding to each table

a. Enter mysql

B.use hive

c. Modify dbs and sds tables

Update DBS set DB_LOCATION_URI=REPLACE (DB_LOCATION_URI,'hadoop-01:8020','nameservice1')

Update SDS set LOCATION=REPLACE (LOCATION,'hadoop-01:8020','nameservice1')

The above is all the contents of the article "what to do if hive throws the wrong Wrong FS after configuring HDFS HA". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Tags: Data configuration article what to do content path question query not much warehouse most database more environment knowledge industry information information channel channel a. Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno Shulou Information Redmi Huawei vpn Apple