Shulou(Shulou.com)06/01 Report--

This article mainly introduces "what is the method of hadoop3 Java client client authentication". In the daily operation, I believe that many people have doubts about the method of hadoop3 Java client client authentication. The editor consulted all kinds of materials and sorted out simple and easy-to-use operation methods. I hope it will be helpful to answer the doubts of "what is the method of hadoop3 Java client client authentication?" Next, please follow the editor to study!

The hadoop cluster upgrades hadoop3 and requires Kerberos authentication. The hadoop3 code package is merged. The reference jar package is as follows:

Org.apache.hadoop hadoop-hdfs 3.1.1 org.apache.hadoop hadoop-common 3.1.1 org.apache.hadoop hadoop-client 3.1.1

Authentication method

Configuration config = new Configuration (); config.set ("fs.hdfs.impl", "org.apache.hadoop.hdfs.DistributedFileSystem"); config.set ("dfs.client.block.write.replace-datanode-on-failure.policy", "NEVER"); / / start Kerberos certification String krb5File = "/ etc/krb5.conf"; System.setProperty ("java.security.krb5.conf", krb5File); config.set ("hadoop.security.authentication", "kerberos") / / add cluster default configuration (optional) configuration.addResource (new Path ("/ etc/hadoop/conf/hdfs-site.xml")); configuration.addResource (new Path ("/ etc/hadoop/conf/core-site.xml")); UserGroupInformation.setConfiguration (config); try {UserGroupInformation.loginUserFromKeytab (kerUser, keyPath);} catch (IOException e) {e.printStackTrace () } / / end Kerberos authentication URI uri = new URI ("hdfs:// cluster name or namenode ip address"); / * code specifies the cluster name and namenode node * conf.set ("fs.defaultFS", "hdfs://yiie"); * conf.set ("dfs.nameservices", "yiie"); * conf.set ("dfs.ha.namenodes.yiie", "nn1,nn2") * conf.set ("dfs.namenode.rpc-address.yiie.nn1", "192.168.116.116) 8020); * conf.set (" dfs.namenode.rpc-address.yiie.nn2 "," 192.168.116.116) 8020 "); * conf.set (" dfs.client.failover.proxy.provider.yiie "," org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider "); * conf.setBoolean (" dfs.ha.automatic-failover.enabled ", true) * * / FileSystem.get (uri, config); at this point, the study on "what is the method of hadoop3 Java client client authentication" is over. I hope to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.