Shulou(Shulou.com)06/02 Report--

This article mainly introduces "Sqoop how to import data to provide password alias". In daily operation, I believe many people have doubts about how to import data to provide password alias. Xiaobian consulted all kinds of information and sorted out simple and easy to use operation methods. I hope to help you answer the doubts of "Sqoop how to import data to provide password alias"! Next, please follow the small series to learn together!

Recently encountered sqoop password import problem, record it. When Sqoop is imported from a relational database into HDFS, it requires the password of the relational database, but the password is not safe to display in plaintext, so after hadoop 2.6, Sqoop uses hadoop credential to use password-alias.

Use hadoop to generate jceks, as shown in List-1 below, then generate mysql.password.jceks file under/tmp, then pass mysql.password.jceks to/user/sqoop of hdfs.

List-1

hadoop credential create mydb.password.alias -provider localjceks://file/tmp/mysql.password.jceksEnter alias password: Enter alias password again: mydb.password.alias has been successfully created.

Then how to use it in sqoop, as follows List-2, using the alias mydb.password.alias instead of using the password directly.

List-2

sqoop import \-Dhadoop.security.credential.provider.path=jceks://hdfs/user/sqoop/mysql.password.jceks \--connect jdbc:mysql://x.x.x.x:3306/xxx \--username xxx --password-alias mydb.password.alias \... At this point, the study of "Sqoop how to import data to provide password aliases" is over, hoping to solve everyone's doubts. Theory and practice can better match to help everyone learn, go and try it! If you want to continue learning more relevant knowledge, please continue to pay attention to the website, Xiaobian will continue to strive to bring more practical articles for everyone!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.