Get the App
SLTechnology News&Howtos  ›  Development  › 

What problems should engineer big data pay attention to during the interview?

Shulou Source: shulou.com Published: 2022-06-02 03:40:50 10月27日 Update

Most people do not understand the knowledge points of this article "what questions should be paid attention to during the interview of big data Engineers", so the editor summarizes the following contents for you. The contents are detailed, the steps are clear, and they can be used for reference. I hope you can get something after reading this article. Let's take a look at this article, "what problems should engineer big data pay attention to during the interview?"

Topic 1: Ganglia can not only monitor, but also alarm. (correct)

Analysis: the purpose of this question is to test the understanding of Ganglia. Strictly speaking, it is correct. As one of the most commonly used monitoring software in Linux environment, ganglia is good at collecting data from nodes according to the needs of users at a lower cost.

But ganglia is not good at warning and notifying users of events. The latest ganglia already has some of this functionality. But Nagios is also better at giving warnings. Nagios is a software that is good at early warning and notification. By combining Ganglia and Nagios, taking the data collected by Ganglia as the data source of Nagios, and then using Nagios to send early warning notification, a complete set of monitoring and management system can be realized perfectly.

Topic 2: Block Size cannot be modified. (error)

Analysis: it is the basic configuration file of Hadoop that can be modified. When a Job is established by default, the Config,Config of Job will be established. First read the configuration of hadoop-default.xml, and then read the configuration of hadoop-site.xml (the initial configuration of this file is empty). The main configuration in hadoop-site.xml is the system-level configuration of hadoop-default.xml to be covered.

Topic 3: Nagios cannot monitor Hadoop clusters because it does not provide Hadoop support. (error)

Analysis: Nagios is not only a cluster monitoring tool, but also one of the three powerful tools of cloud computing.

Topic 4: if NameNode terminates unexpectedly, SecondaryNameNode will replace it to keep the cluster working. (error)

Analysis: SecondaryNameNode is to help restore, not replace, how to restore, you can see.

Topic 5: Cloudera CDH needs to be used for a fee. (error)

Analysis: the first set of paid products was unveiled by Cloudera Enterpris,Cloudera Enterprise at the Hadoop Conference (Hadoop Summit) held in California, USA, with a number of proprietary management, monitoring and operation tools to enhance the functions of Hadoop. The fee is ordered by contract, and the price varies with the size of the Hadoop set used.

The above is about the content of this article "what questions should be paid attention to when big data engineers interview". I believe we all have a certain understanding. I hope the content shared by the editor will be helpful to you. If you want to know more about the relevant knowledge, please follow the industry information channel.

Tags: Data monitoring configuration content topic analysis error engineering engineer problem cluster early warning function that is tools files articles time users knowledge Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno Xiaomi Redmi Linux MariaDB Shulou Information