Get the App
  • Using Spark API to develop Spark Program based on IDEA

    Using Spark API to develop Spark Program based on IDEA

    Qingming Festival holiday twists and turns for two days, summed up two ways to use IDE spark program, record: the first method is relatively simple, both ways are compiled using SBT. Note: there is no need to install the Scala program locally, otherwise there will be version compatibility issues when compiling the program. one

    Shulou · 2022-06-03 06:50
  • How can SD card format be restored? Simple recovery tips

    How can SD card format be restored? Simple recovery tips

    How can SD card format be restored? A simple way to recover. We often feel that our SD card may not be very useful, but sometimes our SD card will hold our important memories, so we attach great importance to the SD card. So if you delete us,

    Shulou · 2022-06-03 06:50
  • Loadrunner12.6 installation and basic recording manual

    Loadrunner12.6 installation and basic recording manual

    Loadrunner12.6 installation and basic operation guidance environment requirements: the required version of the software supports Microsoft operating system Microsoft Windows 7 SP1 64-bit (Recommended) Microsoft W

    Shulou · 2022-06-03 06:50
  • Deep understanding of HDFS architecture

    Deep understanding of HDFS architecture

    In-depth understanding of replica storage in HDFS architecture: optimized replica storage strategy is an important feature of HDFS to distinguish other distributed systems. HDFS adopts rack-aware strategy to improve the reliability, availability and network bandwidth utilization of replica data. Through rack awareness, Namenode can determine

    Shulou · 2022-06-03 06:50
  • What is software testing?

    What is software testing?

    I understand the software testing: testers stand from the user's point of view to test whether the software meets the needs of users.

    Shulou · 2022-06-03 06:50
  • The third of big data's Learning Series-detailed explanation of HBase Java Api Picture and text

    The third of big data's Learning Series-detailed explanation of HBase Java Api Picture and text

    Introduction: in the previous article, the second part of big data's learning series-HBase environment building (stand-alone), successfully built the Hadoop+HBase environment, this article is mainly about some operations on HBase using Java. First, prepare in advance. Confirm hado

    Shulou · 2022-06-03 06:50
  • Junit monomer test (PowerMockito) 1

    Junit monomer test (PowerMockito) 1

    I recently left my job, and at the end of the project one month before I left, I did a single test in the company. Starting from imitation, I accumulated something, recorded it, and reserved it for future needs. When I was doing it, I also wanted to study deeply in searches such as Google. There is an impression that the relevant books in China are relatively old, generally.

    Shulou · 2022-06-03 06:50
  • Analysis of Spark Accumulator commonly used in production (Custom Accumulator)

    Analysis of Spark Accumulator commonly used in production (Custom Accumulator)

    Ideas & requirements refer to the implementation ideas of IntAccumulatorParam (mentioned in the above article): trait AccumulatorParam [T] extends AccumulableParam [T, T]

    Shulou · 2022-06-03 06:50
  • Data Analysis of big data's Operation

    Data Analysis of big data's Operation

    The process of data analysis includes: data modeling, big data processing, alarm and trigger, report and so on. From the point of view of the real-time requirements of data processing, big data analysis can be divided into batch and streaming data processing methods. Batch processing is mainly suitable for analytical applications with low real-time requirements, while streaming processing is mainly suitable.

    Shulou · 2022-06-03 06:50
  • Basic concepts of software testing

    Basic concepts of software testing

    1. What is software testing: software testing is the process of proving that there are no errors in the software (the process of running or testing a system by manual or automatic means) 2. The difference between testing and debugging: 1) the purpose is different: the task of testing is to find defects in the program, and the task of debugging is to locate and solve the program.

    Shulou · 2022-06-03 06:50
  • At least the abilities that new R & D personnel should have

    At least the abilities that new R & D personnel should have

    In the middle of the year, I wrote the following summary, put it in this memo, and provide it for reference to those who are interested. The list below is just what I have just finished the project. If you don't agree, please feel free to modify it to suit yourself. Although in the previous project, the company's R & D personnel have been able to compare with other company personnel.

    Shulou · 2022-06-03 06:50
  • Brief introduction and characteristics of zookeeper, the Core component of hadoop

    Brief introduction and characteristics of zookeeper, the Core component of hadoop

    Zookeeper is a reliable coordination system for large distributed systems. 1) it provides functions such as configuration maintenance, name service, distributed synchronization, group service, etc. 2) its goal is to encapsulate complex and error-prone key services, making easy-to-use interfaces, efficient performance and stable functions.

    Shulou · 2022-06-03 06:50
  • APP special project-flow &  electricity &  GPU

    APP special project-flow & electricity & GPU

    Why do you want to test the traffic Android does not have a unified message push pipeline for management? app regularly starts the background process to ask the server if there is a message. If so, pull to the client scene operation app and do not operate app when the tool DDMS selects package name on the left side and Network on the right side.

    Shulou · 2022-06-03 06:49
  • What is the real value of big data? Have you get arrived yet?

    What is the real value of big data? Have you get arrived yet?

    The word "information explosion" must not have much novelty for everyone, but big data, caused by the information explosion, has increasingly become the darling of enterprises, and more and more enterprises have gradually realized the importance of big data. But most enterprises often only look at the surface, blindly follow the trend, and collect a lot of data.

    Shulou · 2022-06-03 06:49
  • Elasticsearch uses that.

    Elasticsearch uses that.

    LZO table creation: create table lzoer (id int,name string, ip string) ROW FORMAT DELIMITEDFIELDS TERMINATED BY','

    Shulou · 2022-06-03 06:49
  • Install the software required for the development environment

    Install the software required for the development environment

    1. Register Yahoo ID and notify relevant personnel to add yahoo id2, check whether you can access Saleforece,Buzila (Fiona), SVN (Afra) QA Center, internal mailbox 3, Yahoo I

    Shulou · 2022-06-03 06:49
  • Hive-exec-*/.jar

    Hive-exec-*/.jar

    Launch hive error report: Missing Hive Execution Jar: / home/hadoop/local/hbase-2.1.0/lib/hive-exec-*.jar related jar package download link htt

    Shulou · 2022-06-03 06:49
  • My understanding of the software industry and big data

    My understanding of the software industry and big data

    The understanding of the software industry can make an overall summary of the software industry in terms of requirements, architecture, tools and algorithms. Requirements are the driving force to promote the development of the software industry, and the changes in requirements have brought about the progress of architecture, tools and algorithms. At the level of architecture, it mainly involves an idea and strategy to solve the problem.

    Shulou · 2022-06-03 06:49
  • File upload based on HTML5

    File upload based on HTML5

    Recently, I deployed an web online picture upload application on my three-Fengyun-free-fee-host machine, using several front-end upload components, which are not ideal. In view of the fact that browsers that support HTML5 have become the mainstream, we decisively abandon IE6 as an old antique and use HTML5.

    Shulou · 2022-06-03 06:49
  • Lintcode12 Min Stack solution problem solution

    Lintcode12 Min Stack solution problem solution

    Implement a stack with min () function, which will return the smallest number in the stack.It sh

    Shulou · 2022-06-03 06:49