Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

Big data from 0 Foundation to Project practice (CDH5+Spark2.3.x)

Shulou Source: shulou.com Published: 2022-06-02 19:17:01 11月13日 Update

Course download: https://pan.baidu.com/s/1gfb4vhowT4hGAVYb-bRVEg

Extraction code: jqff

This course is an employment course, with a complete actual combat project as the main line, each link of the project not only in-depth explanation of theoretical knowledge, but also combined with the project business practice, so as to achieve one-stop learning, so that you can quickly reach the level of employment.

Big data's common hot technology One lesson completed: linux, Shell programming, virtual machine, Hadoop (HDFS, MapReduce, Yarn, distributed cluster), Zookeeper, CDH5, Eclipseg and MapReduce integrated development, Eclipse configuration Maven management of multiple MapReduce, HBase distributed real-time database, Kafaka message cluster, Flume log collection, Flume and Kafaka integration, Flume and HBse integration, Flume HBaseSlink secondary development source deployment, Flume+HBase+Kafaka integrated development, Hive big data warehouse, Hive and HBase integration, Hue big data project visual analysis Spark2.x offline data calculation, Spark2.x real-time data analysis (Spark SQL, Spark Stream), visual data presentation (Eclipse+JDBC+Hive+Spark+MySQL+Echarts)

Full flow demonstration of Quanzhen enterprise project: big data production-> Collection-> Storage-> processing-> Computing-> Analysis (offline + real-time)-> extraction (offline + real-time)-> Java interface-> visual Web display.

Development environment:

CDH5 、 Spark2.3.x

Tags: Data project real-time development course analysis visualization distributed integrated development cluster employment actual combat hot business warehouse enterprise multiple large number common technology Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno OPPO Reno Docker Redmi Apple MySQL