What does Apache Atlas mean?

This article mainly introduces what Apache Atlas means. It is very detailed and has certain reference value. Friends who are interested must finish reading it.

Apache Atlas is an open source project produced by the Hadoop community to solve the problem of metadata governance in the Hadoop ecosystem. It provides Hadoop clusters with core capabilities for metadata governance, including data classification, centralized policy engine, data consanguinity, security and lifecycle management.

Apache Atlas is the incubation project of the Apache Foundation and is the data governance and metadata framework (Data Governance and Metadata framework) of the Hadoop ecosystem. Atlas is a set of core basic governance services, which has good scalability and scalability, can meet the diversity needs of enterprises for Hadoop ecosystem, and can integrate with enterprise data ecosystem.

The architecture of Apache Atlas is shown in the following figure:

Core characteristics

Apache Atlas provides the following features for metadata governance of Hadoop:

1. Data classification

● imports or defines business-oriented classification annotations for metadata

● definitions, annotations, and automatic capture of relationships between datasets and underlying elements

● exports metadata to third-party systems

2. Centralized audit

● captures secure access information with all applications, processes, and interactions with data

● captures information about actions, steps, activities, etc.

3. Search and consanguinity

● predefined navigation paths are used to explore data classification and audit information

● uses text-based search features to quickly and accurately locate associated data and audit events

● 's visual browsing of the consanguinity of datasets allows users to drill down to information related to operation, security, and data origin.

4. Security and Policy engine

● runtime compliance policies based on data classification patterns, attributes, and roles

● 's advanced policy definition based on classification-prediction to prevent data derivation

● masking at the row / column level based on cell attributes and values

The above is what Apache Atlas means all the content, thank you for reading! Hope to share the content to help you, more related knowledge, welcome to follow the industry information channel!