Get the App
SLTechnology News&Howtos  ›  Development  › 

How to set kafka topic permission control

Shulou Source: shulou.com Published: 2022-06-02 10:09:44 10月02日 Update

This article introduces the relevant knowledge of "how to set kafka topic access control". In the operation of actual cases, many people will encounter such a dilemma, so let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

Kafka is an open source stream processing platform developed by the Apache Software Foundation and written by Scala and Java. Kafka is a high-throughput distributed publish and subscribe messaging system, which can handle all the action flow data of consumers in the website. This action (web browsing, search and other user actions) is a key factor in many social functions on the modern web. This data is usually resolved by processing logs and log aggregations due to throughput requirements. For log data and offline analysis systems like Hadoop, but requiring real-time processing limitations, this is a feasible solution. The purpose of Kafka is to unify online and offline message processing through Hadoop's parallel loading mechanism, as well as to provide real-time messages through clusters.

Let's take a look at the content of kafka topic permission control:

Kafka official website

Configuration

Set permissions

# View permissions. / kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181,test03:2181-- list# add permissions. / kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181,test03:2181-add-- allow-principal User:streaming-- allow-host 10.10.151.*-- producer-- topic carbon_file_test./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181 Test03:2181-add-- allow-principal User:streaming-- allow-host 10.10.151.*-producer-- topic eve_agg_file./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181,test03:2181-add-- allow-principal User:streaming-- allow-host 10.10.151.*-- producer-- topic flink_test_producer./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181 Test03:2181-add-- allow-principal User:streaming-- allow-host 10.10.151.*-consumer-- topic flink_test_producer./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181,test03:2181-add-- allow-principal User:streaming-- allow-host 10.10.151.*-- consumer-- group=*-- topic flink_test_producer./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181 Test03:2181-add-- allow-principal User:carbon-- allow-host 10.10.151.*-- consumer-- group=*-- topic carbon_file_test./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181,test03:2181-add-- allow-principal User:carbon-- allow-host 10.10.151.*-consumer-- group=*-- topic eve_agg_file

Delete permission

. / kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181,test03:2181-remove-- allow-principal User:streaming-- allow-host 10.10.151.*-- producer-- topic carbon_file_test-- force./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181 Test03:2181-remove-- allow-principal User:streaming-- allow-host 10.10.151.*-- producer-- topic eve_agg_file-- force./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181,test03:2181-remove-- allow-principal User:streaming-- allow-host 10.10.151.*-producer-- topic flink_test_producer-- force./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181 Test03:2181-remove-- allow-principal User:streaming-- allow-host 10.10.151.*-- consumer-- topic flink_test_producer-- force./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181,test03:2181-remove-- allow-principal User:streaming-- allow-host 10.10.151.*-consumer-- group=*-- topic flink_test_producer-- force./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181 Test03:2181-remove-- allow-principal User:carbon-- allow-host 10.10.151.*-consumer-- group=*-- topic carbon_file_test-- force./kafka-acls.sh-- authorizer-properties zookeeper.connect=test01:2181,test02:2181,test03:2181-remove-- allow-principal User:carbon-- allow-host 10.10.151.*-consumer-- group=*-- topic eve_agg_file-- force

Command parameter

This is the end of the content of "how to set kafka topic access Control". Thank you for reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Tags: Permissions processing control content data logs messages actions throughput real-time more knowledge systems websites throughput feasible practical successful learning next key Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno MariaDB MySQL macOS Xiaomi Redmi