Get the App
SLTechnology News&Howtos  ›  Servers  › 

How to realize the concurrency of Storm Topology

Shulou Source: shulou.com Published: 2022-05-31 17:16:59 09月21日 Update

This article mainly explains the "Storm topology concurrency degree how to achieve", the article explains the content is simple and clear, easy to learn and understand, the following please follow the editor's ideas slowly in depth, together to study and learn "Storm topology concurrency degree how to achieve" it!

1 Storm distinguishes the topologies that run for a century in a Storm cluster according to the following three main parts:

1: worker

2:Executor (Thread)

3:tasks

The following figure simply illustrates their relationship. Okay, this is a repeatedly published structure diagram:

For the above, a Task, that is:

An Executor is a thread generated by a worker process that may be running one of the same components Spout and bolt or

Multiple task

A task performs actual data processing, and each spout or bolt you implement in code is equivalent to many task distributed throughout the cluster.

In the life cycle of 1 topology, the number of task of 1 component is always the same, but the number of executor (threads) of 1 component can be changed over time.

Change from time to time. This means that the following conditions are always true: the number of thread

Tags: Quantity configuration topology threads components runs code processes intermediate metrics clusters facets learning figure above two that is content situation data terminology Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno Redmi Docker Apple Shulou Technology Linux