Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

Why not use mysql,redis in the Construction of stand-alone airflow

Shulou Source: shulou.com Published: 2022-06-02 02:34:47 10月03日 Update

This article shows you why you don't use mysql,redis in airflow stand-alone build, the content is concise and easy to understand, absolutely can make you shine, through the detailed introduction of this article I hope you can gain something.

[toc]

Airflow Standalone Build Record Environment Preparation

Python(pip)--airflow written in python

Installation of airflow

pip install apache-airflow

environment variable configuration

I am executing under root user, so I can choose it myself.

export AIRFLOW_HOME=~/airflow

Execute the airflow command

airflow

To generate the configuration file airflow.cfg under AIRFLOW_HOME

modify the configuration file

default_timezone = Asia/Shanghai

load_examples = False

base_url = http://etl1:9999

web_server_port = 9999

initialize the database

airflow initdb

modified the time zone

https://blog.csdn.net/crazy__hope/article/details/83688986

start

airflow webserver -p 9999 -D

airflow scheduler -D

additional program

Simple dag template configurator developed by third party

environment

Python3 https://www.cnblogs.com/Hunry/p/9350607.html requires additional installation

Java environment

The above content is why you don't use mysql,redis in airflow stand-alone build, have you learned knowledge or skills? If you want to learn more skills or enrich your knowledge reserves, please pay attention to the industry information channel.

Tags: Environment configuration stand-alone content skills files knowledge programs concise crude concise variables commands that is data databases articles time zones are in Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno Xiaomi Linux Redmi Shulou Technology MySQL