Example Analysis of multiple source in flume

This article mainly shows you the "sample analysis of multiple source in flume", which is easy to understand and clear. I hope it can help you solve your doubts. Let the editor lead you to study and learn the article "sample analysis of multiple source in flume".

Agent1.channels=ch2

Agent1.sources=exec-source1 exec-source2

Agent1.sinks=hdfs-sink1

Agent1.channels.ch2.type=memory

Agent1.channels.ch2.capacity=1000

Agent1.channels.ch2.transactionCapacity=1000

Agent1.channels.ch2.keep-alive=30

Agent1.sources.exec-source1.type=exec

Agent1.sources.exec-source1.command=/usr/bin/vmstat 1

Agent1.sources.exec-source1.channels=ch2

Agent1.sources.exec-source1.threads=5

Agent1.sources.exec-source2.type=exec

Agent1.sources.exec-source2.command=tail-F / root/date.txt

Agent1.sources.exec-source2.channels=ch2

Agent1.sources.exec-source2.threads=5

Agent1.sinks.hdfs-sink1.channel=ch2

Agent1.sinks.hdfs-sink1.type=hdfs

Agent1.sinks.hdfs-sink1.hdfs.path=hdfs://slaver3:8020/root/

Agent1.sinks.hdfs-sink1.hdfs.writeFormat=Text

Agent1.sinks.hdfs-sink1.hdfs.fileType=DataStream

Agent1.sinks.hdfs-sink1.hdfs.rollInterval=2000

Agent1.sinks.hdfs-sink1.hdfs.rollSize=2000

Agent1.sinks.hdfs-sink1.hdfs.rollCount=20

Agent1.sinks.hdfs-sink1.hdfs.batchSize=1000

Agent1.sinks.hdfs-sink1.hdfs.txnEventMax=1000

Agent1.sinks.hdfs-sink1.hdfs.callTimeout=60000

Agent1.sinks.hdfs-sink1.hdfs.appendTimeout=60000

Agent1.sinks.hdfs-sink1.hdfs.filePrefix=%Y-%m-%d

Agent1.sinks.hdfs-sink1.hdfs.useLocalTimeStamp=true

The above is all the content of the article "sample Analysis of multiple source in flume". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!