Data pipeline with flume
A centralized log event management solution. to archive logs from java/nonJava platforms. and implemnt search and analytics on the log data.
Will be using foloowing components for logging
- Flume (1.4) https://flume.apache.org/
- Rsyslog http://www.rsyslog.com/
- Log4J Syslog Appender https://logging.apache.org/log4j/1.2/apidocs/org/apache/log4j/net/SyslogAppender.html