AI, KAFKA, Big-Data Data-Engineering and Distributions
Features
- Kafka
- Kafka sending data using REST API
- Kafka Consumer and Producer
- Data Cleaning
- Data Virtualization
- Machine Learing
- Simple AI project
Steps to run in your machine for Kafka
Kafka Quick Start : https://kafka.apache.org/quickstart
clone the repo
Run as following to Start the Kafka
Go to your Kafka dir
\bin\windows\zookeeper-server-start.bat .\config\zookeeper.properties
\bin\windows\kafka-server-start.bat .\config\server.properties
Run the project
Open the project in any Ide, then run as spring boot appication
Try Chnage your Tpoic name as you wish. Here we used "alanbinu"
Try the following in any API builder
http://localhost:8081/api/v1/message
Body
{
"message":"It works. Thanks Alan"
}
To see the Data from Kafka, follow the below steps
Go to the Kafka Dir, then the run the following command
bin\windows\kafka-console-consumer.sh --topic <ENTER_YOUR_TOPIC_NAME> --from-beginning --bootstrap-server localhost:<KAFKA_LOCALHOST_PORT>
Steps to run in your machine for Data Virtulization, Machine Learing or Data Cleaning
clone the repo
Follow the steps
Install Jupyter Notebook : https://jupyter.org/install Open Jupyter Notebook and the open the file you need to run and then Click on the "Run from Start"