kaushalshetty / mongo-elasticsearch-connector

MongoDB Elasticsearch Connector

mongo-elasticsearch-connector

This repository connects mongodb with elasticsearch. It inserts multiples csv files from local directory to mongodb collections first, then it indexes all these collections to elasticsearch. A template of elasticsearch settings currently exists in config.json but changes can be made to it.

USAGE:

python mongo_elastic_connector.py

Changes in config.json

• fs_src is the source location of the csv files
• result_keys are the column names that needs to be indexed into elasticsearch.
• Change the name of the column on which elasticsearch settings must be applied. Currently passage_text is the mapping on which elasticsearch settings is applied. Change it to the column of interest.

NOTE:

Elasticsearch and mongo server must be up!!