hoat23 / ETL-and-Data-Processing-Python-Elasticsearch

ETL and process data using Python

Extraction Tranformation Load Using Python

ETL using Python

Encoding types

• ISO-8859-1

GEO IP LOCATION

GeoLite2 data created by MaxMind

https://dev.maxmind.com/geoip/geoip2/geolite2/ https://github.com/maxmind/GeoIP2-python

Elasticsearch Export: Using Elasticsearch Dump

npm install elasticdump

Documentation

• https://github.com/elasticsearch-dump/elasticsearch-dump

More Info

• https://eland.readthedocs.io/en/7.10.0b1/examples/introduction_to_eland_webinar.html
• https://towardsdatascience.com/exporting-pandas-data-to-elasticsearch-724aa4dd8f62