kapsali29 / analyzer

AnalEyeZer

AnalEyeZer is a component used in Qualichain H2020

Supported Data Sources

• RDBMS
  • PostgreSQL
• NoSQL
  • MongoDB
• Files
  • CSV
  • TSV

Setup ElasticSearch and Kibana

• cd config
• docker-compose up -d es01 kibana

Run AnalEyeZer locally

• pip install -r requirements.txt
• flask run

Run AnalEyEZer using Docker

In order to run AnalEyeZer using Docker you should run the following command

docker-compose up -d analeyzer --build

Run Analyezer Stack

In order to run all Analyezer Components at once you should run the following

docker-compose up -d --build

This command creates the following

• one ElasticSearch node is accessible in port 9200
• Kibana is accessible in port 5601
• AnalEyeZer is accessible in port 5000

Examples

Submit a new data source

POST /receive/source HTTP/1.1
Host: 127.0.0.1:5000
Content-Type: application/json

{
	"uri": "postgresql://admin:[e-mail]:5432/api_db",
	"type": "POSTGRES",
	"part": "job_post",
	"index": "my_index"
}

Submit Query to ElasticSearch

POST /ask/storage HTTP/1.1
Host: 127.0.0.1:5000
Content-Type: application/json

{
	"query":"bool_query",
	"index": "my_index",
	"min_score": 4,
	"_source": ["id"],
	"should": [
    {"multi_match": {
        "query": "backend engineer",
        "fields": ["title", "requirements"],
        "type": "phrase",
        "slop": 2}
    },
    {"multi_match": {
        "query": "backend developer",
        "fields": ["title", "requirements"],
        "type": "phrase",
        "slop": 2}
    }
]
}