duydvu / Scalable-VnCoreNLP

Easily increase the capacity of the VnCoreNLP service to handle huge dataset.

Scalable VnCoreNLP

Easily increase the capacity of the VnCoreNLP service to handle huge dataset.

Only support for word segmenter.

Requirements

• Docker.
• Docker Compose.
• Python with vncorenlp preinstalled.

Get Started

1. Clone this repository.

git clone https://github.com/duydvu/Scalable-VnCoreNLP.git
cd Scalable-VnCoreNLP

2. Build the Docker image:

docker-compose build

3. Start the service with 4 instance:

docker-compose up --scale vncorenlp=4

4. Connect to the service:

from vncorenlp import VnCoreNLP

wordsegmenter = VnCoreNLP('http://localhost', 8000)
wordsegmenter.tokenize('hôm nay tôi đi học')