Enable jinad-aws to create multiple JinaD instances (pods) in one vpc

Question

Enable jinad-aws to create multiple JinaD instances (pods) in one vpc

alanthssss opened this issue 3 years ago · comments

Zhisheng Alan Niu commented 3 years ago

jina-ai/jina#2082
https://github.com/jina-ai/jina-terraform/issues/8

Zhisheng Alan Niu · Answer 1 · Thu Apr 08 2021 16:34:38 GMT+0800 (China Standard Time)

provided by @deepankarm

To test successful installation of JinaD, please go to http://18.208.71.169:8000/status (change to the new IP). No need to test it with jina flow. We can actually add a validation in terraform if JinaD is accessible from public.
All instances created in one go can use a single pem file.

Zhisheng Alan Niu · Answer 2 · Thu Apr 08 2021 16:50:11 GMT+0800 (China Standard Time)

provided by @deepankarm

enable pip install of packages before starting JinaD.

Changes should be done with the systemd script before we install jina
The script should accept parameters as bash deb-systemd.sh tensorflow==2.0 torch==1.0.1
The list of pip-install args should be accepted in the same map as instances in variables.tf (currently it accepts instance type only, please extend that to allow a list of pip packages).

Zhisheng Alan Niu · Answer 3 · Thu Apr 08 2021 16:56:01 GMT+0800 (China Standard Time)

provided by @deepankarm

Once this is done & tested, please raise a PR in terraform-jina-jinad-aws repo & we'll publish a new release. After this, we can get started on actual stress-tests. Here are a few links to go through for the last test run.