Set up cloud-based API server

Question

Set up cloud-based API server

ProfJanetDavis opened this issue 4 years ago · comments

@j6k4m8 has a plan for this! We need a stable, public backend server to deploy the web interface.

This is a project!

We tentatively plan to deploy the software as-is to a VM on AWS, deferring the transition to spacy and AWS Lambda for later issues.

Plan (16 points):

Make an AWS account for GLAM-lab and share info with the team (@ProfJanetDavis)
Find/do a tutorial on AWS VM-based server deployment (2 dev * 2 points = 4 points)
Install the repo on AWS (@j6k4m8 + 2 dev * 1 point = 2 points)
Get Gunicorn running on AWS (@j6k4m8 + 2 dev * 2 point = 4 points)
Install and integrate nginx (@j6k4m8 + 2 dev * 1 points = 2 points)
Create new repo for configuration files and instructions (@j6k4m8 + 2 dev * 2 points = 4 points)
PR (0 points)

Jordan Matelsky · Answer 1 · Sat Jul 04 2020 07:45:29 GMT+0800 (China Standard Time)

I'm trying to brain-dump here. I'll update/clarify text once I have the first few steps in motion! Happy to do these debug sessions on video-call if anyone is interested in listening in :)

Janet Davis · Answer 2 · Mon Jul 06 2020 08:19:06 GMT+0800 (China Standard Time)

Awesome, thanks for moving this along! My schedule is pretty full next week, but I bet some of my students will be interested.

Jordan Matelsky · Answer 3 · Tue Jul 14 2020 02:22:27 GMT+0800 (China Standard Time)

It is now possible to mount a shared filesystem in a Lambda runtime, which makes this WAY more approachable (and perhaps obviates the need to remove nltk, though i still think we ought to pick one NLP lib and stick with it...)

More docs on lambda limits here.

Janet Davis · Answer 4 · Tue Jul 21 2020 01:56:43 GMT+0800 (China Standard Time)

Initial plan for planning:
We are currently in the research & planning phase: 8 points total

Meet with Jordan (2 dev * 1 point = 2 points)
Create an issue for replacing nltkwith spacy(0 points)
Determine which code modules use nltk - maybe use grep? (2 dev * 1 points = 2 points)
Read an introduction to spacy and/or do a simple tutorial (2 dev * 2 points = 4 points)

Nidhi · Answer 5 · Wed Jul 22 2020 05:17:40 GMT+0800 (China Standard Time)

@ProfJanetDavis I am unable to check this boxes, but so far we have an AWS account, and have installed gunicorn and nginx.

Janet Davis · Answer 6 · Wed Jul 22 2020 06:42:16 GMT+0800 (China Standard Time)

Thanks for the update, @nidhi2509! I adjusted our team's permissions on this repository. Can you check the boxes now?

Janet Davis · Answer 7 · Tue Jul 28 2020 01:17:23 GMT+0800 (China Standard Time)

@nidhi2509 thinks this is done and I agree! The test will be in completing the implementation of gender-bias-web#13.