Set up cloud-based API server
ProfJanetDavis opened this issue · comments
@j6k4m8 has a plan for this! We need a stable, public backend server to deploy the web interface.
This is a project!
We tentatively plan to deploy the software as-is to a VM on AWS, deferring the transition to spacy
and AWS Lambda for later issues.
Plan (16 points):
- Make an AWS account for GLAM-lab and share info with the team (@ProfJanetDavis)
- Find/do a tutorial on AWS VM-based server deployment (2 dev * 2 points = 4 points)
- Install the repo on AWS (@j6k4m8 + 2 dev * 1 point = 2 points)
- Get Gunicorn running on AWS (@j6k4m8 + 2 dev * 2 point = 4 points)
- Install and integrate nginx (@j6k4m8 + 2 dev * 1 points = 2 points)
- Create new repo for configuration files and instructions (@j6k4m8 + 2 dev * 2 points = 4 points)
- PR (0 points)
I'm trying to brain-dump here. I'll update/clarify text once I have the first few steps in motion! Happy to do these debug sessions on video-call if anyone is interested in listening in :)
Awesome, thanks for moving this along! My schedule is pretty full next week, but I bet some of my students will be interested.
It is now possible to mount a shared filesystem in a Lambda runtime, which makes this WAY more approachable (and perhaps obviates the need to remove nltk, though i still think we ought to pick one NLP lib and stick with it...)
More docs on lambda limits here.
Initial plan for planning:
We are currently in the research & planning phase: 8 points total
- Meet with Jordan (2 dev * 1 point = 2 points)
- Create an issue for replacing
nltk
withspacy
(0 points) - Determine which code modules use
nltk
- maybe usegrep
? (2 dev * 1 points = 2 points) - Read an introduction to
spacy
and/or do a simple tutorial (2 dev * 2 points = 4 points)
@ProfJanetDavis I am unable to check this boxes, but so far we have an AWS account, and have installed gunicorn and nginx.
Thanks for the update, @nidhi2509! I adjusted our team's permissions on this repository. Can you check the boxes now?
@nidhi2509 thinks this is done and I agree! The test will be in completing the implementation of gender-bias-web#13.