linuxluigi / meetup-data-scraper

Scrape groups & events from Meetup Rest API to enable a fulltext search

Meetup Data Scraper

Dowload group & events from Meetup-API into a database to make a fulltext search on every event.

Settings

Moved to settings.

Basic Commands

Setting Up Your Users

• To create an superuser account, use this command:

  $ docker-compose -f local.yml run django python manage.py createsuperuser

Type checks

Running type checks with mypy:

$ docker-compose -f local.yml run django coverage run -m mypy meetup_data_scraper

Test coverage

To run the tests, check your test coverage, and generate an HTML coverage report:

$ docker-compose -f local.yml run django coverage run -m pytest
$ docker-compose -f local.yml run django coverage run -m coverage html
$ open htmlcov/index.html

Running tests with py.test

$ docker-compose -f local.yml run django coverage run -m pytest

Sentry

Sentry is an error logging aggregator service. You can sign up for a free account at https://sentry.io/signup/?code=cookiecutter or download and host it yourself. The system is setup with reasonable defaults, including 404 logging and integration with the WSGI application.

You must set the DSN url in production.

Deployment

The following details how to deploy this application.

Heroku

See detailed cookiecutter-django Heroku documentation.

Docker

See detailed cookiecutter-django Docker documentation.