Module dependencies
william-p opened this issue · comments
Hi,
i tried Leselys from git
with pip
and i'm surprised by all dependencies:
Successfully installed docopt flask feedparser lxml itsdangerous py-bcrypt requests celery celery-with-mongodb leselys Werkzeug Jinja2 billiard python-dateutil kombu pymongo anyjson amqp
celery
, celery-with-mongodb
, amqp
, kombu
it's normal ?
Thanks :)
Yes, leselys works with celery for it's refresher and retention tasks.
Refresher will fetch new stories when you don't use leselys to avoid missing stories.
And retention task, just trash old stories.
All these tasks are done asynchronously by celery scheduled jobs.
That's why 😄
Okey Great :)
IMHO it's overkill, what do you think about gevent/greenlet
or multiprocessing
for that ?
I don't think celery
is overkill, it has been done exactly for that (django for example).
When I wrote it, i had in mind to split web app and worker but why not merge them.
I'll think about it 👍
Ok thanks, have a nice day.