1. What did you do this week?
Last week I was reworking the error handling once again. I moved the self-check from the general queue class to the Redis class and changed it to a simple Redis ping command. I also checked the code coverage w.r.t. tests and made requests with big payloads (e.g. fat cookies).
2. What is coming up next?
The next step is to extract Redis into its own scrapy library. This library should be an official addon to scrapy and eventually not only contain support for Redis but also for other message queues.
3. Did you get stuck anywhere?
No.
from Planet Python
via read more
No comments:
Post a Comment