PSF GSoC students blogs: Check-in for week 8

1. What did you do this week?

Last week I was splitting the pull request into two parts: One part that goes into the Scrapy core, and one part that goes into a new library scrapy-external-queues. I also refactored the payload generation code in scrapy-bench to not duplicate code and use random payloads instead of fixed ones.

2. What is coming up next?

The new project scrapy-external-queues needs a bit of cleanup. It also lacks tooling like flake8, tox or Travis. Additionally, I want to add support for RabbitMQ as a second message queue backend.

3. Did you get stuck anywhere?

No.Create

from Planet Python
via read more