Deploy Scrapy Spider on the cloud
Budget: $10 – $30 USD
Hi there!
My name is Stefan and Im a Web developer / Jack-of-all-trades
I love coming up with new ideas for things but sometimes there just arnt enough hours in the day
This is where you come in :)
I've written a scrapy spider that works well on my local machine but now it needs to be deployed to the cloud.
Since there are an abundance of cloud service providers im open to your suggestion as to which one to use, though I've used AWS more. Options so far are: Zyte(Scrappinghub), AWS, GCP, Vultr.
A scheduler for the spider needs to be written, either as a cronjob or using some platform specific method.
It also needs to connect to a Database, again platform specific.
The spider will need to be re-deployed multiple times, so the deployment method needs to suit
Sound like your kind of gig? Id love to hear from you!
Thanks!
My name is Stefan and Im a Web developer / Jack-of-all-trades
I love coming up with new ideas for things but sometimes there just arnt enough hours in the day
This is where you come in :)
I've written a scrapy spider that works well on my local machine but now it needs to be deployed to the cloud.
Since there are an abundance of cloud service providers im open to your suggestion as to which one to use, though I've used AWS more. Options so far are: Zyte(Scrappinghub), AWS, GCP, Vultr.
A scheduler for the spider needs to be written, either as a cronjob or using some platform specific method.
It also needs to connect to a Database, again platform specific.
The spider will need to be re-deployed multiple times, so the deployment method needs to suit
Sound like your kind of gig? Id love to hear from you!
Thanks!