If you put your scraper into a Docker container, you can launch multiple, parallel instances using Docker swarms. As your individual swarm nodes get locked out, you can kill it and add another instance.
--
Tech junkie, entrepreneur dreamer, practical engineer
Love podcasts or audiobooks? Learn on the go with our new app.