CplNathan/CrawlerTakeHomeTask: A take home task for demonstrating high concurrent, scalable, and thread safe web crawling. Configurable to be distributed using docker-compose orchestration and distributed messaging queues and caches. · GitHub
A take home task for demonstrating high concurrent, scalable, and thread safe web crawling. Configurable to be distributed using docker-compose orchestration and distributed messaging queues and caches.