FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

x-cold/task-queue-sample: Node.js 生产者/消费者 模式简单实践 - 多进程爬虫任务队列 · GitHub

/ task-queue-sample Public
BranchesTags

Latest commit

 

History

6 Commits

Folders and files

NameName
Last commit message
Last commit date
cache
cache
 
 
customer
customer
 
 
producer
producer
 
 
.gitignore
.gitignore
 
 
README.md
README.md
 
 
collector.js
collector.js
 
 
filter.js
filter.js
 
 
package.json
package.json
 
 

Repository files navigation

学习目的

  • 了解和使用生产者/消费者模式

  • 了解任务调度

  • 掌握基本的分布式架构及通讯

  • 掌握Node.js多进程工作机制

概念须知

参考文章：http://blog.csdn.net/kaiwii/article/details/6758942

生产者/消费者 爬虫

  • 启动缓存队列
> cd cache
> npm install
> npm run koa
  • 启动生产者进程
> npm install
> node ./producer/cluster.js [进程数量]
  • 启动消费者进程
> npm install
> node ./customer/cluster.js [进程数量]

About

Node.js 生产者/消费者 模式简单实践 - 多进程爬虫任务队列

Resources

Readme
Activity

Stars

13 stars

Watchers

1 watching

Forks

3 forks
Report repository

Releases

Packages

Used by

Contributors

Languages

Back | FazBrowse Home | New Git URL