pip install Scrapy
scrapy startproject <project_name>
scrapy genspider <spider_name> <host_name>
pip install -r requirements.txt
scrapy crawl <spider_name>
- 打开settings.py文件在ITEM_PIPELINES选项下加入peline并赋值，0-1000，数字越小越优先
makai554892700/ScrapyDemo
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Latest commit | ||||