Question

With crawler written by scrapy+redis+mongodb, the crawled data can be stored in mongodb and exported to excel format?

Answer 1

Of course you can.

scrapyYou can specify the format of the saved data by yourself, which is supported by default.json，xml，csvSuch as three formats.

scrapy crawl projectname -o items.csv

Then you can put thiscsvFile conversionexcelFormat.

This conversion is very simple.

Of course, you can search,mongodbDid you export data as followsexcelThe method of.