RecylerView’s basic usage

2023-01-25   ES  

1, problem

Due to reptile error/production environment replacement, etc., the timing SCRAPY mission queue is waiting too much

(passhttp://127.0.0.1:6800/listjobs.json?project=myprojectQuery of PENDING’s reptile queue, there are 600+….)

2. Solution

Enter the user directory-> DBS directory, delete the scrapy project db file of Pending

Because of the project data (including crawling mission queue) in the DBS directory

as shown below (the scrapy project is mytoken, delete mytoken.db here)

Note: View official documentation of scrapyd (https://scrapyd.readthedocs.io/en/stable/config.html), we can find:

dbs_dir: The directory where the project databases will be stored (this includes the spider queues).

A sample configuration file with all default values is as follows, and the default is in the user directory

Reference document:https://scrapyd.readthedocs.io/en/stable/config.html

 ————- END ————

source

Related Posts

WeChat confession mysterious code! Quickly send it to TA!

HTML+CSS+jquery beautiful vertical timeline

Asterisk call process

k8s — Question follow -up

RecylerView’s basic usage

Random Posts

Python Draw a function curve and set the intersection of the XY shaft at the position of the original point of the coordinate origin

Flower Static HTML Webpage Work College Student Flowers Web Design Production Products Simple DIV CSS Layout Website Q

Android ReycleView to achieve anti -QQ left sliding deletion

Various games puppet

Huffman Tree && Huffman Code (Affordable Source Code)