dspider | 一款基于django的以beryllium为引擎的爬虫管理系统

by mannuan Python Version: Current License: Apache-2.0

X-Ray Key Features Code Snippets Community Discussions Vulnerabilities Install Support

kandi X-RAY | dspider Summary

dspider is a Python library. dspider has no bugs, it has no vulnerabilities, it has build file available, it has a Permissive License and it has low support. You can download it from GitHub.

dspider

Support

Quality

Security

License

Reuse

Support

dspider has a low active ecosystem.

It has 10 star(s) with 1 fork(s). There are 1 watchers for this library.

It had no major release in the last 6 months.

dspider has no issues reported. There are no pull requests.

It has a neutral sentiment in the developer community.

The latest version of dspider is current.

Quality

dspider has no bugs reported.

Security

dspider has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

License

dspider is licensed under the Apache-2.0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

dspider releases are not available. You will need to build from source code and install.

Build file is available. You can build the component from source.

Installation instructions, examples and code snippets are available.

Top functions reviewed by kandi - BETA

kandi has reviewed dspider and discovered the below as its top functions. This is intended to give you an instant insight into dspider implemented functionality, and help decide if they suit your requirements.

get data_list from a page
get shop ticket
Return a list of the shop results .
Returns a list of comments .
Get recommendations for a given query .
Parse hotel intro section .
save data to db
get new comment data by CSS selector
get shop info
get shop menu

Get all kandi verified functions for this library.

dspider Key Features

No Key Features are available at this moment for dspider.

dspider Examples and Code Snippets

No Code Snippets are available at this moment for dspider.

Community Discussions

No Community Discussions are available at this moment for dspider.Refer to stack overflow page for discussions.

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install dspider

run command python manage.py runserver 0.0.0.0:8000, visit [http://localhost:8000/spider/](http://localhost:8000/spider/).
pip install -r requirements.txt
python manage.py migrate(用户名默认是root,密码默认是12345678)
sudo apt-get install tsocks(这个工具是为了ip代理使用的)
dspider/spider/driver/travel/core/traveldriver.py这个文件里面的host、port根据需要修改
run command python manage.py runserver 0.0.0.0:8000, visit [http://localhost:8000/spider/](http://localhost:8000/spider/)

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: