ckanext-harvest | Remote harvesting extension for CKAN
kandi X-RAY | ckanext-harvest Summary
kandi X-RAY | ckanext-harvest Summary
Remote harvesting extension for CKAN
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Clear harvest source
- Clear harvest source index
- Get a single value from the model
- Update harvest source
- Abort a harvest job
- Harvest harvest jobs
- Return a dictionary of harvest information
- Imports harvest objects
- Check if user is sysadmin
- Run harvest
- Harvest notifications
- Get the list of available packages
- Create harvest source
- Harvest harvest logs
- Preview an object
- Validate harvest source URL
- Import a staging
- Update the configuration
- Report a harvest job
- Validate harvest source data
- Show status of harvest source
- Validate the configuration
- Clear harvest source history
- Execute harvest
- Abort aborted jobs
- Create harvest tables
ckanext-harvest Key Features
ckanext-harvest Examples and Code Snippets
Community Discussions
Trending Discussions on ckanext-harvest
QUESTION
I read this documen to create a harvester. https://github.com/ckan/ckanext-harvest.I can reach http://localhost/harvest.After that, I created a harvest source.But what will I do right now?What I want to do is to collect some datasets from another ckan instances.Do i have to implement harvesting interface
...ANSWER
Answered 2018-Aug-07 at 12:21To harvest from another CKAN instance you can use the ckan_harvester
plugin provided with ckanext-harvest. You only need to implement the IHarvester
interface if you want to harvest from a different data source for which a harvester isn't available (for example a proprietary database format).
To enable the ckan_harvester
plugin, add it to the list of plugins
in your CKAN INI file and restart CKAN. You then need to create and configure a new harvester in the CKAN web UI at http://your-ckan-instance/harvest. Finally, make sure to actually run the configured harvesters using the command line tools (or cron).
Refer to the documentation for details.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install ckanext-harvest
You can use ckanext-harvest like any standard Python library. You will need to make sure that you have a development environment consisting of a Python distribution including header files, a compiler, pip, and git installed. Make sure that your pip, setuptools, and wheel are up to date. When using pip it is generally recommended to install packages in a virtual environment to avoid changes to the system.
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page