Assembling and compiling a custom crawler plug-in
After you write the source code for your crawler plug-in, you must assemble and compile it.
IBM Cloud Pak for Data IBM Software Hub
This information applies only to installed deployments.
Prerequisites
You must have the following items to compile a crawler plug-in:
- Java SE Development Kit 1.8 or higher
- Gradle
- cURL
- sed (stream editor)
- Crawler plug-in SDK package, see Obtaining the crawler plug-in SDK package
Assembling and compiling the crawler plug-in
- Specify the class name of the crawler plug-in by opening the
plugin/config/template.xmlfile and modifying theinitial-valueof thecrawler_plugin_classelement. - Ensure that you are in the crawler plug-in SDK directory on your development server.
- Enter
gradle packageCrawlerPluginto use Gradle to compile your Java source code and to create a compressed file that includes all of the required components for the crawler plug-in. - Confirm that you have access to the crawler plug-in package, which is in the
build/distributions/wd-crawler-plugin-sample.zipfile.