Spiculecharms Sparkler
- By Spicule Charms
Channel | Revision | Published | Runs on |
---|---|---|---|
latest/stable | 10 | 19 Mar 2021 |
juju deploy spiculecharms-sparkler
Deploy universal operators easily with Juju, the Universal Operator Lifecycle Manager.
Platform:
-
addseedurls
Add seed urls to sparkler
- Params
-
urls string
Comma separated list of urls
-
crawl
Crawl the urls
- Params
-
crawldb-uri string
Crawldb uri
-
iterations string
Number of iterations to run
-
jobid string
Job id. When not sure, get the job id from injector command
-
output string
Output path
-
sparkmaster string
Spark Master URI. Not required if relation to spark is set.
-
topgroups string
Max Groups to be selected for fetch
-
topn string
Top urls per domain to be selected for a round.
-
inject
Inject seed urls
- Params
-
crawldb-uri string
Crawldb uri
-
jobid string
Id of an existing Job to which the urls are to be injected. No argument will create a new job.
-
removeallseedurls
Remove all seed urls from Sparkler
-
removeseedurls
Remove seed urls
- Params
-
urls string
Comma separated list of urls to remove