mongo kafka stormdeployer

  • By tengu-bot
  • Latest version (#0)
  • trusty
  • Stable

Description

mongo-kafka-stormdeployer

Overview

The mongo-kafka-stormdeployer provides a method to deploy a storm topology whenever it detect relations to MongoDB, Zookeeper and Kafka. When a relation breaks the topology will be undeployed.

Usage

The storm topology to deploy has to be located in /tmp on the machine wich hosts the stormmaster.
An example of an environment:

juju deploy zookeeper
juju deploy storm stormmaster
juju deploy storm stormworker
juju deploy mongo-kafka-stormdeployer deployer
juju deploy mongodb
juju deploy apache-kafka kafka

juju action do kafka/0 create-topic topic=test partitions=1 replication=1
juju action fetch <id>

juju add-relation zookeeper stormmaster
juju add-relation zookeeper stormworker
juju add-relation zookeeper kafka
juju add-relation stormmaster:master stormworker:worker
juju add-relation deployer stormmaster
juju add-relation deployer mongodb
juju add-relation deployer zookeeper
juju add-relation deployer kafka

Known Issues

Currently only one topology will be deployed.
Storm does not support multiple versions of the same topology with the same name so assure that each time the name of the topology is different. You can use a version number for instance. The deployer will not deploy the topology if it is already deployed.

Contact Information

Bugs

Report bugs on Github.

Authors

This software was created in the IBCN research group of Ghent University in Belgium. This software is used in Tengu, a project that aims to make experimenting with data frameworks and tools as easy as possible.