datafellas notebook #1

  • By frbayart
  • Latest version (#1)
  • trusty
  • Stable
  • Edge

Description

Originally forked from the amazing scala-notebook,
almost entirely refactored for Massive Dataset Analysis using Apache Spark.

The tool allows performing reproducible analysis with Scala, Apache Spark and more.

This is achieved through an interactive web-based editor that can combine Scala code,
SQL queries, Markup or even JavaScript in a collaborative manner.

The Spark is available out of the box, and is simply accessed by the variable sparkContext.


Overview

This charm will deploy the DataFellas Notebook http://spark-notebook.io
The tool allows performing reproducible analysis with Scala, Apache Spark and Mesos.

Installation

To deploy this charm you will need at a minimum: a cloud environment,
working Juju installation and a successful bootstrap. Once bootstrapped,
deploy the Mesos(mesos-master & mesos-slave) charm and then this Notebook charm:
juju deploy mesos-master
juju deploy datafellas-notebook
Add a relation between the two of them:
juju add-relation mesos-master datafellas-notebook
And finally expose the Vanilla service:
juju expose datafellas-notebook
You can add more slaves nodes, example to add 3 slaves:
juju deploy mesos-slave -n 3
Add a relation between mesos-master and mesos-slave:
juju add-relation mesos-master mesos-slave

Configuration

port
(int) DataFellas listening port. (default: 9000)
9000