Description

Installs the logstash agent. useless without logstash indexer.
outputs to logstash-indexer using redis.

Tags:
misc ›

logstash-indexer-juju-charm

Juju Charm for logstash agent.

will download the logastash monolithic.jar every time unless you have a copy in files/charm/

common.sh provides a bunch of config stuff bits ... useful to customize locations etc.

Inputs
: File - /var/log/syslog and some others
Outputs
: Redis - configured to use redis as a message bus to logstash server

needs to join relationship with logstash-indexer to do anything useful, although it will output to a text file without for testing/debug purposes.

will search for known local log files and add logstash inputs for them. This means if you add it to an apache server it will find the /var/log/apache2 directory and start sucking down logs from that dir.

Configuration:

mid-flight configurable variables found in config.yaml. modify Reload to get it to rescan server for known log files. Add custom log inputs, Add twitter keyword input.

pre-flight configuration variables found in hooks/common.sh ... don't change these unless you know what you're doing.

Examples:

see logstash-indexer charm's README.md file for usage examples showing the full charm stack.

secure Kibana with auth-proxy and log it's apache configs

strong example delivers basic logstash-indexer stack also

# deploy Kibana Charm
juju deploy kibana
# deploy Auth-Proxy subordinate charm to kibana
juju deploy --repository=examples local:precise/auth-proxy
juju add-relation auth-proxy kibana
juju set auth-proxy ServerAdmin="kibana@example.com" ServerName="kibana.example.com" DestinationURL="http://127.0.0.1:5601/"
# deploy logstash-indexer and connect Kibana to it.
juju deploy logstash-indexer
juju add-relation kibana logstash-indexer:rest
# deploy Logstash-Indexer subordinate charm to kibana and connect it to Logstash-Indexer
juju deploy --repository=logstash local:precise/logstash-agent
juju add-relation logstash-agent kibana
juju add-relation logstash-agent:input logstash-indexer:input

Log Twitter mentions of logstash, devops, ubuntu

weak example for demo purposes, really need to connect to logstash-indexer and kibana etc to be useful.

juju deploy ubuntu
juju deploy --repository=logstash local:precise/logstash-agent
juju add-relation logstash-agent ubuntu
juju set logstash-agent InputTwitterEnabled=true InputTwitterUsername="derpaderp" InputTwitterPassword="wallybollysollynolly" InputTwitterKeywords="['logstash','devops','ubuntu']"

Read apt package manager log files

weak example for demo purposes, really need to connect to logstash-indexer and kibana etc to be useful.

juju deploy ubuntu
juju deploy --repository=logstash local:precise/logstash-agent
juju add-relation logstash-agent ubuntu
juju set logstash-agent CustomLogFile="['/var/log/apt/term.log','/var/log/apt/history.log']" CustomLogType="apt"

Configuration

InputTwitterEnabled: (boolean) enable twitter input. before enabling need to also setting InputTwitterUsername, InputTwitterPassword, InputTwitterKeywords
Reload: (string) change this string to reload logstash-agent checks. will rescan system for known log types and modify file inputs to match.; 0
InputTwitterUsername: (string) twitter username
InputTwitterKeywords: (string) twitter keywords treat it like an array, even if only one keyword. Usage: "['word1', 'word2']"
CustomLogFile: (string) location of log you want to parse ... will accept wildcards treat it like an array, even if only one file. Usage: "['/var/log/test/test*.log', '/opt/test/logs/*.log']"
CustomLogType: (string) logstash Type setting for log file
InputTwitterPassword: (string) twitter password