The Riak Mesos Framework simplifies the deployment and management of large Apache Mesos based Riak KV clusters allowing for massive scalability with little operational effort. This preview highlights key features of the Riak Mesos Framework.
An Apache Mesos framework for Riak KV, a distributed NoSQL key-value data store that offers high availability, fault tolerance, operational simplicity, and scalability.
The Riak Mesos Framework is managed by Marathon and coordinates with Mesos to keep large Riak KV clusters connected and running. The Riak Mesos Framework scheduler will attempt to spread Riak KV nodes across as many different mesos agents as possible to increase fault tolerance. If there are more nodes requested than there are agents available, the scheduler will then start adding more Riak KV nodes to existing agents.
Applications outside of Mesos can communicate with Riak on Mesos via a smart proxy called the "Riak Mesos Director". Due to the nature of Apache Mesos and the potential for Riak KV nodes to come and go on a regular basis, client applications using a Mesos based cluster must be kept up to date on the cluster's current state. Instead of requiring this intelligence to be built into Riak client libraries, a smart proxy application named Director has been created which can run alongside client applications.
The Director communicates with Zookeeper to keep up to date with Riak KV cluster changes. The Director in turn will update it's list of balanced Riak KV connections.
Installing the Riak Mesos Framework is easy with the help of the Mesosphere data center operating system (DCOS). Simply install the Riak DCOS package and CLI plugin to get started.
This demonstration DCOS environment has 3 masters, 5 private agents, and 1 public agent. Running "dcos package install riak" will start the scheduler and other framework components.
Creating large Riak KV clusters on Mesos is as simple as a few commands, no more complex and error prone deployment scripts.
Running "dcos riak cluster create" will create a namespace for your Riak KV nodes.
The second command needed to get a Riak KV cluster running is "dcos riak node add". To increase the initial scale of the cluster, supply the "--nodes 3" option.
Applications need a way to communicate with Riak KV, and most Mesos agents are closed to the world by default. Luckily the Riak Mesos Director smart proxy can bridge the gap.
The Director is an application which sits on a Riak agent that is accessible to applications outside of Mesos. Automatically install and configure the smart proxy with "dcos riak proxy install."
The Director will proxy incoming HTTP and Protobuf traffic to each of the new Riak cluster nodes.
Apache Mesos provides an environment that allows for massive scale. Riak KV on Mesos takes full advantage of those capabilities.
add more nodes add new cluster
Simply repeat the "dcos riak node add" command to increase the size of the cluster.
Best practices for operating Riak KV include creating a new cluster for each use case. This is easier than ever with the Riak Mesos Framework.
Find clarity at www.basho.com
