Karan Singh

Where there's a Cloud , there's a way !!

FIO Tip: Use Genfio to Quickly Generate FIO Job Files

| Comments


FIO is one of the most popular benchmarking tool out there and its my favourite too. It’s a feature rich and provides pretty useful supporting utilities. One of the utilities it provides is genfio . As the name suggest it a tool that generates FIO job file based on arguments you provides to it.

Recently i have been try to benchmarking my server containing 35 disks such that each operation should run in parallel on all disk’s and i should get aggregated results for IOPS and Bandwidth. So i used genfio to generate FIO job file and then run fio command line using the job file

COSBench: Cloud Object Storage Benchmarking Tool

| Comments

cosbench Benchmarking storage systems is a pretty interesting job and these days i am playing hard with it . Having said that object storage benchmarking is currently under my radar.

Block and file storage is there since ancient times and so as their benchmarking tools. Object storage is way too different and the traditional benchmarking tools don’t talk object. There are not very many tools out there for benchmarking object storage, the one which is getting popularity is COSBench aka Cloud Storage Benchmarking tool.

COSbench is developed and open sourced by Intel. It’s based on classic client / server model where client node aka COSBench Driver node ( COSBench client ) accepts the job from server aka COSBench controller node ( COSBench server) executes the job against storage system gathers the result and send them back to COSBench controller node. Here are some good to know things about COSBench

Introducing Ceph Cookbook

| Comments

ceph cookbook

Why do we care

We are a part of a digital world that is producing an enormous amount of data each second. The data growth is unimaginable and it’s predicted that humankind will possess 40 Zettabytes of data by 2020. Well that’s not too much, but how about 2050? Should we guesstimate a Yottabyte? The obvious question arises: do we have any way to store this gigantic data, or are we prepared for the future? …. Software Defined Something ….. Well it’s a great saying that “Software is eating the world”. This appears to be true. However, from another angle, software is the feasible way to go for various computing needs, such as computing weather, networking, storage, datacenters, and burgers, ummm…well, not burgers currently. As you already know, the idea behind a software-defined solution is to build all the intelligence in software itself and use commodity hardware to solve your greatest problem. And the greatest minds in the industry thinks that, the software-defined approach should be the answer to the future’s computing problems.

Ceph is a true open source, software-defined storage solution, purposely built to handle unprecedented data growth with linear performance improvement. It provides a unified storage experience for file, object, and block storage interfaces from the same system. The beauty of Ceph is its distributed, scalable nature, and performance; reliability and robustness come along with these attributes. And furthermore, it is pocket friendly, that is, economical, providing you more value for each dollar you spent.

Effectively Monitoring a Ceph Cluster

| Comments

Effectively Monitoring a Ceph cluster

Hello guys, during my system house keeping i found this video , which i had recorded some time ago, thought to share with you.

This video is about how we do monitoring of our Production Ceph clusters. In our company we prefer open source software for service monitoring. We have been using the following open source projects all-together for monitoring.

  • Opsview : Its based on Nagios. Until March 4 , 2015 OpsView was available under GPL license , however its opensource version is now discontinued.
  • Collectd : collectd gathers statistics about the system it is running on and stores this information
  • Graphite : Is a tool for monitoring and graphing the performance of computer system in real time.
  • Grafana : Is Graph and dashboard builder for visualising time series data

Opsview Monitoring for Ceph cluster

Live Demo : OpenStack and Ceph

| Comments

openstack and ceph live demonstration

Hey Guys , with this blog post i would like to share live demonstration screen cast that i have prepared using my openstack and Ceph environment.

What’s expected from this Demo

  • Creating OpenStack glance image stored on Ceph RBD
  • Creating OpenStack instance with Ephermal disk on Ceph RBD ( storing instance on Ceph )
  • Creating OpenStack Cinder volume on Ceph RBD
    • Attaching this volume to OpenStack instance
    • Mounting this volume and generating some load
  • OpenStack Instance LIVE MIGRATION across hypervisors

Un-installing OpenStack RDO

| Comments

Uninstalling OpenStack

RedHat Distribution of OpenStack ( RDO ) is one of the most popular openstack distribution for test, dev and production environments. Deploying OpenStack infrastructure using RDO is fairly easy.

However there is no automated uninstall process for RDO (or OpenStack in general).

With the help of this blog I will share my secret sauce that I personally use to uninstall / remove openstack from my development & test environments. This saves me from reinstalling the entire OS and over the OS configurations + it saves time.

Calamari Packages for Community

| Comments

Ceph Calamari Packages for Community

Recently I have been playing around Ceph calamari, which is a management and monitoring system for Ceph storage cluster. It provides a beautiful Dashboard User Interface that makes Ceph cluster monitoring amazingly simple and handy.

Deploying OpenStack KILO Using RDO

| Comments

Deploying OpenStack KILO using RDO

Getting openstack up and running using RDO is fairly straight forward. However many people have asked to deploy openstack with an existing external network. This method should allow any machine on the network to be able to access launched instances via their floating IPs.


  • CentOS7
  • OpenStack RDO KILO
  • Vagrant ( Optional )

Docker Containers in Just 10 Commands

| Comments

Docker container in 10 commands

If you are on this page, then you definately know what is Docker , i will not take your time with the introduction part.

Lets do Docker !!!

  • Install docker packages on your Linux host , in my case its CentOS.
# yum install -y docker-io