Karan Singh

Code Never Lies, Comments Sometime Do !!

Deep Learning: Face Recognition Without Coding

| Comments

face-recogination

Today, its 27th of October 2017 15:00 EEST, i am still in transit to home, after attending Spark Summit Europe 2017. The top two trends of this summit was

1. Machine Learning

2. Streaming workloads

I am fascinated by the advancement happened lately in the field of Machine Learning, Deep Learning and Artificial Intelligence.This technology is the biggest thing now, and is destined to be human scale.

As they say “The hardest part of any journey is taking that first step

So with that, i am all set to take my first step, where i am going to do my first Machine Learning toy lesson

Project #1: Face Recognition using face_recogination library (without coding)

OpenShift / K8s : DNS Configuration Explained

| Comments

openshift-route Life is easy when you have a DNS service … But you not always have DNS service handy to play with !!!

When you have an openshift local environment and do not have a DNS service in place, accessing your openshift application endpoints from outside master node could be challenging. I had the same problem in home lab, which i managed to fix.

In my setup, i have an openshift cluster hosted on a my home server. My applications which are ofcourse inside containers works fine from within openshift master node. However accessing my appliation from another host (e.g. my workstation) does not work. Reason being, DNS resolution for application endpoint missing.

Here is how you can access your application from outside openshift master noded.

Note: You must have a fully functional openshift environment with some apps running, exposed with their route configured.

Ceph : RGW SSL Made Simple

| Comments

ceph-rgw-ssl

It’s been a while since Ceph Rados Gateway (RGW) has built-in support for SSL. In this blog post we will quickly cover how to setup SSL for RGW and adding another layer of security to object storage endpoint without much efforts.

The first ingredient we require to configure SSL endpoint is “SSL Certificate” itself which must be obtained through an official certification authority, or CA. Its CA’s responsibilities to confirm the certificate’s identity as well as assert for its authenticity. For demonstration purpose we will use self-sign certificate, however it’s recommended to acquire SSL certificate through aurhotuzed CA for production usage.

Kubernetes : Deployment Using Ansible on VirtualBox by Vagrant

| Comments

kubernetes-handson

Containers are everywhere. You will not find any tech event, tech meetup and tech discussion without using the word containers. Yes containers are almost ubiquitous. But containers alone will not solve your tech challenges, they need someone to give them ride. Containers are nothing but isolated gift box containing some present, they need someone to take care of the delivery to the right address. This is where container management/orchestration/scheduling systems comes into picture , Kubernetes, Mesos , Docker Swarm , Kontana are some examples of container orchestration systems.

Kubernetes is the new HOT container management system brought to you by Big Daddy Google. In this blog i will help you to get your hands dirty with Kubernetes (K8s). Here is what we are going to do

  • Setup a local environment using Vagrant and Virtualbox
  • Deploying K8s using Ansible
  • Interacting with K8s
  • Deploy your first application on K8s

OpenStack Summit Boston : Voting Begins

| Comments

openstack summit

Hello Stackers and Cephers , as you already know the next OpenStack summit is around the corner and is planned for 8-11 May , Boston MA. Its the Time to VOTE NOW.

This time i have submitted the following presentations which are very unique and touching different dimensions of your favorite technology .

Ceph User Group Finland : First Meetup

| Comments

My colleague Toni Willberg from Red Hat Finland office, came up with a brilliant idea of creating a Ceph local meetup group “Ceph user group Finalnd” , so we both pursued that idea and created Ceph user group Finland (CugF)

This is group that brings together software/devops/system engineers, cloud/solution architects with an interest in Ceph, software defined storage and data center storage infrastructure to collaborate and share their knowledge,experience and opinions about the future of storage.

On 15th February 2017, we organized our first meetup with 2 presentations + great discussion. Here are they :

  • I have presented “Ceph Introduction and Beyond” and here are the slides.

  • My friend Pietari Hyvärinen presented “Detailed view of operations in production scale Ceph systems with Grafana” (i will seek his permission before publishing his slides)

Special Thanks to @ToniWillberg for CugF + 8 different User Groups that he is running in Finland Metropolitian Area on a wide range of open source technologies.

What’s Next : In approx 2 months time we will schedule our second meetup. Along with snacks and beer ( call out for sponsors ) you will enjoy listening to some interesting topics. If you are based in Finland and want to be the part of this community, feel free to join and collaborate. We will be happy to see you :)

Ceph Object Storage : Part-II (Indexless Buckets)

| Comments

Indexless Bucket

This is episode-2 of Ceph Object Storage Blog Series , you can refer to episode-1 here where i have explained the internals of Ceph Object Storage and covering over Ceph Indexless Buckets feature. In this episode we will go through the implementation of Ceph indexless buckets

By default Ceph RGW creates standard indexed bucket ( i.e. non-indexless buckets ). These buckets can list the objects stored in them. Lets verify standard bucket before configuring indexless buckets.

Ceph Object Storage : Part-I (the Internals)

| Comments

Ceph Object Storage

There is some performance difference between pure RADOS writes ( ex. via RadosBench ) vs RGW writes. There are several factors contributing to this such as :

  • Object storage access protocols ( S3 / Swift ) have higher overheads than native RADOS writes
  • Client write requests are translated through RGW adds additional latency causing additional bottlenecks
  • The most important factor is that “RGW maintains bucket indices that needs to be updated every time when a write operation is done. And further more RADOS writes does not have this over head of maintaining indexes / metadata”

In this blog post i will talk about a new feature landed in Ceph Jewel v10.1.0 which is officially known as Indexless Buckets and unofficially as Blind Buckets. Before diving into indexless buckets let’s understand what RGW does under the covers with a write request.