Posts

Showing posts from 2015

The Unscientific Analysis of Languages popular with Indian Startups

Image
Well all this started with this one tweet

disruptive, IIM, ninja, passion. leverage, LSD, enterprise. this takes buzzwords to whole next level and more https://t.co/BTKniycDxa
— Sathya (@SathyaBhat) March 9, 2015 And finally ended with this one
@jackerhack thanks, got it @SathyaBhat@mehulved
— 100rabh™ (@the100rabh) March 9, 2015
And I had the entire dump of Hasjobs postings. It was pretty cool of Kiran to send them across to me and saving me the time and effort to scrape that data. At that time I had very little idea what I would do with it. I am aware of R and this was the moment when I thought I could make use of the little knowledge of it I had.

So I got on with it.

Step 1: Step R on my system.
Step 2: Write some code to extract the data and cleanse it
Step 3: Generate the counts for words
Step 4: Manually pick up the technology words with counts
Step 5: Generate the image with language popularity

So as it stands the top 5 of required technologies for Indian Startups are

1. PH…

Fabric - Just the tool for continuous deployment

Originally published in Near Engineering blog
One of the big problems with scaling complex and tightly integrated system clusters is deploying changes. As number of tools grow, changes and deploying for scale get all the more complex. Logging into each of the different system is rendered impossible as you grow from a small unknown startup to one building large scale systems. A few months back, we decided that we had hit the limits of spending time just to deploy our RTB and DMP offerings to scale. We needed a radical solution to get it right.
Let me get to our problem statement. We need to deploy a setup which involves a concoction of various technologies like HAProxy, Redis, Nginx, PHP-FPM, ZMQ, Kafka, ElasticSeach, Logstash etc. This is just tools which must be configured on deployment of a new machine in our cluster. Besides these you have all the code in PHP which needs to configure location of the services which are different based on regions. I believe this is a fairly typical…