Idle/Random/whatever Thoughts of a Demented/Idle/Whatever Mind

Well all this started with this one tweet disruptive, IIM, ninja, passion. leverage, LSD, enterprise. this takes buzzwords to whole next level and more https://t.co/BTKniycDxa — Sathya (@SathyaBhat) March 9, 2015 And finally ended with this one @jackerhack thanks, got it @SathyaBhat @mehulved — 100rabh™ (@the100rabh) March 9, 2015 And I had the entire dump of Hasjobs postings. It was pretty cool of Kiran to send them across to me and saving me the time and effort to scrape that data. At that time I had very little idea what I would do with it. I am aware of R and this was the moment when I thought I could make use of the little knowledge of it I had. So I got on with it. Step 1: Step R on my system. Step 2: Write some code to extract the data and cleanse it Step 3: Generate the counts for words Step 4: Manually pick up the technology words with counts Step 5: Generate the image with language popularity So as it stands the top 5 of required technolog...

Originally published in Near Engineering blog One of the big problems with scaling complex and tightly integrated system clusters is deploying changes. As number of tools grow, changes and deploying for scale get all the more complex. Logging into each of the different system is rendered impossible as you grow from a small unknown startup to one building large scale systems. A few months back, we decided that we had hit the limits of spending time just to deploy our RTB and DMP offerings to scale. We needed a radical solution to get it right. Let me get to our problem statement. We need to deploy a setup which involves a concoction of various technologies like HAProxy, Redis, Nginx, PHP-FPM, ZMQ, Kafka, ElasticSeach, Logstash etc. This is just tools which must be configured on deployment of a new machine in our cluster. Besides these you have all the code in PHP which needs to configure location of the services which are different based on regions. I believe this is a fairly ...