Showing posts from 2024

[14th April 2024] Interesting Things I Learnt This Week

  1. Opera adds built-in support for local LLMs - Opera is adding local AI models to its browser. Users can choose from 150 local LLM variants, keeping their data private on their device. This is part of Opera’s AI Feature Drops Program for early adopters. My Take : Locally running LLMs will become a commonplace very soon. It requires not just software but hardware support as well. On older hardware it might takes ages to get anything done. But on newer hardware it will be good I guess. The best software to get them integrated is going to be the browser for most folks IMHO . I was hoping Firefox to be the first one to do it, but I wish they work towards it. I have no hope of any of the big personal computing softwares to be doing it. They will push for only their models to be running and working across devices, also trusting them to not harvest data off it, would be a challenge. Never the less, integrating LLM APIs in browser will open up some interesting avenues for web applications.

The path forward

 Throughout my life, I've often found myself choosing paths different to those taken by most of my peers. Sometimes, this was a deliberate choice, while other times it was a result of the circumstances life presented me with. One instance of this occurred when I opted to pursue a Bachelor of Engineering in Computer Science, while most of my peers were flocking towards Electronics. Later, when many of my peers were planning to leave India, I made the decision to stay and eventually secured fulfilling roles that prevented any regrets about my choice. Similarly, while everyone was engrossed in developing for iPhone and Symbian, I ventured into Android and published apps on that platform. I vividly recall attending a mobile conference at IIMB in 2009-2010, where during a talk, I was the only individual who solely knew Android, while others were proficient in Nokia or iPhone. Despite being advised that only Symbian and iPhone would yield financial success, I'm glad to have jumped on

[March 31] Interesting Things I Learnt This Week

 1. MRI Headphones - This is an interesting post about how MRI Headphones work . During MRI normal headphones cant be used at they use metal and have magnets. So there is a simple solution for that, have electronics outside and audio piped through a tubing.  My Take: When I first read about it, I was blown over by the fact that there were headphones for MRI. I have never seen one but then when I read the post about how and why it works, its seems like a no brainer. Its a simple elegant solution which has been invented because of the constraints on the system. 2. How many natural satellites does Earth have : There has been multiple discussion and articles on it. Earth has one permanent moon, but many other objects are temporarily captured in Earth’s orbit. These temporary moons are called minimoons, quasi-satellites, or ghost moons. Some are asteroids that get caught in Earth’s gravity for a short time. Others are pulled in by the sun’s gravity and follow a similar path to Earth.

My learnings at Google

I just quit Google after almost 7½ years. When I had joined Google in 2016 I was exploring to start up with a travel planning, sharing and booking platform. But then when I got the chance to join Google I told myself that I will stay for 3-4 years and learn how Google's culture makes it build products that people love, at scale. Also, their engineering culture was something I had heard a lot about and thought this is my best chance to learn about and implement it in my startup. But then I managed to overstay at Google for various reasons.  There are various posts talking about what is wrong about Google here , here and here . But I wanted to look at its positives and I hope companies adopt it rather than a toxic culture which is brewing everywhere. Here are a few things which stood out for me (in no particular order): 1. Blameless postmortems : Blameless postmortems are a powerful tool for learning from incidents and improving system reliability. The key aspects of it are   a. Foc

[March 24] Interesting Things I Learnt This Week

 1. Ultrasound becoming Utra small - How MEMS technology has miniaturized ultrasound imaging. It discusses the limitations of traditional ultrasound machines. These machines are bulky and require multiple probes. MEMS technology allows for the creation of a single probe that can image the entire body. This probe is small enough to fit in a lab coat pocket.  The article also details the technical aspects of MEMS transducers. My Take : Any and all technology is bound to get cheap and miniaturized over time with progress in science and technology. Utrasound is something which can be thought of a speaker and a mic in very layman terms. These are bound to get smaller over time and be more effective. But like any other tool, this can be misused and the reason for skewed male/female ratio in India can also be attributed to ultrasound. My worry is if this tech is available more widely and portable, it will further skew the gender ratios in India(and probably a lot of other countries). This pa

[March 17] Interesting Things I Learnt This Week

1. LocalSend : On its website explains what it is, in a minimalist way with just two lines written there Share files to nearby devices. Free, open-source, cross-platform. This is all this product does My Take : This is an incredible app which works across different platforms. I tried it on Android and Linux and my experience was super boring, which is great. This process there is always a market for simple products which just work. I hope this app becomes like VLC player which is another great open source software which just works across different platforms. 2. Arduino GIGA R1 WiFi : A 3.6kW, Arduino controlled, single-axis tracking, ground mount solar system   My Take : Amazing work and all of it is open source. I guess anyone working to setup solar panels should look into this for better efficiency.  3. Oxygen Production at Europa : NASA's Juno mission has found that the ice-covered Jovian moon generates 1,000 tons of oxygen every 24 hours – enough to keep a million humans b

[March 10] Interesting Things I Learnt This Week

1. Kitten - The Streaming HTML framework - Kitten is a small, JavaScript-based web framework designed for people who want to build web applications easily. It is designed to be easy to use and fun to work with. Kitten accomplishes this by using plain HTML, CSS, and JavaScript. Additionally, Kitten supports features like WebSockets, htmx, and Alpine.js. A starter tutorial for it is at My Take:   This is a new framework that I find it very interesting, and it's worth keeping an eye on. It introduces some intriguing concepts, including streaming HTML and a JavaScript Database (JSDB). While this approach seems more suited for small web applications rather than web-scale ones, it might not be relevant for large organizations. However, for hobbyists like myself, it presents an exciting opportunity to try something new. I'll definitely be following this closely.   2. Radicle Heartwood Protocol & Stack -  Heartwood is the third ite

[March 03] Interesting Things I Learnt This Week

1. New Prompt Engineering Technique using Star Trek references : This is a very interesting and pretty long article which goes into how talking about star trek makes LLM spit out better results.  My Take: The idea of using Star Trek references to enhance LLM performance is certainly intriguing. However, it also serves as a stark reminder of just how much we still have to learn about the inner workings of these complex models. While we can observe and utilize their outputs, the actual mechanics behind their decision-making processes remain shrouded in a degree of mystery. This lack of understanding doesn't deter me from seeking new ways to explore and understand LLMs. In fact, this unique approach only strengthens my curiosity and compels me to delve deeper into their capabilities and limitations. Ultimately, uncovering the secrets behind LLM operations could pave the way for even more innovative and effective applications in the future.   2. StreetPass : StreetPass is a browser

[Feb 25] Interesting Things I Learnt This Week

1. How a group of birds got their names - This is an article about the collective names of groups of birds. It discusses how these names came to be and how they have changed over time. The names are often based on the birds’ characteristics or behavior. Some examples are a “murder of crows” and a “parliament of owls”. The article also mentions a book called “ The Boke of Seynt Albans ” which contains a list of many of these collective names. My Take: The evolution of names across centuries is a fascinating journey, often revealing a captivating rabbit hole of linguistic transformations. At times, it strikes me that we may become overly fixated on specific details that are destined to fade with the passage of time. In doing so, we risk losing sight of the broader picture. This phenomenon is particularly evident when exploring historical instances that highlight the intellectual contributions of women. Unfortunately, history illustrates how their brilliance was often stifled through fo

[Feb 18] - Interesting things I learnt this week

A few interesting things I learnt about this week are 1. Coffee Stains in LaTeX - This package provides an essential feature that LaTeX has been missing for too long: It adds coffee stains to your documents. A lot of time can be saved by printing stains directly on the page rather than adding them manually. My Take: There is too much fun to be had with LaTeX. I guess the rest of the world missed this wonderful piece of tech completely. These small and sometimes pointless tools are what really make any technology platform stand out among others, not because of the tech but the fact that its users are emotionally invested to build these kind of tech nuggets 2. Meshtastic - Meshtastic is a project that enables you to use inexpensive LoRa radios as a long range off-grid communication platform in areas without existing or reliable communications infrastructure. This project is 100% community driven and open source. LoRa uses license-free sub-gigahertz radio frequency bands EU868 (863–87

[Feb 10] - Interesting things I learnt this week

This is second of my experiment series to compile a few interesting things which I read about during the week. I hope I can continue this for this year at least. 1. Eagle 7B   - The race for better models is on. Gemini from Google is there but its another closed source one. But this one is open source. It claims to have transformers with 1 Trillion Tokens Across 100+ Languages.  My Take: Models are going to be get better in the open source world with each passing day. Very soon we will have GPT4 level models running on our local laptops and phones. The open source is going to be a big part of it. How people build on top of these models is going to become even more interesting. I have not tried this model yet, but I am guessing it will be faster than llama2  2. Text Generation WebUI - This is an amazing tool which starts a webservice on your machines and makes loading and configuring various LLMs a breeze. It will autodownload models once you have given hugginface project name.  My T

[Jan 28] - Interesting things I learnt this week

 This is my experiment to compile a few interesting things which I read about during the week. I hope I can continue this for this year at least.   1. One Pedal Driving : This is an article about one-pedal driving in electric cars. It discusses what one-pedal driving is and the benefits of using it. One-pedal driving allows you to accelerate and brake using only the gas pedal. This can help extend the life of your brakes and increase your car’s range. It also reduces stress while driving. The article also details how one-pedal driving works and how to use it safely.  My Take: This is really nice idea. I drive a smart hybrid which I kind of drive in a one pedal mode. Not sure if I am getting most bang for the buck, but I kind of am used to leaving the accelerator and the car slowing down and coming to a stop where I want (obviously I need to brake for complete stop) ever since I learnt driving first, thanks for my trainer.    2. Reading QR Codes manually - This guide teaches you