[Feb 10] - Interesting things I learnt this week

This is second of my experiment series to compile a few interesting things which I read about during the week. I hope I can continue this for this year at least.

1. Eagle 7B  - The race for better models is on. Gemini from Google is there but its another closed source one. But this one is open source. It claims to have transformers with 1 Trillion Tokens Across 100+ Languages. 

My Take: Models are going to be get better in the open source world with each passing day. Very soon we will have GPT4 level models running on our local laptops and phones. The open source is going to be a big part of it. How people build on top of these models is going to become even more interesting. I have not tried this model yet, but I am guessing it will be faster than llama2 

2. Text Generation WebUI - This is an amazing tool which starts a webservice on your machines and makes loading and configuring various LLMs a breeze. It will autodownload models once you have given hugginface project name. 

My Take: I dont know what more can ask for. Probably one of the best tools out there to try all the customised model and prompt deployment that I have come across. Downloads and loads the models with ease. Not for average usage but more for prompt engineers and those looking to experiment with LLMs

3. Canon's new chip making stamp machine - Canon announced a new chip making machine that stamps chip designs onto silicon wafers rather than etching them using light. The process, says Canon, will be “one digit” cheaper and use up to 90 percent less power than Netherlands-based ASML’s market-dominating and light-based extreme ultraviolet (EUV) technology.

My Take : It's made as a big deal announcement as if something revolutionary has been created but as noted in the article the tech has been around for sometime. But I am still hopeful they will shake things up here with atleast the less complex chips moving to this process. 

4. Gemini from Google - Bard is now Gemini and it has an Android app which replaces Assistant.

 My Take : Having teeny tiny bit of contribution to this, I don't think it's right of me to talk much about it right now. But it does a whole lot of things and is moving in sort of right direction with miles and miles to go.

 

Comments

Post a Comment

Popular posts from this blog

My learnings at Google

I just quit Google after almost 7½ years. When I had joined Google in 2016 I was exploring to start up with a travel planning, sharing and booking platform. But then when I got the chance to join Google I told myself that I will stay for 3-4 years and learn how Google's culture makes it build products that people love, at scale. Also, their engineering culture was something I had heard a lot about and thought this is my best chance to learn about and implement it in my startup. But then I managed to overstay at Google for various reasons.  There are various posts talking about what is wrong about Google here , here and here . But I wanted to look at its positives and I hope companies adopt it rather than a toxic culture which is brewing everywhere. Here are a few things which stood out for me (in no particular order): 1. Blameless postmortems : Blameless postmortems are a powerful tool for learning from incidents and improving system reliability. The key aspects of it are   a. Foc
Read more

Top reasons why Tata Elxsi should be blacklisted

Well that a provoking first line, but then thats exactly what I have to say about this company. Tata Elxsi should be blacklisted, but wait a minute by whom? Well the software developers fraternity. Its a blood sucking corporation which is right documented in the documentary The Corporation . Ok why am I telling this after almost one year of leaving it. Well when the fact is that I have nothing to do with it. I have already let out my personal experience here , here and here . Well it was not just me as its obvious from the comments but then it was general feeling of my friends there. Well all I can talk about is friends because I dont know how each and every employee of Tata Elxsi felt. Anyways heres one more story about the kind of harassment and employee of Tata Elxsi might have to suffer . Though I had read it earlier but am blogging now about solely because I wanted to confirm the news being true. And sadly it is true. An employee was indeed made to resign. And indeed its legally
Read more

[14th April 2024] Interesting Things I Learnt This Week

Image
  1. Opera adds built-in support for local LLMs - Opera is adding local AI models to its browser. Users can choose from 150 local LLM variants, keeping their data private on their device. This is part of Opera’s AI Feature Drops Program for early adopters. My Take : Locally running LLMs will become a commonplace very soon. It requires not just software but hardware support as well. On older hardware it might takes ages to get anything done. But on newer hardware it will be good I guess. The best software to get them integrated is going to be the browser for most folks IMHO . I was hoping Firefox to be the first one to do it, but I wish they work towards it. I have no hope of any of the big personal computing softwares to be doing it. They will push for only their models to be running and working across devices, also trusting them to not harvest data off it, would be a challenge. Never the less, integrating LLM APIs in browser will open up some interesting avenues for web applications.
Read more