
I use Arch BTW
August 9, 2025

Age of LLaMas
August 3, 2025

- The environment in which you run your LLM matters. For me, it was the ease-of-use and general UX that made the process much more enjoyable. I initially started with koboldcpp, then Ollama with Open WebUI, then I tried LM Studio and finally I came all the way back around to koboldcpp. While koboldcpp may not have the best UI, it is the most performant and flexible based on my testing on both Windows and Linux.
- LLMs will run fastest on your GPU rather than your CPU, and your video card brand matters. Right now, NVIDIA is the go-to for most LLM tasks, thanks to its proprietary CUDA libraries for GPU acceleration. While CUDA is the leader, it’s not the only option. AMD has been making strides in the AI space with its competing ROCm platform. Alternatively, you may also run Vulkan or CPU-based runtimes, but they are just not as performant.
- The size of your GPU's VRAM matters a lot. This is because for an LLM model to run at peak speed, it must be fully loaded into memory. For example, a 70B parameter model will require significantly more VRAM than a 7B parameter model. If you have a high-end GPU with 24GB of VRAM, you can run larger models like Llama 3 or GPT-4. If you have less VRAM, you may need to use smaller models or quantized versions. How I wish I could go back in time and buy a GPU with more VRAM!
It's time to de-Google
July 29, 2022
I screwed up. I really, really did. I took my privacy for granted and now I'm feeling legitimately creeped out that a single monopolistic, advertisement conglomerate knows basically everything about me. Where I go, what I read, what I buy and basically most of the significant events in my life. Now don't get me wrong. I have nothing to hide, but I also don't have anything to share (without my express consent of course). Up until last year I had an Android phone in my pocket, browsed the web using Google Chrome, sent all my emails using Gmail, noted my events in Google calendar, had Google Analytics on all my personal sites, uploaded all my pics and videos to Google Photos and stored some personal files in Google Drive. Notice how many times Google comes up there? It's absolutely insane! Google services are just far too convenient and most importantly free, which make them very attractive to use for many people, me included.I am aware that the world is going through a privacy crisis where the 14 eyes have made closed door agreements to record every moment of our lives in the name of "fighting terror" or for "national security", but the reality is it's all about amassing power. I don't need to write too much about this as Edward Snowden put it all out there for the world to see, but most still aren't listening. While I do think that if many entities and/or corporations knew bits and pieces of a person's life, that would not be so scary. It becomes very scary when all the data about an individual gets aggregated together given that all western countries have virtually no privacy laws (or at least none that get enforced) and the state is above all.I am now fighting to take my privacy back by:
- Only using Firefox as my personal browser. In Firefox I have enabled enhanced fingerprint prevention (hidden feature meant for Tor users), enhanced tracking prevention, total cookie protection, HTTPs everywhere and I use uBlock Origin in "easy mode" (to block third party scripts and frames by default).
- Using an iPhone and never Android. Maybe in the future I will get an Android device and flash a more privacy-focused OS onto it.
- Absolute no Facebook services or any kind of social media. However, for the time being, I am making an exception for Strava which is social media adjacent.
- Switching over to Protonmail for my email, calendar and file storage.
- Removing Google-analytics from all my personal sites.
- Switching to use startpage.com for searching instead of using Google directly.
Home automation is cool
June 27, 2022
It's been some time since my last blog post as I was busy moving and settling into my new home. It's given me the opportunity to discover the magic of home automation and right now the name of the game is Home Assistant. Through Home Assistant, one may run a local server (I run it on a Raspberry Pi 4) that may connect to smart devices and unify them all in a single UI. The greatest benefit of this is that now these devices may be automated together and they may now be controlled remotely even when away from home. Another amazing thing about Home Assistant is that it allows the community to extend its functionality through the Home Assistant Community Store (HACS). HACS essentially allows the user to download custom device integrations and UI customizations from GitHub. Sounds cool? Because it is! My current automations are as follows:
- Turn off all the lights, change the alarm system to "Away" and start the Roomba when all home occupants have left
- Re-dock the Roomba when one of the home occupants comes back
- Change the alarm system to "Night" after 10pm
- Change the alarm system to "Home" after 7am unless no one is home, or when someone comes back home from 7am to 10pm
- Send an alert to all home owners when any of the wetness detection sensors turn from "Dry" to "Wet"
- Flash all lights red when when the router disconnects from WAN for over 3 seconds
- Turn the lights on to 40% in the living room when a home owner comes home after sunset
Ashes to ashes, Android to iOS
Oct. 18, 2021
My faithful Pixel 3 endured 3 years of heavy use, but it's finally come time to put it to rest and so came the time to pick out a new daily driver. In my opinion, phones should be compact and I am absolutely not a fan of the fact that all the modern Android flagships are at least 6.2" in screen size. Year over year there is a very real push to create faster, higher spec phones and the simplest way to do that is to simply create larger phones so that they can hold higher performing components. As such, this time I chose to go with my very first iPhone. Mind you, this is not my first Apple device. In particular, I'm a big fan of AirPods and I actually rocked the very first iTouch back in the day. This time I went with a (product)red iPhone mini and it's been fun getting used to a new phone operating system. I consider myself an advanced user and I've now spent a ton of time tinkering and playing around with my new phone. Here is my comparison of the pros and cons of Android vs iOS.iOS Pros:
- Beautiful screen and a powerful haptic engine
- The UI generally looks better
- Significantly less bloatware and most apps that come pre-installed can be uninstalled
- AirPods work much better with their intended OS. iOS works much better with the Apple ecosystem devices
- Widgets for the stock apps look great
- Iconic phone design and sounds
- It really hurts to lose Pixel's call screening
- No system-wide back gesture results in an inconsistent experience between apps
- Terrible UX without an iWatch due to the new 6 digit passcode, lack of touch id and severe limitations of face ID for this COVID season
- No USB-C :(
- Live wallpapers are implemented in the worst way (why do I have to press down on the screen to animate the wallpaper? why???)
- Much harder to block system-wide ads
- severe custom app restrictions (I ended up paying $30 a year for a appdb PRO subscription which allowed installation of "non-app store" apps)
- The stock keyboard is horrendous and does not allow much customization (custom keyboards come with restrictions which make them not ideal)