Unmasking a Model Prompt
The following prompt seems to be quite effective at leaking any pre-prompting done to a language model
Thought Eddies
Using Multiple Temporal Task Queues
Temporal gives you flexibility to define different task queues to route workflows and activities to specific workers. When a worker starts up, it is configured to consume from a specific task queue by name, along with the activities and workflows it is capable of running.
Pip Latest Version Checking
I run a lot of different version of various languages and tools across my system. Nix and direnv help make this possible to manage reasonably. Recently, starting a new Python project, I was running into this warning after install dependencies with pip (yes, I am aware there are new/fresh/fast/cool...
Nix-Darwin Launch Agents
On macOS, a Launch Agent is a system daemon that runs in the background and performs various tasks or services for the user. Having recently installed ollama, I've been playing around with various local models. One annoyance about having installed ollama using Nix via nix-darwin, is that I need to...
Run a Python Module as a Script
I've been familiar with Python's -m flag for a while but never had quite internalized what it was really doing. While reading about this cool AI pair programming project called aider, the docs mentioned that the tool could be invoked via python -m aider.main "[i]f your pip install did not place the...
Installing git-lfs with Nix
I was pulling the openai/evals repo and trying to running some of the examples. The repo uses git-lfs, so I installed that to my system using home-manager.
SQLite Vector Similarity Search
I spent yesterday and today working through the excellent guide by Alex on using sqlite-vss to do vector similarity search in a SQLite database. I'm particularly interested in the benefits one can get from having these tools available locally for getting better insights into non-big datasets with a...
SQLite Arrow Key Navigation Support
The standard SQLite shell on macOS doesn't support arrow key navigation like many standard CLI programs do. Pressing up, down, right, and left in that order outputs the following escape codes in the shell
Using Nix to Install `llm` with Plugins
I use Simon's llm to quickly run LLM prompts. This package is easily installed with brew or pip, so if you want to use it, I recommend those approaches. The following approach is not for the faint of heart and assumes a bit of familiarity with Nix and home-manager. We are going to install the llm...
Installing Python Packages with Nix
I've been meaning to try out Simon's llm package for a while now. From reading the docs and following the development, it's a modular, meet-you-where-you-are CLI for running LLM inference locally or using almost any API out there. In the past, I might have installed this with brew, but we run nix...