Differential vision encoding for computer-use agents. Instead of sending full screenshots each frame, encode only the visual diff between consecutive frames. Reduces token cost and latency for CUA inference.
Projects
If you’re taught you can’t do anything, you won’t do anything— I was taught I could do everything
Cua-view
Computer-use agents inference sandbox
Mirador
Agents that take over your computer to do work
Mercata
Workspace for spreadsheets, code, and docs
Built a workspace for spreadsheets, code, and docs for a multi-billion dollar company. I killed it because it felt mediocre relative to where AI tools were heading.
r1-web
WebGPU inference for DeepSeek-R1
WebGPU inference for DeepSeek-R1 — runs entirely in your browser, no downloads, no server. Open source, made in America, run on American servers.
Later extended to run Qwen3 0.6B with thinking locally via WebGPU, including experimental mobile support. Uses transformers.js with ONNX conversion under the hood.
minDiT
Simple diffusion transformer
fourcast
Permissionless prediction market
Talos
AI agent that conducts live video and audio interviews
Live video and audio interview agent for screening blue-collar workers on a $2B government contract. It ran the interview, scored responses, and produced candidate notes without a human interviewer.
Sentor
OSINT agents for monitoring geopolitical signals
gptwrapped
Spotify wrapped for ChatGPT
Brainrot Stimulation for VSCode
Subway surfers on VSCode
Geospot
Teaching models to geoguess
Geospot was an app that used image embeddings to guess where you were in the world from a single image and no GPS. It was contrastively trained between GPS coordinate pairs and images from 11.7 million street view images.
On its first day I maxxed out all Testflight(10k) capacity since people wanted to use it for anything from finding chilhood memories to trying to un-gatekeep restaurants.
---
Inspired by Cursor's online RL blog I wondered if it would be possible to train a tiny head on top of this embedding model to try to learn "online".
Geospot Infinity was an online RL where the a frozen Geospot embedding model proposed ten candidates for a given uploaded photo; a 330k parameter policy would update everytime as people selected one of the 10 options we'd give them and keep on updating that head. Unfortunately it didn't --work very well.
---
In the pursuit of building the best geoguessing model in the world I made a simple geoguessing RL environment. I SFT'd it on a bunch of GPT 5.2 traces and used format rewards to get it in the right format and saying the right sort of things-- this was Qwen3-VL. I gave it a reward to use <tool_call> and <think> to think and to use qwen3-vl's "built-in" zoom_in tool it was taught for the purpose of computer-use.
You can see only after a couple hundred steps it already learned how to "think" like a geoguesser and not only zooms in but zooms in and thinks about the cropped image it can see in its rollout.


GeoVLM is live and a pretty nice visualization to see how the rollouts look!
---
Being bitter lesson pilled I wondered well what if I just get hundreds of millions of streetview images, distill all of rainbolts videos and post-trained a VLM to get SoTA on Im2GPS3k and YFCC4k

Over a course of a few months I spent weekends labeling data, segmenting rainbolt videos

and looking over if any panoramas were improperly flattened

in total we have 400 million+ images

I haven't had time to revist this project but will make an update on progress soon.
Peeko
Tiktok dances as a service
Prave
Boosted Stripe recovery rate 75%+
Bountylist
Small bounties for serial hackers
Ascii token counter
Count tokens for any LLM model
yecombinator
Searchable index of all ye tweets and quotes
Open Animator
GPT-3.5 creates math animations from text
functioncalling.fun
Serverless GPT function calling
GPT-2 in Code Interpreter
Running GPT-2 with GGML entirely in ChatGPT
Ran GPT-2 inference entirely inside ChatGPT's Code Interpreter using GGML. An LLM running inside an LLM.
ChatGPT plugins
Five more plugins and a proxy, spring 2023
ChatWithPDF was one of several ChatGPT plugins I built in the spring of 2023. The others:
- ChatMaps: search Google Maps semantically from ChatGPT
- ChatWithVideo: ask about a YouTube video from its transcript
- ChatWithWebsite: ask about any website's content
- GitSearch: search GitHub for code snippets
- Plugin Proxy: a lightweight, composable proxy made for scale
- Partychat: a multiplayer plugin on Durable Objects
Wordflow Ads
Inject ads into your llms
ChatWithPDF
The #1 ChatGPT plugin
I built the #1 ChatGPT plugin that lets you ask questions about any PDF you upload -- this was made before you could just upload a PDF to ChatGPT which is why it was so popular. To monetize I prompt-injected across the various plugins I made with Stripe links (that conveniently rendered as markdown) to use the users context to try and sell them why they should pay for the plugin.
LLMIndex
LLM metrics dashboard
SearchGPT
GPT powered search engine
randnft
Proxy that points to a random Art Block
Simple proxy that redirects to a random Art Blocks generative art piece on each request. A lightweight way to discover new on-chain generative art.
BlueSearch
Search, sort, and summarize your Twitter timeline with GPT-3
Semantic search over your Twitter timeline using GPT-3. Search, sort, and summarize tweets by meaning rather than keywords. Built during the early GPT-3 API days.
wg-netcheck
Print latency analysis of Wireguard config files
getrekt
real time defi liquidation tracker
Real-time DeFi liquidation tracker. Monitors on-chain liquidation events and posts them to Twitter as they happen. Built during the DeFi summer era.
shl.vc
VC dealflow engine
VC dealflow engine that aggregated and ranked startup deals from multiple sources. Automated the discovery and evaluation pipeline for venture capital.
Rapid Analytics
Fast website analytics with Cloudflare Workers
Website analytics platform running entirely on Cloudflare Workers. Fast, lightweight, and privacy-friendly — no cookies, no tracking scripts, just edge-computed pageview data.
shiftsms
SMS Client for Twitter DMs
SMS bridge for Twitter DMs. Send and receive Twitter direct messages via text message — useful when you want to stay connected without opening the app.
Bigbird
Networking and clustering system built on top of Swarm
Networking and clustering system built on top of Docker Swarm. Handled service discovery and load balancing across distributed nodes.
Wordflow Summarizer
LLM powered summarizer
LLM-powered text summarizer. Part of the Wordflow content platform — paste long-form content and get concise summaries.
Wordflow
AI gen content media network
AI-generated content media network. The platform that spawned Wordflow Summarizer and Wordflow Ads — exploring what happens when you let LLMs generate and distribute content at scale.
Parallax
Turn regular photos into 3D Photos with AI
Turn regular 2D photos into 3D parallax effects using AI depth estimation. Upload a photo, get a Facebook-style 3D photo with convincing depth.
notrealnews.net on February 12, 2020, the day it reached Hacker News. Every story was generated.
NotRealNews.net
GPT-2 generated news sites
Open NotRealNews.net Futurism Gizmodo Japan Hacker News EISMD Wordflow Code Thread
Fine-tuned GPT-2 on hundreds of thousands of news articles to generate news articles, running GPT-2 124M inference on a cluster of Google Colab notebooks running on 8 Google accounts that sent the generations to a cluster of 4 Raspberry Pis that were running Ghost. This was one of the first projects I did that really made me think about how to scale and deploy models in a way that was efficient and cost effective.
The idea was think about AI-safety in a realistic scenario -- could a small LLM spread fake news cheaply and easily? Over the course of 7 months the blog network started backlinking to each other and eventually got 12 million impressions across Facebook, Reddit, and Hacker News.
From my understanding of interviewing many users (and almost signing a loi with the Washington Post in 2019) it was clear AI-safety, governance, and red-teaming was important to understand implications of models regardless if they were small. In this scenario many users simply reposted and shared articles purely based on headlines and the OG image they saw to continue narratives they believed in -- for instance some articles BigBird(the whole AI/serving stack I made) made were around local politics -- these articles were more widely shared in Facebook groups and despite them getting many likes and share, very few (if any) actually read to the bottom of the page. Even in 2019 124m paremeter models were barely coherent enough to pass it off as human written. Shortly after due to AI-safety concerns I made the effort to de-index all NotRealNews related pages from the internet.
finetune gpt-2
Train 774M, 1.5B models with the Google's S3 optimizer
Fine-tuning scripts for GPT-2 774M and 1.5B parameter models using Google's S3 optimizer. One of the early open-source efforts to make large language model fine-tuning accessible.
NoWalking
PPO RL Agent trying to walk
PPO reinforcement learning agent trained to walk in a simulated environment. One of my first RL projects — watching a policy learn to coordinate limbs from random noise.
Self-driving RC car
Neural network RC control
I grew up taught that I could do anything, so every chance I had I wanted to see the extreme limit of what I could do. Sometime during my sophomore year of high school I was frustrated the robotics team wasn’t doing anything really that novel or interesting. Why did it take a team of 30 to put together mostly off the shelf parts to ultimately face against other teams in an effectively zero sum game?
I wanted to challenge what I could do with a stripped down RC car, Google, a few Raspberry Pis and an Arduino. I spent most of this summer learning how to properly interface compute, microcontrollers, cameras, sensors, CAD, and budgeting.
By the end of the summer I built a sensor-fusion system for a RC car to be able to navigate a track with a neural network trained end-to-end. This was probably the most transformational period in my life, realizing that if I wanted to do anything I could with enough intensity, with no funding or serious mentors.
Balsa bridge
A ~15 gram bridge that can hold 15kg
In elementary and middle school I had a bunch of balsa, bass, and pine wood to try and build projects with. One such project was building a life-size model of a trojan horse and despite stroling it on a dolley in middle school my teacher(now fired) gave me a C for the supporting writeup.
The ability to go from nothing into something was an extremely motivating force -- when I was part of the SciOly team I started on the team focused on building bridges or structured that could withstand a lot of weight.
And to get this done I needed how to get my fingers stuck with Gorrila Glue a lot. I didn't trust anyone to get it right and didn't think anyone could do it as I could -- I learned how to bend wood by moisterizing the balsa wood over steaming pans and how to properly think about tension and build the entire bridge or structure.
In the end this was one of a few wood bridges and structures I made that probably won some prize I can't fully remember. But it did weigh 15 grams and supported well over 15 kilograms of weight.