TypeSafe's essay extending Sutton's lesson: doing the right task beats data, which beats compute, which beats algorithms.
The post orders the leverage in ML as doing the right task > data > compute > algorithms, using InstructGPT as its example: GPT-2-sized models over 100x smaller than GPT-3 beat it once trained on the right task.
It argues that scaling pre-training would have needed roughly GPT-7 level to beat that baseline and GPT-9 to beat InstructGPT on GPT-3, and that picking the right task often means leaving ML to study users, products, and organizations.
Definitions that connect to this one.
Posts from builders shipping with Jev right now.
Day-one notes from a skeptic, in Chinese
一些关于 Jev (@typesafeai) 的 notes 研究了一天 Jev，带来的新鲜感迅速回落，这好像就是一个更快的通用分类器/决策器，LLM 完全可以做到。 而且因为不了解模型背后的参数规模（应该不会很大），世界知识可能不一定有常规 LLM Show more
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x
Search and tagging on keep.md
Cloudflare Workers has Jev now so I'm putting it to the test on keep.md - 7x faster search rerank compared to the current hybrid - 50x faster tagging of content vs GLM 4.7 Flash with no failures
A filter for reply-guy comments
Pro tip: You can use Jev to remove annoying reply guy comments that X seems to always miss. Takes 5 minutes in Astra with the docs and an API key.
A Downloads folder that sorts itself
Jev unlocks SO many awesome new ideas. I built a macOS app that monitors my Downloads folder along with a customisable set of rules. Is the downloaded file an invoice? Move it to a special folder with the correct filename. No other LLM calls involved - just Jev!
Which outreach signals book demos
JEV is insanely fast. We gave it a massive dataset based on thousands of outreach messages and asked: Which intent signals generated the most booked demos? 40 seconds later, we had the answer. Cost: less than $0.20. JEV can also rank leads, measure prospect-message fit, and Show more
Website to App turns any URL into a native app
Introducing Jev for 'Website to App' Turn any website into a native mobile app. Just paste a URL. jev-1.13.0 decides how to build the original website as a *native* mobile app, then shipper submits to the app stores for you. We’ve been using this internally a ton for Show more
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x
