As Promised, A Very Dumb Frog (rwblog S6E6)

Last updated: Wed Jul 17 2024

Currently listening to: Orbvm Terrarvm, The Orb1

This issue is an old-school linkblog. Not a whole lot of thoughts on my end, just a lot of web bricolage. Share and Enjoy!2

Electrical lighting in Mission Bay

The Web Is A Great Platform, Actually

So I’ve been enjoying my time as a full-stack engineer, even as Apple platforms once again draw my attention with “spatial computing”. That’s in no small part because I’ve learned that the web is a great platform, actually!3

Last month I talked about how cool WebGPU is, but that’s not all. Here’s an attempt to build a signal analyzer on the web, with the takeaway that the web is very much ready to be a “real” platform now.

Also neat from a frontend perspective is the upcoming scroll-driven animations, which let you drive an animation from, well, how far a user has scrolled. That’s really nice! Sometimes I wish iOS had stuff like this, instead of forcing me to get a border with corner radius. Similarly, I just learned about Open UI, a W3C community group trying to specify as many common components as possible. They even have a neat chart of every component in every web framework!

Honestly, I didn’t really have a point with this section, other than to point out that web technologies are really cool?

A tree in Lafayette Park

Russell’s LLM Corner

Welcome back to the corner where we talk about LLMs (sorry). If you have a functioning scroll wheel, you can skip the next section, where we talk about a very dumb frog.

So my favorite thing I read about LLMs this month was ”Why Chatbots Are Not the Future” by Amelia Wattenberger. Provocative title etc etc but it is a very interesting take from a Design Thinker™️ that I wholly agree with! I’ve linked before to Simon Willison’s take that LLMs will be more like “calculators for words” and this article goes along with it. I suspect most people actually won’t use LLMs via a chat interface for much longer, or at least not a ChatGPT-like interface; instead, we’ll see them baked in as infrastructure for “fuzzy problems”, like parsing text that is difficult to specify or providing tools for writers from a more traditional writing interface.

For instance, here’s react-llm, which provides React hooks for working with an LLM running natively in the browser via WebGPU (which I talked about last week). I could imagine building a mini version of Sudowrite in a weekend with this…

Or not! Here’s ”All the Hard Stuff Nobody Talks About when Building Products with LLMs” from Honeycomb, who built a Query Assistant™️ for their product. tl;dr building products with LLMs is hard and requires a lot of tough product engineering. I guess product engineers don’t need to worry about their jobs after all? /s

Finally, here’s “Numbers Every LLM Developer Should Know”, modeled off the famous Jeff Dean paper “Numbers Every Software Engineer Should Know”. Even as a non-LLM developer, there’s some interesting rules of thumb in here, like how each word is about 1.3 tokens.

The Very Dumb Pumpkin Toadlet

As promised, a very dumb frog:

A pumpkin toadlet frog jumping and landing on its head

It’s so small that the fluid in its ears doesn’t work right, so it has no sense of balance and just kind of falls on its head, which would seem like a problem vis a vis predation, but apparently it’s so poisonous nothing eats it.

I learned about this from The Whippet, a newsletter you should absolutely subscribe to immediately if you would like to feel joy in your life.

You Should Read The Magic Fish

You should read The Magic Fish by Trung Le Nguyen! Drop everything and read it! It’s a very charming coming-of-age comic about a gay Vietnamese teenager trying to come out to his parents via the medium of fairy tales! But it’s not one of those sad Ocean Vuong stories! It’s slightly bittersweet but mostly optimistic! And you get to read a bunch of fairy tales drawn with a meticulous hand and an eye of telling anachronism! In summary: you should read it!

Light-up fire escape stairs along Market St

Today I Learned I Know Nothing

I’m still writing irregular technical TIL posts inspired by Simon Willison — I definitely recommend checking them out 😉 I also wrote up a list of VS Code plugins that I’ve been using. Also, in case you missed it (and want even more links), I have reading lists for some of the major theme areas I list on my site, which I update every so often:

I’ve also been working on a personal library a la Borges, but that’s not ready for prime time yet.

Until next time!

Footnotes

  1. This is what I’m literally listening to right now. If you want a listening recommendation, you should listen to Janelle Monae’s new album The Age of Pleasure. It’s good!!! Thank God it’s good!!!

  2. I’ve finally gotten around to reading the radio scripts for the later series of Hitchhiker’s Guide to the Galaxy, which are a lot happier than the frankly bitter Mostly Harmless. They do, unfortunately, cut the long Douglas Adams rant about people with the name “Russell.”

  3. Despite the insistence of Resilient Web Design that the web should properly be cross-platform.