94. Step by Step 🔗
May 26, 2022
In which I tag an emerging step-by-step ethos — from prompt engineering to backflip tutorials to Wordle — as the antidote to vibing, derangement, and brute-force trial-and-error, arguing that mindful sequentialism may be the tortoise that outruns the hare at civilizational scale.
🔗
Tagging an interesting microtrend that also looks important: a “step-by-step” ethos developing momentum. A general interest in break-king illegible learning processes into their component steps and refining them. A kind of process skill mindfulness. Like 6-sigma but for learning.
🔗
Exhibit D: The accidental discovery at the @yak_collective that good prompts are all you really need to sustain a slow and steady learning track on any subject. We’re trying to develop that into a Thing ™ (details soon…I’ll link here when we go public with it)
🔗
Initially I thought “prompt engineering” should be called “magic spells” since you’re commanding illegible forces to do improbably miraculous seeming things with the right words, but this is exactly wrong. Prompt engineering illuminates and demystifies. It’s anti-magic spells!
🔗
I will add: the Wordle Revolution (no longer a “fad” since a dedicated minority among us have turned it into a healthy daily habit) belongs here. A nugget of accessible step-by-step thinking to warm up a mindfully step-by-step day. I wrote this about it studio.ribbonfarm.com/p/derangements…
🔗
Step-by-step-ism (needs a better name) is exactly the antidote we need to a bunch of unhealthy things:
- vibing as a bad substitute for sense-making
- derangement syndromes as a chronic state of mental ill-health
- uncritical brute-force trial-and-error that learns nothing
- vibing as a bad substitute for sense-making
- derangement syndromes as a chronic state of mental ill-health
- uncritical brute-force trial-and-error that learns nothing
🔗
I think we’re about to discover that there are “10x teachers” and that prompting skill is fat-tailed
Prompting and step-by-stepping is basically skilled teaching, whether it’s silicon or living neural nets. Except in the former you can also do some “brain surgery”
Prompting and step-by-stepping is basically skilled teaching, whether it’s silicon or living neural nets. Except in the former you can also do some “brain surgery”
🔗
Thanks @kylemathews for reminding me of this piece. Yes, Blue Origin “gradatim ferociter” might have a moment again. I forgot I wrote this. Much as I admire SpaceX, long-term I think I trust this philosophy more, whatever the execution troubles.
studio.ribbonfarm.com/p/gradatim-fer…
studio.ribbonfarm.com/p/gradatim-fer…
🔗
In general, I guess this is a swing away from both “one-shot” intuitionism where you get from A to B via a stroke of illegible genius AND away from the move-fast-break-things mode of inefficient learning where you get a high learning rate at the cost of high waste and risk
🔗
A more “slow is smooth, smooth is fast” approach to mindful learning.
🔗
There is also going to be a tendency to deny there us anything new here and an effort to identify this development with a favored old tradition. I’d suggest resisting that temptation.
There’s more than “Socratic method, you invented the Socratic method!” here.
There’s more than “Socratic method, you invented the Socratic method!” here.
🔗
Oh, the big upside here is that only the original discovery of effective prompt patterns is a rare skill. Once discovered, others can easily copy. An ordinary gym teacher should be able to copy that clever backflip teaching method.
🔗
There’s a potential for a network effect here, and good prompt patterns driving out weak ones.
And of course, a clever architecture may allow AIs to discover good prompt patterns to. PromptGAN?
And of course, a clever architecture may allow AIs to discover good prompt patterns to. PromptGAN?
🔗
I have a fair amount of college teaching experience. Enough to know I’m not naturally talented at this. Once I know something, I find it hard to put myself in the shoes (motherboards?) of someone who does not know. But when I’m in a patient mood I can sort of do it okay.
🔗
I’m registering an Official Interest™ in this stebystepism trend so tag me if you spot anything interesting that’s related.
It’s also the single most positive development I’ve seen in the zeitgeist in a couple of years. Step-by-step is how you work your way out of shit times.
It’s also the single most positive development I’ve seen in the zeitgeist in a couple of years. Step-by-step is how you work your way out of shit times.
🔗
Oh shit, Asimov called this... this is robopsychology!
🔗
Also, this is the n-step version of google and twitter prompting
🔗
There is something here about growth rates. Stepbystepism is slower initially but accelerates to big momentum if it works. Uncritical trial and error is fast initially but either plateaus or crashes. And just vibing in one-shot ways just finds clever intutions without growing.
🔗
Zooming out to extreme macro, the growth vs. degrowth may be ill-posed. What if step-by-step is the DNA of tortoise like growth that doesn't backslide or crash as much? What if net, the tortoise IS faster than the hare?
🔗
Hmm... now that I think of it, my "sparring partner" approach is a step-by-step alternative to trying to "do" one-shot strategy. Instead of a fully-formed strategy being designed out of 2 days of leadership retreat BS, it emerges gradually, contour by contour
🔗
In any single sparring conversation, you might take 1-2 steps at most, but they add up over time. The strategy "takes shape" at the rate of actual alpha being uncovered in the situation, like a thing gradually revealing its full structure.
🔗
I'm unhappy with the term stepbystepism. I need to know the True Name of this thing.
Possibly asynchronous sequentialism, as an antidote to the growing synchronous parallelism of the last few decades.
Possibly asynchronous sequentialism, as an antidote to the growing synchronous parallelism of the last few decades.
Notes
- @karpathy — https://twitter.com/karpathy/status/1497652099701620738
- @IntuitMachine — https://twitter.com/IntuitMachine/status/1529476743114924034
- @Coach_365 — https://twitter.com/Coach_365/status/1515227818942251012
- @sco — https://twitter.com/sco/status/1529881116496130048
- @DrNickA — https://twitter.com/DrNickA/status/1529880745598230528
- @aresnick — https://twitter.com/aresnick/status/1529876945651085313
- @aresnick — https://twitter.com/aresnick/status/1529878280903483398
- @DrNickA — https://twitter.com/DrNickA/status/1529884287398559745
- @3blue1brown — https://twitter.com/3blue1brown/status/1528767362802929664