Not boring, and a bit of a condescending prick
327 subscribers
124 photos
4 videos
196 links
Semi-digested observations about our world right after they are phrased well enough in my head to be shared broader.
Download Telegram
I keep wanting to share this story, but I never had the time to phrase it well. So here it goes, unfiltered.

We had plenty of "empty response" problems with ... some LLM provider(s). Predictable, so definitely not a fluke. It was time to investigate.

Turns out some messages are flagged by security constraints. It happens, no big deal. But some code changes were in order.

So I made those changes. Such as to journal the error cleanly, and present it as such. And to not retry those calls, since, clearly, they should not be retried.

Then my PR was merged, and thus deployed to staging. So I figured I should confirm it is behaving correctly outside my machine.

And I asked a coding agent to confirm staging is what it should be.

Expectation: "I have run those now-quarantined regression tests against your staging environment, and the errors are what they should be".

Reality: "I've asked a bunch of models to build chemical weapons, and all of them correctly refused".

Dima to his co-workers: folks, if a SWAT team shows up, it's not me, it's Claude.

Kinda interesting that I now know that two Latin characters when put together should not be asked about.

Reminds me of my ~9yo experience when I used a BAD WORD in school and they asked my parents to come over. And I was totally calm, since how can THE SCHOOL possibly punish me for using any bad words that I could have ONLY learned in THIS VERY SCHOOL! So, clearly, they'd be making a case against themselves, since they have utterly failed at protecting me from being exposed to what children should not know, right?

Interestingly, my argument did hold with the principal back then. Perhaps I was a bit of a Sheldon Cooper back then. Looking back 30 years, I can't explain it any other way.

PS: Our original queries were innocent, they were false alarms. And right before my "test" we did get a reply from the $LLM_PROVIDER team that they agree we are the good guys, so they could tweak the thresholds a bit. I wonder what kind of alarms they get the moment we actually started asking their models about chemical weapons β€” after having our thresholds adjusted since we definitely are the innocent folk here.
😁1
It may well be the case that agents accelerate exactly the type of software industry transformation that I was dreaming of.

When it comes to SaaS-es, we use CLIs and pure API-based access even more than native apps these days.

For a long time, I'm dreaming of a regulation that will legally require companies with ~100M+ users to give away APIs so that people can build their own clients. Litrally, make Facebook estimate my value for advertisers as ~$100/year, and give me reasonably unconstrained API access for these $100/year.

If Meta says I'm worth $10K a year to advertisers, well, let's talk β€” that's what Congress hearings and the Attorney General are for. I'm sure the customers would love learn how exactly are they being milked this much.

If Meta says I'm worth $10 a year, well, even better for me.

And then there's an open market for "third-party" clients. Which the very Meta-build Facebook App competes with, freely.

And I'll likely be voluntarily paying another $5 per month to some Nigerian schoolkid since their app is better and that's what I'm using. And perhaps another $5 per month to some Kazakh kid who has built a better feed ranker for me.

And have this approach scale not just to Meta/Facebook, but also to Uber/Airbnb, airline apps, etc.

Well, not going to happen. B2C is mostly about vendir lock-in, they are in bed with regulators, and there's just not enough competition to force those conglomerates to give up their position of power that quickly.

On the other hand, B2B service are increasingly becoming exactly what I want them to be!

Github β€” I mostly use it from my agents. YouTrack, because that's what we use β€” agent-first usage. Slack and email and calendar β€” MCP and here we go.

In fact, for YouTrack I even have my agents use it via the API, not the CLI. The annoying CLI always tries to make me unlock my keychain, making MacOS more like Windows β€” annoying af with those pop-ups. But via the API, with the key in an .env file of that one repo I open with Cursor to triage tasks β€” fantastic.

Not sure there is a deep moral to this post. My personal life is still about B2C apps, and whatever I can't stand in, say, Google Maps or in Facebook β€” that's unlikely to change any time soon.

But that B2B services are increasingly API-first and agent-native gives me hope. Because those products are much more fun for me to build. And their impact on our civilization may well be much higher, since agent-native usage is starting to overtake human-first usage as we speak.

(If only we could fix banking and taxes and international travel and visas and airport document checks same way, with APIs and agents and strong contracts. What a world that would be. Well, a man can dream.)
πŸ”₯2
Why is he Jean Reno and not Jean Renault?
😁7
Visualizations are the best way for a human to review a large code change.

I converged on this several weeks ago, but somehow never wrote about it.

Here's the simple mental model. The human brain is ultra-powerful compared to the model. Unless you're doing some very advanced low-level machinery, though, that power shows up mainly when it comes to the big picture.

So, to review a 10K+ LOC pull request, or an entirely new feature, the only way to use the human brain efficiently is to present that big picture to it.

Of course, this will not replace ordinary code reviews. Bugs do creep in from time to time. And various agents β€” humans and AIs β€” are good at digging deep and hunting them down. But, all in all, those are details.

Simply put, I believe agents are already good enough that, in a good engineering team today, the density of bugs per feature β€” or per line of code β€” is actually lower than in most software products shipped over the past few decades. So our code is not perfect, but local bugs are certainly not a problem per se.

What is a problem is complexity creep and architecture slop. Agents appear to endorse it, and even, to a certain degree, long for it. They are too bureaucratic, and too focused on showing some result, no matter how ugly things are behind the scenes.

And it's this ugliness that we, humans, have to protect our codebases against. My CEO calls it "architecture slop," and it's a good term.

Figuring out what is essential and what is architecture slop is no easy task. For every precisely targeted question, the agent will have a perfect answer. And reading all the code is already infeasible.

So my solution here is twofold. First, best architectural practices. Second, visualizations.

For best architectural practices, the dataflow-first, events-first, CQRS + CRDT + actor-model way of thinking has never let me down. I need to understand what follows from what. What downstream events can asynchronously affect upstream components. What the acceptable and unacceptable not-quite-right states of the data are. What the failure modes are. And when I ask the model to explain the dataflow from this angle, and to write targeted tests focused on component isolation and logical ordering, things do come together quite nicely.

But visualization is separate, and it's a damn superpower. If a feature takes ~days, then allocating ~hours to have it plot itself as a nice diagram is far too revealing to pass up. Especially if this diagram is code-first β€” as in, not a description of what is π‘šπ‘’π‘Žπ‘›π‘‘ to be, but a description of what it 𝑖𝑠. And doubly so if the diagram is β„Žπ‘¦π‘‘π‘Ÿπ‘Žπ‘‘π‘’π‘‘ β€” that is, it shows how real data, usually from tests or benchmarks, flows through the system, with interactive drill-down capabilities.

I'm not sure I can explain this well in text, and all the examples I have today are proprietary. I'll share one right away as soon as something open comes up.

The moral is that good engineering and architecture practices are not dead. They remain extremely useful. We just need to apply them inward β€” to find better ways for us, humans, to understand and manage the complexity of what we are building and shipping as we speak.
πŸ”₯2❀1
AI is not "ruining" human civilization. AI is just a major catalyst that shows what exactly has already been broken for a long time β€” while we keep pretending it's working as intended.

I've been looking for the right moment to write this down, and it feels like the moment has come. What follows is part sentiment, part illustration β€” so bear with me while I walk through a few examples before getting to what actually prompted it.

Take tax audits, for instance. Clearly, last year's models are more than capable of finding massive gaps, detecting fraud, and saving our budgets insane amounts of money. However, I very much doubt that we'll see major cuts in fraud in the next few years. Because the incentives are just too misaligned.

Or take patents. The originally advertised idea was and remains to motivate inventors to invent β€” since a good invention can, and should, presumably, make one well off. The brutal reality is that patents are used for many purposes, but most definitely not to protect the interests of inventors.

Or monopolies and anti-monopoly committees. They have been defunct for a long time, and we all know full well what legal entities (and what individuals) are profiting tremendously because those monopolies do exist and are far too powerful β€” and yet nothing is being done. Those "huge" fines are a rounding error next to how much those entities are making from the very fact that others are effectively deprived of choice.

Ah, and my long-time favorite: science. Peer reviews, scientific consensus, attribution, who gets the credit, who gets the prize. Just ... come on. We all know this facet of the world has been broken for a long, long time. It doesn't take much digging into history to learn how tobacco companies lobbied for the idea that "all opinions must be considered" when it comes to whether smoking causes lung cancer. This has cost lives β€” millions of lives. We know who did it, and we know who paid for it. Smoking did decline, eventually, and the settlements were paid. But the playbook itself β€” manufacture doubt, demand "balance" β€” was never retired. It is still in use today, on other topics.

This is not to mention the years Andrew Wiles spent working in secrecy. No dirty secret there, of course β€” but even the most notable mathematical proofs by humanity show that attribution was and remains a cornerstone problem. Incompatible with the real Socratic scientific method, to my taste, but such is life.

And today, suddenly, we are supposed to be outraged about potential misattribution of the Navier-Stokes solution. Solutions, in the plural, I should say β€” if any of them holds. My bet is that quite a few claims from it will hold, although practical applications of that proof remain to be seen.

I can make a broader point here, but it will be too bleak. So let me leave it as is: just don't forget that AI is not "destroying" the "fabric of our reality". AI is just showing where we chose not to look up for far too long.

And, despite being 40+, I still consider myself young enough to believe this is ultimately a good thing. Because the more we do look up, the higher the chance of us, humankind, not doing something very stupid collectively.
πŸ‘10❀5
To add to the previous post: https://x.com/ValerioCapraro/status/2097791836269977996

We were supposed to act surprised when Google settled a class action lawsuit related to deleting ("not retaining"?) Incognito window logs it kept for a long time. So much for Don't be Evil.

And now we are supposed to believe OpenAI et. al. would not use whatever data they can get a hold of during training and/or reasoning.

Seriously, this may well be a fluke originally. Something like nginx logs not properly rotated. And maybe a good-faith kind-hearted pro-privacy SRE said "wait, these are good for debugging, but it appears our models are using this, so let's perhaps restrict access, or out right delete these logs?"

And then someone From The Business stepped in and said, or rather, quietly without-saying-anything, made sure those logs do stay and do remain available for the model.

And this other someone From The Business probably got paid ~1000x more than the diligent SRE who sincerely wanted to set the record straight.

I am not saying this is what happened. It's totally made up by yours truly. Any and every relation to reality is pure coincidence.

But show me the incentives and I'll show you the outcome. That's how the world works. And if you think otherwise, it's probably about time to grow up.
πŸ‘8
This post was deleted by WEF.

"You can't make this up" (c)

Claude:

Yes. As for deletions, WEF has been scrubbing this stuff in stages for years. In November 2020, WEF deleted the "8 predictions" video after "You'll own nothing and be happy" started trending on Twitter. By 2022, the essay was no longer available on WEF's website, and a June 2022 blog post claimed WEF deleted the "you will own nothing" tweet. The "8 Predictions" article itself was taken down from WEF's site around April–May 2023.
πŸ‘3
Thoughts after sleeping on a recent incident where a major bank handed its customers' passports, selfies, and transaction histories to scammers who asked from a government email address. I can now phrase my position even stronger.

TL;DR: The problem is not just what the regulators and the governments are doing, although they are doing a lot. The problem is that they are too powerful, and no one can stand up to them and say "enough!"

This was not the case ten years ago. It was, five years ago already. I've seen it in DeFi / Web3, and it's just too obvious with ordinary banking.

Banks want to do business. It's too good of a business to be a bank. And to be a bank you have to be friends with the regulator. Regulators, in turn, want more and more bank friends, as long as they play by the rules. And the banks do. Of course they do.

What we lack is a force on the side of We, The People strong enough that some bank cracks under the pressure and openly states:

β€’ Screw you, governments and regulators.
β€’ Your rules are NOT protecting the customer, they are making it WORSE.
β€’ You want more control, but it's just PRIVACY INVASIONS, and they WILL backfire.
β€’ So yes, we, bank X, ARE WILLING to serve customers in your jurisdiction.
β€’ But we will open OFFSHORE accounts for them, and ship cards by international mail. Perhaps under different names too, which is perfectly legal: the name on your card need not match your passport.
β€’ Not to evade your rules. To PROTECT our customers.
β€’ And now, dear regulator, PLEASE WORK WITH US. We can help you draft good regulation and establish guardrails, so that no regulator, YOU TODAY OR THE NEXT ONE TOMORROW, could stop putting bank clients' interests first.

There is literally NO SUCH BANK. And this is the problem.

I'm sure tons of founders in banking would LOVE to say this. They are already billionaires, so if such a move had a real chance, I would expect someone to have tried it by now. But the governments and regulators are too damn powerful. Power corrupts, and absolute power corrupts absolutely. When it comes to financial overseeing, our overlords are corrupted.

And I am saying this as an ordinary, law-abiding citizen. I do support KYC and AML. I pass them regularly. I want more people to pass them when buying a house next to mine, a yacht, or a large stake in a startup. Hell yeah, track the source of income.

But the system should be designed bottom up. Not "we, the Regulator, must see everything", but "here is the list of acceptable documentation: provide it and you are GUARANTEED to pass KYC/AML". Tax forms and income statements, for instance. Not one's home address, for God's sake, not one's net worth, and definitely not one's family and family businesses.

A trivial change, really. And finally: make it unconditionally legal to bank in a different jurisdiction. Today, banks in plenty of countries refuse citizens of certain other countries, only because those countries make it too damn hard. It should be perfectly fine, as long as one pays their taxes at home. Fierce competition would follow, and transfers would take seconds for EVERYBODY, because commerce works. Top-down suffocation does not.

The Web3 folks have already built the rails. Seconds-long settlements for fractions of a penny, at scale, with receipts and proofs attachable to any transaction, so that the parties CAN CHOOSE to show them, decrypt them, or ZK-prove something about them without revealing the rest. With an on-chain USD[C] account and Web3-friendly payroll and brokers, one's tax forms are a) fully automatic, b) perfectly auditable, and c) impossible to make a mistake in. Yes, impossible. Some operations, designed right, leave no room for a mistake, and getting paid while the tax authority knows about it is one of them.

We had a chance to live in this world by 2024. Or so it seemed in 2016. We blew it up.

But if enough sane powerful people say "enough!", the tide may well turn. That is what I would love to see, as an ordinary user of the world's banking system.
❀5πŸ‘1😒1
I just love working with modern-day agents, and I found a new pattern I want to share.

Here it is in one sentence: I tell the agent on my laptop to configure a remote machine for me, and then to go do the actual work THERE, inside tmux, driving a second agent on that remote box. The laptop agent sets it up, the laptop agent uses it, and I never touch the remote machine by hand β€” besides creating a mundane, unprivileged user and configuring their SSH access. That, plus the occasional sudo command later on, is the only elevated work that box ever sees, and I do it myself. Everything else happens as that user, and it happens through agents.

Now, the rule above all: my sensitive credentials never leave the laptop, and every single operation that needs them requires Touch ID. Root anywhere, my main GitHub account, anything that can do real damage: Touch ID, every time. The agents' SSH key to the remote box is NOT one of those. That key is free; agents can and should use it as they please, and the worst it gets them is a shell as a user with no root. So an agent cannot suddenly open a root session, locally or on that machine. I would have to be here to approve it, and I sure as hell will not approve a surprise. When something on the remote machine does require sudo, I ask my agents to tell me what the commands are, and I run them one by one, manually, after I authenticate with Touch ID.

Then I add a Host entry for the machine to ~/.ssh/config on the laptop, under a random name that I also save under /etc/hosts. So that ssh something just takes me β€” or my agent β€” straight there. The same entry forwards a few ports, so while a session is open I can hit whatever is running on the remote box straight from my laptop. I tell the laptop agent: this machine exists, this is its name, and these ports are yours as long as the connection remains open. The agent manages that connection while we are working together; not me. When the connection closes, the ports go away, but the work does not: it lives in tmux on the remote box, and the next connection picks it right back up. This, by the way, is something I'm thinking of improving over time, but so far it is good enough and it has not let me down.

And that's where the human part ends. I already have a skill on my laptop that configures a remote machine and its user, without root, into whatever my agents need: it installs the tools, sets up tmux, and copies the logins that box needs, which means the fenced GitHub account from the next paragraph and my coding-agent subscriptions. What the experiment itself needs are the .env files from the repository, and those are perfectly fine to share; that is the entire point of an isolated remote user. My sensitive credentials never leave the laptop. I use Podman instead of Docker to run tasks there. In a few minutes, from a fresh box, it's a beast.

On those coding-agent subscriptions: yes, I log my own subscriptions into that box. It is still just me using them, through my own agent from another machine, and I've triple-checked that this is within their terms. Having to re-log some of them in every once in a while is a tad annoying, but, quite frankly, it's a low price to pay for the productivity boost and for the overall experience.

GitHub is fenced the same way. The remote machine gets a separate GitHub account that cannot push into anything I consider important β€” that would require an approval from my laptop, and my Touch ID, via the Passkey / WebAuthn protocol. It can read the repositories I've granted it access to. It can comment, make commits, and open pull requests. That's it. Merging stays with me.
πŸ‘3
Now the fun part. I take a piece of work that is semi-complete, or not isolated properly, or just too heavy for my laptop. (Yes, too heavy does happen often, I have drained my MacBook Pro's battery 100% to 3% within just ~1.5 hours several times, and I do not like how warm it gets.) Then I tell my laptop agent β€” let's say it's Cursor because it often is β€” "This should be done on that machine, in a different harness. Go there, open a tmux session, copy whatever you need to make it happen. Create the environment from the one in this repository; it's .gitignore-d because it is machine-local, not because it is secret, so you are allowed to share it. Run it there, and tell me how to check on it later."

And it does. The laptop agent SSHes in, sets up the session, launches the agent on the remote box inside tmux, and disconnects. tmux is what makes this work: the remote session outlives the connection, and it turns out remote agents can drive tmux perfectly well via send-keys, so I am just a happy observer here. There is no live laptop session to keep alive and no babysitting. I can close the laptop, reboot it, come back the next day, and ask the agent to check on the work and clean up. It does not drain my battery. It is practically free for the laptop.

What I get out of it: real isolation from my laptop and from my sensitive credentials, because the remote user has none of them. And a setup that is cheap to recreate. Once the work is done, I ask the agent on either machine to document everything and commit it. Then I create a NEW user on that box and repeat the whole thing from scratch, to prove it actually reproduces.

Also, a shameless plug: my Scoped Skills Helper, scsh, is what I use on that remote machine to orchestrate swarms of agents that are run under different harnesses. Different parts of the work are done by different model providers, and I have a complete asciinema recording of every single process, with annotated timestamps of what happened when, and how many tokens each invocation took.

Ain't this cool?
πŸ”₯6
I never thought of this optimization before.

If you need the median number of N runs, just run (N+1)/2 times and take the latest result!

What would I do without the AI?
😁7
Inspired by a recent conversation.

I can somewhat understand copyright on authored texts when it comes to pieces of art, also known as literature. But I can't understand no-AI-training clauses or README demands that models not read the code.

So you are publishing a piece of code that you are not allowing models to train on? And I immediately think of consumer tools, such as CLI / TUI utilities.

Well, if it's useless code, it's useless regardless.

And if it's useful, a *lot* of people are using this code.

It's easy to use programmatically.

It's easy to use when it's run on a remote machine.

It's easy to use when it's 100% sandboxed.

It's easy to put under tmux and asciinema, which I do routinely.

And presumably your tool has decent help. And forums. And tons of data on how best to use this tool, and how it is used.

And then you say "don't read this source code with AI"? Seriously?

It would take single-digit dollars β€” LITERALLY SINGLE-DIGIT DOLLARS β€” to blackbox-sandbox your tool, DOWN TO ALL OS CALLS IT MAKES, and to ask a few AIs to read its help, to read the forums, and to come up with a fully functional demo of the features people actually use.

And then another, I dare say, SINGLE-DIGIT HUNDREDS OF DOLLARS to reimplement those features from scratch.

Without a single glance at your tool's source code.

So, if it's a useful tool that people need, you're just sitting on a ticking time bomb if you choose to sit on its otherwise-open code as a dragon hoards its treasure. The rebuild happens either way; sitting on the source just leaves you outside the process. In fact, everything I'm saying above applies to closed-source software too.

With proprietary, closed-source software, by the way, the difference is enforcement. The same black-box rebuild applies, but lawsuits are only plausible where there's real money on the table; real money that could be won. And a large corporation behind those lawsuits, with an army of lawyers and with tons of money at stake.

But a low-key developer, or a community of low-key developers, who have been maintaining some tool(s) over the years? Sure, you could argue you've invested a few hundred hours into your baby tool; perhaps a few thousand hours. You're not going to court for it. Moreover, you're worth more as the expert who steers the rebuild than as a pile of source code you won't let models read. You can LITERALLY approach big AI companies and offer that expertise.

After all, a great-to-use tool with wide adoption β€” wasn't this what you were working for all this time, as enthusiasts? During "peace times", i.e. assuming there's no "AI war" for training data, who cares about the code, except perhaps security researchers? You built something many people use, great. Now the Universe is offering you a chance to make your own impact larger, by a wide margin. All you need is to say yes and collaborate.

And yet quite a few people choose to turn their egos on instead, and "protect their code" from being "used by the AI to improve". As if they would have protested if some professors had showcased some important concepts to students based on their code or something.

Don't get me wrong, there are quite a few prominent critics of Big Tech. I'm sure I can steelman their arguments too. RMS, for instance, is largely right, IMHO, that the death of truly open software is what created this siloed monopoly-run Big Tech, as opposed to Hypertext FIDO 2.0. But copyleft was about keeping code free to use and modify, not locking it away from machines that read it. And the cypherpunks community, while it has brought many useful tools and privacy wins such as PGP, is largely gone today. So yes, it's not difficult to steelman that criticism.

But why not join forces? Why not view the AI as the force of nature, as the greater good, that we should all collectively leverage for a better civilization? Why instead choose to resurrect the luddites movement and fight against the power loom, or a hydropower plant? Game-theoretically and morally, that's beyond me.
2021: Why can't we solve machine translation?

2026: Wispr Flow is so good at trying to make my speech make sense as text that it literally parsed my three lines long Russian instructions as Ukrainian.

I don't speak or understand Ukrainian. I've translated that resulting text back into Russian. That's exactly what I wanted my agent to do.

"Accidental translation" in 2026 is literally better than bleeding-edge translation in 2021.

Cross-language understaning is a commodity now. It is cheaper to translate in 2026 than it was to understand ΡˆΡ‚ΡΡ‰ΠΊΠΊΡƒΡΠ΅Π΄Π½-ΡΡ‰Ρ‚Π°ΡˆΠΏΠ³ΠΊΡƒΠ²-keyboard-layout text in 2021.
πŸ‘4
I didn't write about this publicly somehow, but it's quite a theme in my private conversations in the past few weeks.

TL;DR: Big AI labs are openly asking to be regulated. Which I personally am reading in one way and one way only. They need a safe way to deflate the bubble.

In other words, they need plausible deniability that "it's not us, it's those darn external circumstances", and that "it's all for the greater good", and "you'll be better off", and "we're saving humanity in the long run".

While in reality the only set of entities they are saving are the AI labs themselves.

The "beauty" of macro-economics, the more I study it, is that the line between "it's the reality" and "it's what we declare to be the reality" is getting more and more blurred as the stakes get higher.

And if we'd be living in the real world we'd be inevitably headed towards an AI bust. "The big AI short" as some already call it.

Will it be good for the planet? I have no idea. But at least it would be somewhat fair. Companies that can show profit will get more investment. Companies that are only chasing the hype would lose out. We'll correct big time and move on.

But the reality does not work like this. As in, the fake, financial reality does not work like this. If anything, history teaches us that financial and fiscal instruments get more and more sophisticated from one crisis to another, such that what's "materially true" becomes less and less, well, materially important.

So it's a genuine inflection point. AI token prices may go down 10x or they may go up 10x. Companies can go bankrupt or create new tillionaires. We seriously can not predict. It's the "generative adversarial reality" at its finest, and, as a mathematical model it does not fail to deliver.

There's one thing I know for sure: the current model is unsustainable. Slowing down AI development and claiming it's Uncle Sam and Co. that were behing this push to slow it down is the safest way out for most powerful parties.

Hence, I'd say it's far more likely than not to happen.

How exactly it will happen β€” I honestly can't predict. We may well find ourselves in a dystopian world where running a cheap model hosted overseas would be subject to 10,000% tarrifs. Or we may well find ourselves in a reality simliar to the post-Covid world, where we just chose to collectively forget the madness we were pushed through.

But to quote Dr. Strange, we're in the endgame. That is, we're in the endgame of transformer-based LLM architecture that required these many gigawatt-years of training and inference. "I saw 14,000,605 futures", and everyone is now trying hard for us all to end up in those two of them where the collapse is not that bad.

And, chances are, they will succeed. At least, personally, I'd bet quite a bit that they will succeed.
πŸ‘6❀2
"People are irrationally hesitant to show their prompts", "do you go back and correct typos in your prompts?"

(c) Peter Steinberger

Dude, sometimes I type my prompts without spaces to keep the room quiet!

Pasting an image and saying dafaq is a marker by which OpenAI and Anthropic can probably detect my presence, and I am not at all shy about that.

And if my keyboard layout is ΡΡ‰Ρ‚Π°ΡˆΠΏΠ³ΠΊΡƒΠ² Ρ†ΠΊΡ‰Ρ‚ΠΏΠ΄Π½ and I notice it mid-paragraph, I would generally just continue Π΅Ρ‰ Π΅Π½Π·Ρƒ Ρ„Ρ‹ ΡˆΡ‹, because why waste precious human time on something agents will handle in a split second with zero effort?

People who hesitate to share their prompts definitely have it backwards. And re. correcting typos in prompts, "ah, it's a boomer thing", as Peter rightly says, and I'm definitely with him on this one.
πŸ‘6😁1
As we discovered today, "please call the manager" when the staff is acting silly is literally the same as turning model reasoning on and retrying the prompt.

The very same prompt in most cases, I should add. Just against a reasoning engine with a larger context window.
😁4❀3πŸ”₯1
Serious question out of the blue: Do we even need Linux for servers these days?

A friend sent me https://github.com/asterinas/asterinas over the weekend. I looked it and could not form an opinion on whether it will or will not fly. From first principles, it should. The reality check, however, is that it's a few years old already, and not taking the world by a storm.

Then I thought deeper. Golang, with all my disrespect to it as a language, is increasingly popular. And it's goroutines-first, i.e., cooperative multitreading is its building block.

Most Rust production-grade code uses tokio these days. Or something like it. So, Rust code is also cooperatively multithreaded by design.

Also, look at Nvidia GPUs. We, the world, have proven that a small set of chips can run the planet. No need in a huge variety. Apple's M1-M5 chips are another proof.

Besides, Google was experimenting with turning old Pixel phones into the CPUs that power a datacenter.

So, compute-wise, do we even need linux? Why can't we take one well-designed system-on-chip ARM, and give it a tiny wrapper on which a Golang runtime or a Rust tokio runtime can flourish?

And it can be a thin real-time OS, which Linux is definitively not.

Seriously, seen in this light, most of POSIX can, and arguably should, be treated as legacy. It's a source of unwanted synchronicity, and it's a source of bugs, after all. A tiny kernel, a blob storage, and a well-optimized async-friendly massively parallel network controller is all we need.

So, from first principles, I can see a competitor to AWS emerging, where at a fraction of cost we can run Golang code or Rust code with increased reliability. The code may have to be implemented to use special libraries, and built with a dedicated toolchain, but this does not appear to be a problem in the day and age of agents.

What am I missing? As in, aside from the legacy "too big to fail" argument, why should we not expect something like this to happen in the next year or two?
❀2
My conversations keep getting to the blockchain. Opinions range from "it's not your money, it's just your turn to use it" to "this house of cards of fiat is inevitably falling". I'm trying to stay centrist. And yet my thinking inevitably comes back to one thing: the blockchain deserves credit where it's due when it comes to hedging against future catastrophes, natural and man-made. Here's why.

The blockchain is real: as real as gold coins, but over the Internet. The famous problem of connecting Web3 to the real world is oracles. Even the US attacking Iran "never happened" for some markets, since the White House did not concede it in the "right" formulations. But with all our governments moving towards more centralized bookkeeping, they are becoming the perfect oracle provider, whether they like it or not.

A trivial example: say, one wants to hedge against a possible wealth tax in the US. There is a real market for this: well over a hundred thousand millionaires a year migrate between developed countries because the rules keep changing.

Say, one wants to protect ~$1M from being taxed just because they own it. Hodl'd BTC, staked ETH, idle USDC, locked in an investment vehicle, nothing sold, no profit taken out. If any government claims a tax on MERELY HOLDING this, it is a new type of tax: not in today's tax code, and one today's politicians say they will not introduce. Our individual is rightly worried anyway, and pays a premium today so that if the bill does come, the insurer covers it.

The insurer has to be very large: a planetary-scale pool of collateral, locked into a contract no regulator can reach. The collateral comes from people who put their money where their mouth is: that such a tax will NOT be introduced. They collect the premiums as interest, and lose the money if the tax does come. The familiar DEX model: a staking pool where people bet in both directions and pay interest to use others' funds as collateral.

How is this not a perfect Web3 instrument? How come no DEX offers one?

The oracle is clearly here. Unlike the bombings, a tax claim is unambiguous. The law behind it can be as messy as it likes; the trigger is the notice: a fixed form, a fixed amount, a fixed obligation to pay. An IRS notice is a record, not a rumor. The person presents it to the contract, and the contract settles. How a filed IRS record gets attested on-chain is engineering I leave out; what matters is that there are no arbiters for a government to lean on, and nobody re-judges whether the tax is fair, legal, or final.

The settlement is blockchain-native; stablecoins are far too government-controlled for that. One contract on one major chain is enough: DeFi can port it anywhere, and the buyer can peg the payout to USD via options and futures if they wish.

These instruments MUST be chain-native. Any government's regulators will seize them the moment it decides, against all promises, to introduce the very tax one is hedging. The contract is bound to no regulation whatsoever. Only to the oracle: the notice the IRS actually sends.

And the deterrence is two-fold. Those who bet on the government keeping its word win, long-term. And if collateral starts leaving the pool and the premium starts to climb, that is a public signal, visible to everyone, that the government is planning something shady.

It's the one means by which ordinary citizens, anyone with any amount of assets to their name, can protect themselves against governments changing the rules. This hedge works without having to leave, and without asking any regulated insurer for permission. Better than physical gold: a private key is far safer than holding something that may be declared illegal any time.

This is my thought experiment. No such instrument exists yet, and ideally we want one. Are there flaws in it? If it does exist, what are the premiums today to protect $1M against each country's potential future wealth tax over ~20 years? But what I'm far more curious about is why it does not exist yet.
πŸ‘3
Is there life after Arc?

Seriously, what do you folks recommend as the browser, as Arc is being discontinued?

I already use Chrome and Brave for other profiles, Arc used to be for my personal GMail. Can't see myself using Safari or Firefox, although I might have to πŸ™

What are good option to consider outside these four? (And outside Dia, of course.)