AI may be a tool and add 50 IQ points to a 100 IQ person today but what happens when its adding 10000 IQ points. The 100 base doesn't quite matter as much does it? What does that world look like?
No, it's not just next word prediction. No you can't just wave your hand that it's probabilistic, so insert bad analogy to compiler or calculator and go about your day. And no, you can't just look at its limitations today, make a conclusion, and go back under your rock.
Presumably there are a lot of use cases that are essentially “solved” where more powerful models won’t matter.
one end is luddites nothing to see here, and the other end is omg humanity is cooked because programming is solved! and consciousness is coding so -> gg
yes there’s a wide surface of emergent behavior we haven’t fully explored, but why do you get the pass to draw a straight line to a conclusion? the naysayers are doing the same thing.
It did replace draftsmen and designers, and changed the work that the engineers do. It's now more efficient to let engineers be their own draftsmen and designers. And design work has changed -- a lot less "hard" quantitative engineering, and a lot more "bureaucracy in three dimensions" as things have gotten more complex.
I realized all this was quite wrong, AI just helps people who already know become more efficient. It just gives confidence to people who dont know anything by the sycophantic nature of AI. AI is just a tool for smart people to become smarter.
Love AI and what it allows us to do. But, it does give some superpowers, but the problems that existed before still do and they need to be solved for. with or without AI.
Because most automations never capture the complete scope of the job/task ( not even close ). Just like neurons, if you don't use it you lose it and when the inevitable problems come, nobody knows the why, the how and the what. At that point someone smart would incorporate all those real costs and opportunity loses on the "automating everything" equation. But they usually don't.
Of course automating tasks is a must, but it's very far from being a black and white situation. These dynamics have been happening for centuries by now, nothing new.
Big companies are always doing bad things, but not because they use AI, because they have legal protections which prevents small companies (which could be anyone like you and me) to compete. The same small companies who could also benefit from using AI.
We are looking forward to bring the same productivity gains to logistics and manufacturing (look at the advancements done in the last few decades!).
Why not bring this to white collar work too? I get so much more shit done today than I did a few years ago. It's a great time to be alive!
Think about all the security clearances no longer required to aggregate big data into intelligence reports. The conditions and incentives for LLMs seem almost laser focused on replacing those particular jobs.
It wasn't but ~20 years ago that people were concerned about Google slurping up all the world's data into spying programs. Now that the hardest part to hide is happening, people have forgotten or assumed it already had. Many other smaller and far less capable businesses have come and gone and taken tiny bits of blame until the public was satisfied they knew who the "real" scapegoats were. What they really had were overcomplicated theories built on a nebulous cloud of debatable evidence that led nowhere. This is how it succeeds in plain sight every time.
Instead, you can and probably should see technology as augmenting you and your coworkers.
My in laws smugly asked me what I would be doing for work since AI would take away all the programming jobs and I said its not gonna happen and they laughed in derision.
Some people who "used to love programming" have jumped ship for precisely this reason. Ordinary software (not R&D) is getting serious. A broken or disagreeable app is no longer a mere inconvenience. There is growing alignment between business and politics and the older generation is retiring out.
So, today, if I think really really really, and I mean, really fucking hard about that “number”, I really really really come up with a number close to 1 (we need one person to type in the instruction at least, maybe two? Maybe three? Definitely not a team … no not that at all).
That means, for everything that we build today, before we even build it, we’ve already mentally replaced people. People be replaced yo, in your mind, in your company, in your reality. That’s it.
It’s a replacement, not a tool. And if you reaaallly think a bit more, you’ll see that it is truly the stupidest possible thing if in your scoping of what needs to be built, you didn’t scope out people. You’d have to be crazy not to scope out people.
Trust me, I never thought we’d get to this point either. I thought it was going to be an “assistant” too.
—-
The layoff numbers still look “normal “ to us. 75k here, 20k there, all numbers we’ve heard before. It hasn’t even really happened yet, the true numbers should be in millions. I didn’t believe the number “trillion dollar company” until, BAM, here’s a trillion dollar company.
Best we can do is kinda get used to the numbers, like the number 0 on one end (how many people you need), and some number N (in millions) that we won’t need anymore. We’ll just slowly get used to these new numbers.
This shit ain’t no tool.
One programmer can know if the program is right. So N additional programmers, in that case, can truly be replaced.
I can know the SQL query came back right, I can know the drop down menu looks right, you know what I mean? I can even know if it’s any good. [Person .., ] of Type Y (let’s say Y is “programmer” for now) can be flattened down to 1 in that case (we no longer need the full array of people of a certain type anymore, just the one). Over time we’ll see all different “types” get collapsed down.
False, Anthropic didn’t claim what was linked in the article.
> OpenAI CEO Sam Altman speculates that enough AI compute could help figure out how to cure cancer
Idk likely true? What’s so wrong here.
> Elon Musk says there will be no need for compilers as AI will write the binary directly
What seems so off about this? AI can write binary and probably better in a few years. Higher level languages would still be efficient probably.
> Anthropic claims that Mythos is super dangerous, the people can’t possibly handle such a powerful cyberweapo
Well it was?
Assuming you mean an LLM, you'd have to train this LLM entirely on a parameter space of binary tokens. Or are you saying the LLM generating natural language tokens is going to be printing machine language in 3-5 years, because that claim kinda betrays a misunderstanding of LLM functions.
I assume that "AI can write binary" means "AI can use a toolset that results in a binary" because we've already seen GPTs use a combination of LLM and specialized math tools to do the things the original GPTs did.
Wouldn’t that make the AI the compiler?
We have no viable mechanism yet to get the same level of confidence if some LLM-based system writes the binary.
Perhaps we can get to a system that produces not just the binary but also a machine-verifiable proof that the binary implements some higher-level language description of the program.
Though then the question will be whether we've gained anything, or whether we've just replaced the compiler with something massively more expensive that does the same thing.
There's some potential here for the LLM-based system to drive better performance optimizations than a regular compiler could.
Of course this isn't what Elon is actually saying, and we'd be better off if fewer people listened to him.
We don't even have a solution to the halting problem, and it probably can't be solved. "Proof it implements a spec" is pure science fiction.
Hard agree that we'd all be better off muting Elon Musk though.