Honestly both of them have demonstrated that they have little interest in AI. Intel gave up on Optane right as (a much-improved successor) would've helped with MoE offsetting or even as a highly durable drive for KV caching.
AMD have... turned out some decent gaming graphics cards and fine server CPUs but little else.
People are out there solding SMDs on old Nvidia mining rig GPUs to use them for inference; their hardware is not depreciating at the normal rate you'd expect from GPUs. DGX spark is finally useful now that AI can write multi-machine inference tooling optimised to it. Where's AMD in all of this? Nowhere.
The rule includes >90% of "remote" workers who have discovered they were classified as hybrid (a classification now eliminated) and their manager didn't make it official. Now, remote approvals are SVP level.
The issue is, AMD still pays significantly less than any company with an RTO mandate, even with the stock appreciation. And the stock has gone down 25% in the past few weeks so it's even less competitive. The typical engineer was not given an equity-weighted package, even L9 only 30% of your TC is in stock.
It's a recruiting bonanza right now and everyone's getting calls offering 50% pay bumps from 5-day office semi corps like Broadcom or Qualcomm. The better people are getting offers at Google or Apple for 3-day RTO for even greater TC bumps.
The board should've sacked the entire leadership team of Intel and AMD years and years ago.
The fact that you can sit through both a mining boom and now a generational AI boom and have little to show for it and still keep your job is a Yahoo!-level fumble.
It never made sense. It's slower than RAM, and what do I get for it? Persistence? I don't want persistent RAM, I like the ability to reboot to solve problems, and storing stuff on a non-volatile mediums has all sorts of legal implications which it's easier to avoid.
It's more expensive and has less storage than SSDs, even though the main downside of SSDs is their high price per gigabyte and relatively low capacities.
It's going in the wrong direction for both use cases. I guess it could have a very niche use case as a super fast persistent caching layer in front of spinning rust but that's kinda it.
Optane had much lower latency than other types of durable storage, and also had very good endurance compared to NAND.
At a prior employer, we made extensive use of them as ZFS SLOG drives for large database servers. They made fsync very inexpensive.
There's an argument to be made for the persistent memory being a cheaper substitute for more RAM, but imo the gap isn't big enough to justify it when considered as a % of the rest of the system you're building around it and the performance tradeoff.
Important reminder to check your biases. I was sure Optane had missed its mark by dropping out just before LLMs became a primary use case for high $ systems.
Density. PCM is closer in bits-per-unit-area to Flash than to DRAM.
SSDs are good, but an improved Optane would've been better.
If you wanted a GPU with 32GB of memory for AI tasks, the AMD AI Pro R9700 was (up until about a month ago) reasonably priced at ~$1300. It's not a RTX 5090 in terms of bandwidth and compute, but for the price and being actually purchasable it's a reasonable pick.
Those cards are cheap because they're not really that amazing.
Intel finally has really great low power/budget answers, but still loses greatly to 3d cache chips on most workloads.
AMD has always been an also ran in this space and it shows to this day, but the true believers cannot be dissuaded of their faith so whatevs.
I honestly think Nvidia needs a worthy nemesis right now more than ever and I wish it existed but I don't think it does... Yet...
that's quite a large market and their only competitor has moved on to greener pastures.
They're around, selling AMD Strix Halo (up to 128GB unified memory) on the low, equivalent to DGX Spark, level; and MI* chips for enterprise AI inference.
The problem they have and they've always had is that everyone uses CUDA. ROCm works, but everyone's toolchain is CUDA exclusive or CUDA first, so it's much harder to use AMD hardware.
Using higher level tooling (vLLM, llama.cpp) I have DGX Spark comparable performance for 1/3 the price (but without the same software out of the box experience nor the clustering network options).
Optane really died before LLMs went big. I was at an enterprise using a TON of them, often for SAP HANA workloads.
> AMD have... turned out some decent gaming graphics cards and fine server CPUs but little else.
I'm on a AMD desktop, using an AMD gpu, next to a gaming console using an AMD CPU and GPU, making large DC purchasing decisions where intel hasn't even shown up as a factor.
> And honestly, "Intel's shambolic efforts" alongside "AMD's Road to Damascus moment" is rather delicious phrasing. The author has managed to deliver quite a sophisticated insult in a single sentence.
But surely intel services are smart enough to get people in there illegally.
Turns out it was a front for Russian intelligence. Even after the German government found out, the guy still somehow escaped to Russia. There’s a solid chance that Russia operatives have infiltrated the German government. They was even a big hack Russia’s state hackers did and a lot of information was leaked.
I bring this up because Hetzner was asking for my passport to buy a $10/m server. Simple opsec says to just pay a bit more and use DigitalOcean or some other VPS.
There are many good non-Hetzner European hosting companies, luckily.
Wirecard were a German fintech, but didn't have big market penetration across Europe. They were a real company with real operations, but a decent part of its balance sheet was fake (supposedly it was in an Asian subsidiary, there was no money there). It wasn't a front for Russian intelligence, it's COO was a Russian operative (and nowadays runs a shadow intelligence agency from Moscow, using incompetent morons to try to kidnap journalists, or scheming to hire ISIS suicide bombers to blow them up); those connections only surfaced after the whole thing imploded. But the whole company was an actual real place with real operations and real non-russian intelligence employees. It's still not certain if the CEO knew about the COO for instance.
Read the FT series on the whole thing, their investigation started the collapse.
†Disclaimer: I own an Intel Arc GPU
In the last few years Intel's division that makes Xeons had huge losses, because in order to retain their big customers they had to accept to sell at big discounts, otherwise the customers would have switched to AMD.
All has changed this year, due to the AI craze.
AMD has sold all the server CPUs that it could make, within its allocations at TSMC. Everybody who did not succeed to buy EPYCs has bought Intel Granite Rapids Xeons, because they are not made at TSMC, but in Intel's fabs, so they did not compete with other TSMC customers for allocations.
So Intel has also sold every server CPU that they could make, and they are now trying to retool some fab that made new Panther Lake CPUs back to the obsolete Intel 3 CMOS manufacturing process, in order to make more Xeons, to sell them as long as this huge demand persists.
Thus in the last quarter both AMD and Intel have sold less consumer CPUs than in the past, because all who could did delay their upgrade plans due to the unacceptable memory prices, but on the other hand both AMD and Intel had record revenues and profits from selling server CPUs.
Or if Intel and AMD GPUs had to compete with Nvidia GPUs ... wait, they do, and they are absolutely losing.
Before the 10nm issues, they were making consistent IPC improvement every generation, and although core counts were pretty stagnant for consumers, they would add a couple cores every generation on top Xeon skus. Maybe they could have done bigger changes with more time between, but it was nice being able to expect new server CPUs every 12-18 months that were meaningfully better.
Krzanich "optimized" the company for profit, by cutting out things he considered to be excess. Including a lot of their irreplaceable validation & verification talent, that AMD instantly snapped up. The lack of validation resources is directly responsible for the failures of many key Intel products during his tenure and later, because major bugs that could have been spotted earlier slipped through, and then resulted in horrible delays and even cancellations. He then spent the surplus of the company on 30 major acquisitions, of which only two were in any reasonable degree successful.
There are CEOs who have destroyed more value than Krzanich, but not many.
Intel stopped advancing in 2014-2015 for a long time. They flopped on the fabrication side, they stuck to the 2-4 core CPUs and charged an arm and a leg for anything with more than that. This gave AMD an opening with their cheap and yet still decently fast higher core count CPUs.
Intel has been chasing higher and higher core counts which look good on spec sheets and dazzle in rarely utilized workloads, but said core counts do nothing to run the apps and games that most people actually use. I think getting dumped by Apple broke them, they're competing with Apple on paper and AMD is eating their lunch in reality.
They also stopped making 3D XPoint a year before AI would have bought all of it.
Sure, but its not like people were actively seeking that GPU, for long time it was the only option to get in a laptop that isn't 20 pounds and 18".
Micron wanted to sell the fab that manufactured 3D XPoint.
First it was virtualization instructions, then AVX stuff
The truth is this is more of the same tech inflationary pressure driven by AI. AMD is winning for showing up. Don't get me wrong, AMD does have technically superior products for specific applications, but that never really mattered.