131 comments

[ 2.6 ms ] story [ 218 ms ] thread
>With the announcement from Marvell's exit [1] of ARM Server CPU it is now all but confirmed that Microsoft and Google are also working on their own ARM Server CPU.

I just wrote about that [2] few hours ago before this news pops up. Even Microsoft is abandoning the WinTel Alliance. I know there are still long way to go before the dismissal of x86 / Intel. On one hand they deserved it, for pathetic management in a hyper competitive market. On the other hand I kind of feel sorry for them. Seeing the Giant falling.

[1] https://www.servethehome.com/impact-of-marvell-thunderx3-gen...

[2] https://news.ycombinator.com/item?id=25471116

Is there a world where Intel basically admits defeat and tries to become a major ARM player? If not Intel, some other company? It feels a bit weird that many different companies are designing their own bespoke chips. I can see how the biggest companies may have this expertise. But for everyone else, shouldn't there be someone they can purchase these Apple-like chips from? Maybe that company already exists?

Or maybe there's something about full integration that makes a custom-designed chip just so much better than a more general purpose chip?

But for everyone else, shouldn't there be someone they can purchase these Apple-like chips from?

For servers there's Ampere and Nuvia. For ARM PCs I think Qualcomm/Samsung/MediaTek/etc. could easily build a pretty good SoC if there's obvious demand.

> For ARM PCs I think Qualcomm/Samsung/MediaTek/etc. could easily build a pretty good SoC if there's obvious demand.

No they couldn't. I mean, not from a technological point of view, there's nothing holding at least Qualcomm and Samsung back.

The problem is the software side. Unlike Apple, all three are used to dumping layers of bullshit upon fossilized bullshit and then dropping that off to customers hoping no one notices that the kernel version is years old, the kernel sources and the entire BSP are nowhere even close to upstream Linux quality - ever seen Mediatek leaked Android kernels? Stay far FAR away if you value your sanity, and the others aren't better. Security for all of them is an afterthought.

Apple created everything from scratch, with security in mind. I agree that Apple ain't perfect either, but... the iPhone 4S was released 2011, it took eight years until the checkm8 bootrom exploit was found. The Android world doesn't even come close.

Does Surface have layers of bullshit upon fossilized bullshit?

The software for ARM PCs is Windows. All the SoC vendor has to provide is some UEFI drivers. Linux will survive on reverse engineering since ARM PCs will have no Linux BSPs, not even shitty ones.

> Is there a world where Intel basically admits defeat and tries to become a major ARM player?

These major strategy shifts require enormous courage, support and trust at the executive level, because they represent cannibalizing an existing (real) part of the business for the promise of future profits in a business that does not yet exist.

Kodak is a textbook example. Execs refused to pivot to digital cameras and associated products, because this would compete with the enormously profitable (and internally powerful) film business.

Kodak was a chemical company, not a camera company, and the problem was not so much that it would compete with their film business as it was that semiconductors and electronics are a very different business. It's one thing to pivot a startup, and another to pivot a beheamoth like the company that Kodak was. And transitioning from one industry to another is a much bigger deal than transitioning from designing x86 CPUs to ARM CPUs.

In hindsight, yes, it was a mistake. But it's a very understandable one.

People are overreacting here. Intel is still very dominant in both desktop and server computing. Even if they continue screwing up at the rate at which they are right now, a complete reversal in their fortunes is like 15-20 years out, if not longer.
No. AMD are outcompeting them on x86 on desktop, server and laptop. Cloud vendors making and pushing their own Arm CPUs, Apple and MS with their own laptop / desktop CPUs.

If Intel can avoid a collapse in market share over a five year horizon they will have done very well.

What might save them is a major issue with TSMC (possibly a political one).

Where are the numbers to back that up? Intel has a >80% share in laptop and >97% share in server chips. The only place AMD is competitive is high-end desktops, and there too Intel has 60%. The only big blow to Intel so far is the loss of Macs, but Apple's overall market share in that space is under 10%. Sure other vendors (including cloud providers) are starting to roll out ARM offerings, but it's very early to say whether they will be successful, let alone dominant. Remember that Microsoft already tried and failed once with Windows RT many years ago.
I've seen businesses before where everything seems fine (from the numbers) and then suddenly the structure of the market changes - be it 'disruption' or something similar. Remember Nokia? Intel looks like its in precisely such a situation now:

- AMD is as good as or beating Intel on performance on server, desktop and laptop (not just desktops).

- Apple (and now MS) looking to control CPUs in their laptop and desktop products and producing Apple has a superior product as a result.

- Nvidia will soon own Arm and will be pushing it's own Arm CPUs.

- The cloud vendors all the see the (price) advantage of Arm based CPUs and are starting to promote them.

- Even a startup like Ampere can produce a product that is competitive with Intel.

That's a lot of competition.

Add to this that Intel is still having process problems.

So on a backward looking basis all looks fine. Looking forward not so much.

Yes and there are businesses where everything is looking fine and it continues to stay fine. There are plenty of historical examples for every single potential scenario. And if you really feel strongly about it then Intel is the perfect shorting opportunity (currently valued at $200B). Clearly the market still has some confidence.
You've not given any reason why Intel will fend off AMD, Apple, Amazon, Nvidia etc.

And the market has exactly the same concerns as I do. Intel has a P/E ratio of less than 10 with strongly growing revenue and eps (even boring old IBM and Dell have much higher P/E ratios). Why? Because the market has no confidence it can sustain these earnings over the long term.

EDIT: From Motley Fool

> Once the head of the pack in computer processors, Intel (NASDAQ: INTC) is coming under serious attack in its core business. Rival big tech companies are opting to develop their own chips, with the latest being mighty Microsoft (NASDAQ: MSFT). On Friday's news that Microsoft is doing the go-it-alone thing, Intel's stock fell by 6.3% on the day.

Yep I remember Nokia, I still use their phones (now running Android), they own Bell Labs and Lucent nowadays.
Looking backwards, everything is great for Intel!
Yes there is still a long way to go, but not 15 years....

50% of Server Market is HyperScaler. That is a possibility of nearly half of Server Sales gone. 97% number is no longer accurate as AMD has gain some ( rather small ) market shares in terms of revenue. But Intel is still >90%. ( In Revenue, not Volume )

In the short term most hyperscaler are only going to be switching may be around 50% of their infrastructure, since x86 will still be in demand. But the trend is set and there are no reversal. And Server Segment is the most profitable segment. That is 25% of profit gone in the short term.

And if you now include AMD for the remaining x86 market, you are looking at another reduction. Depending on how AMD is executing ( Which in my book is not nearly good enough on their Server Segment, mainly due to conservative planning for Capacity )

AMD is also for the first time in history really competing in Notebook market with their APU. They have a lot of lessons to learn with regards to working with Notebook manufacture. But again the numbers suggest AMD is making lots of inroad, holding back by capacity again.

You then have majority of the volume driven by OEM and Business usage. These CPU are low margin business. But AMD are not interested in those, and Intel needs those to fill capacity, so they are fine.

So in the next 5 years you are looking at roughly 25% reduction of profits or revenue. Now of course Intel are making their own GPU and are expanding into Network and SSD. And more importantly the market for both PC and Server is still expanding. Which means despite having a lower market share in terms of percentage the revenue number may not be as bad. But again, there nothing even on paper that suggest Intel could change its course. They couldn't even give a valid argument in Investor notes or Technical Forum meetings to clam the market.

Intel is definitely in trouble but five years way too fast of a prediction, even assuming Intel is utterly unable to do anything in the interim.

Take AMD. AMD doesn’t have the volume or capacity with partners like TSMC to produce at the rate Intel does, even if demand justified it (and I’ll go on record and say there isn’t demand for AMD chips that will match demand for Intel chips across segments and there won’t be for five years, to use your timeline).

Intel is truly on the ropes and is getting screwed on all sides, but AMD is less than 1/10th the size and in this sort of commodity market, size absolutely matters. AMD can’t reliably take the sorts of orders Intel can. It doesn’t have the clout or cash flow to buy the wafers. It doesn’t have its own fabs and is fighting for space and resources against Nvidia and Apple, who are both larger.

It’s great AMD has had such a resurgence (I’m a Mac user but I’m finalizing a build on the first AMD system I’ll have owned since 2003), but they aren’t a real factor in Intel’s decline, outside of adding to the narrative of all aspects of Intel’s business being challenged.

Apple is a threat insofar as it shows the limitations of current Intel hardware, but outside of smartphones, it doesn’t do the volume to pose a real challenge for many of Intel’s markets. Apple isn’t selling into the same places Intel is and across the spectrum of requirements and it is a vertically -integrated company who wants to sell its hardware, software, and services. Apple doesn’t want to sell into the data center (the recent AWS deal proves that very clearly). It’s similar for Amazon. Amazon having its own custom chips for certain workloads doesn’t change the fact that most of AWS’s millions of servers are and will continue to be Intel. Could that change long-term, sure! But it’ll take more than five years for them to get to a point where they can produce those chips in a volume that could match Intel (assuming Amazon even wants to be in the business of making large volumes of its own processors).

Intel is facing massive challenges that will likely be most visible several years from now, and I’ll go as far as to say that the company is wounded right now in a very real way. But economies of scale and R&D cycles necessitate that we’re not going to see a collapse in market in five years.

The theme underpinning this comment is that the competition can't scale up - which is effectively a view that TSMC can't scale up and indeed TSMC is the big risk in this hypothesis.

But TSMC has scaled up quickly before to produce 200m+ iPhone CPUs. And the money is there - Amazon, MS, Google, Nvidia and even AMD are not exactly paupers.

As I've said below Intel's P/E ratio is less than 10. That's extraordinarily low for a company in this market with growing revenue and eps. Clearly the market agrees with me that Intel can't sustain these earnings even over the medium term.

>It doesn’t have the clout or cash flow to buy the wafers.

They definitely have the clout, and the volume. TSMC's limited capacity and Apple's ability to pay top dollar is their only real limitation.

I saw this play out 25 yrs ago with workstations. I remember a friend working at SGI telling me that while PC graphics cards were getting better, they would never be as good as the integrated solutions in their workstations.
This is not about the ISA - it's about margins and the business model. CPUs have become a commodity and Apple, MS etc want control for lower cost and with the best (TSMC) process. Switching to Arm doesn't solve any of that.
> I kind of feel sorry for them

Me too. Except they really did deserve it but not because they could not compete, but because instead of trying to help board manufacturers making better computers they sued them.

Nvidia made an awesome chipset with a mini cpu made to handle basic instructions and used intel cpu for the high end computation. Intel sued them for not using their own Chipset.

The nvidia chip was a power saver in 2010. And it was the best of both worlds. Zotac put together their chipset and board into a mini itx pc. Fabless. Playing 1080p video.

That was the height of innovation and intel tried to keep a clamp on the market for fear of losing it.

And maybe that is the bottom line. They knew their product was dying. Their market was no longer going to grow. So they followed the 40% rule. And tried to milk the market as much as they could.

Source. https://www.zotac.com/us/product/mainboards/zotac-ionitx-t-s...

https://www.wargamer.com/articles/intel-sues-nvidia/

I have seen Intel from both the technical side and the customer side. From a technical perspective, they are solid, diligent, but slow. They used to do a lot themselves, including IP blocks, simulators, timing tools, etc. I believe they are trying to adopt more modern design flows to keep up with the rest of the industry in terms of costs and schedules.

As a customer, I tried buying compute sticks in large quantities (i.e. 1000s) from a distributor but they would not extend pricing discounts until Intel approved them. In order to get approved, I had to take online training classes and quizes Intel offered. It was insane. No other company I dealt with required anything like that. I spent hours doing online training on their solutions and never was able to arrange a single discount. Finally said screw it and went with a different solution. Hands down the worst company I dealt with.

Silicon is going to be the most significant moat there is. You'll either have companies which master it and can adapt it to their stacks (mobile, laptops, servers) - or companies lagging behind feeding on the leftovers and racing to the bottom. This is the final frontier, in a way.
Wasn't this the case for IBM and then clones came out? What's different this time around?
IBM didn’t have its own silicon in the PC; it picked bog-standard parts to get to market fast.

Having commodity hardware meant anybody could buy a motherboard and parts to build a competitive computer.

What is different now is that the big players try to de-commoditize the hardware.

Result is that you can’t build a competitive hackintosh anymore, as you cannot buy the M1 chip (you can still build a x64 hackintosh, but even that is getting harder, with Macs having various custom chips)

If enough other large companies go the same way, there might eventually not be enough market left to warrant development of competitive commodity parts.

Actually it was Compaq that did the trick, had their reverse engineering been considered illegal and there wouldn't be any clones to start with, regardless of being commodity hardware.
They de-commodotize because that’s the only way to remain competitive. Power efficient SoCs are the way forward as Apple shown with the M1.

Likewise a Graviton with hardware acceleration specifically addressing AWS tasks can break through existing performance barriers.

In those times, CPU compute power was the defining limitation. Nowadays, even dirt cheap chips offer enough grunt to get many things done, and the majority of the focus is on performance per watt. And this is where x86-derived designs are at a genuine disadvantage.
30 years ago there were loads of companies making CPUs, most of them have disappeared.
That’s exactly what I thought about after writing my comment but I think this comparison is flawed.

The battle of 30 years ago was a battle of ecosystems more than of individual architectures. The market went into consolidation around Wintel and later Linux on the server side.

The market today is orders of magnitude larger and supports multiple ecosystems at different tiers - mobile, laptops, workstation, servers.

Platforms which will not adopt complete vertical integration all the way into their hardware will lag behind.

The other thing is that now, binary compatibility is pretty much preserved and lots of software parts are shared across these platforms. It’s not fragmentation like DEC vs IBM vs Sun vs SGI.

So, we're going back to the days of manufacturers having a completely custom software/hardware systems, one step at a time? Yes, ARM seems to be the standard, but once you start customizing, how long until Apple or Microsoft start making portability very difficult?
Apple making portability difficult, yes... Microsoft? I cant see it... Windows has been able to run on x86/x64, ARM, MIPS, Alpha, PPC and more since the beginning of time (well, NT4) and granted, they haven't released a lot of that code in a while, but i would guess its still there... remember, xbox360 was based on PPC...

Also, given they sell an OS to other manufactures to install on their own machines, they are going to keep that running for a while. Same with servers... Even in the Azure side, they are allowing enterprise and OEMs build Azure Stack. I cant see them locking it down... But Apple? yes... its already locked down...

Apple (M1) and Amazon (Graviton) are already out there marketing how great their chips are for various applications. They're not saying "ARM chips are great" they're saying "Apple silicon" or in the case of Amazon, "AWS Graviton processors are custom built by Amazon Web Services using 64-bit Arm Neoverse cores to deliver the best price performance for your cloud workloads running in Amazon EC2".

The thing to worry about is not them "locking it down" it's that they're building custom hardware that you can only access by renting cloud computing (EC2) or buying a complete machine (Apple).

With Graviton, it's really just try it for your use case, see if it's cheaper.
All their managed services will be running off them in time
I think its just the beginning. They are testing the market for their own silicon and reception from market. They are also going to need a userbase for Graviton products as well so portability in the beginning is important. This is true in any product. In the early days, increase market and mind share. So you need to make it as easy to adopt as possible. Then, add differentiation, so you product stand out from the others to continue attract users. Then slowly add some barriers for people to leave your product for a competitor's product. You want to increase moat and protection against competitors.

I don't think Amazon will throw in the resources to build a chip just to offer cheaper prices than competitors alone. Pretend you are Amazon. Remember, the cost of building a chip is similar between you and another guy. And if you are getting less return on investment compared the other guy why bother? It has to be that getting into chips will give you more return on investment than the other guy. But return on investment comes from many forms. For example, using graviton to run VMs is cheaper and leading your customer to use AWS more and less likely to leave AWS is another form of return. In this strategy, you need to build up the barrier for customers to leave. You could do it by making the stuff customer use with their VMs have lock-in effect, for example databases or storage that only runs or works better on AWS. Or you can directly make sure things customers run on Graviton cannot be run on anywhere else.

By the way, a better hardware performance is hard to maintain. If everyone uses the same instruction sets and the same manufacturing process, the only way you can be faster than the other guy by better circuit design. But there is only so much you can squeeze out of a circuit design and its really hard to maintain a sizable lead for many many years. Look at how AMD designed a better circuit and Intel's competitive position is gone. Changing the way software interact with the hardware is next easiest thing to do, and especially easy if you have a lot of leverage over software, OS, APIs, programming languages and developers. Basically what companies like Amazon, Microsoft, Google and Apple all excel at. See the addition of matrix operations for ML significantly increased performance. And how Apple can use their control over iOS APIs to build CoreML, get developers to use it, and have add special instructions and function blocks to their hardware to accelerate core ml. It will be interesting to see how this develops, but it would be only natural for these companies to explore this direction.

But they will not necessarily want to pass on all the savings to their customers. They may be cheaper on the price list, but that also reflects greater risk in using a less familiar platform.
Yeah, that's it. I would consider buying an A1 if such a thing were possible. But I'll buy AMD and build a desktop even though that's not ideal when I travel (I'll have to downgrade to my old MBP). But if I buy a system I want to run Linux for work and windows for games. Apple and I will just never get along if they can't open up their hardware.
Further, Microsoft will be incentivized to sell their chips to Windows OEMs. Because Microsoft makes both the CPU and the operating system, they'll be unparalleled integration and optimization between the Windows OS and the silicon (this leaves Intel and AMD at a huge competitive disadvantage)

I doubt Microsoft will lock out Intel or AMD, but we could see certain Windows features compatible only with Microsoft silicon.

If? They already do. Why is nobody aware of the surface pro X?
Sorry, I meant to say if MS makes Surface CPUs and licenses them to OEMs. I'm aware of the Surface Pro X. Edited my comment accordingly
ARM is far less of a standard than the x86/PC ever was. There are countless ARM SoCs out there with zero public documentation, and while x86 has grown its share of secrets, the heritage of backwards compatibility means a lot of things remain the same.

(Incidentally, this is why I see efforts to remove backwards-compatibility from the PC as a hostile takeover and closing of the ecosystem.)

x86 and the platform around it didn't become a standard, it was _made_ one. The standard platform for PCs is WHQL Testing:

https://en.wikipedia.org/wiki/WHQL_Testing

The only way you get a standard like that is if a really big player, in this case Microsoft, steps in and sets the rules and does the work. It's not like backwards compatibility had enough inertia to do this without having someone set the standard.

It's not like backwards compatibility had enough inertia to do this without having someone set the standard.

No, the PC/AT was the de-facto standard and that came long before WHQL or anything else from MS.

For Apples previous transition, 32bit to 64bit Intel, there were seamless universal apps made with the lipo tool, or Xcode config. It sounds like the same is still possible with an intel+arm binary.

Microsoft have considered their arm desktops as less serious than the others? If this new arm chip is meant to be an intel challenger that lower status must end. Universal binaries solve that too.

Apple has a much more ‘my way or the highway’ approach to its developer community than Microsoft.
I think you're right. The economic incentives to differentiate their offerings are too strong to ignore. I predict it will be death by a thousand cuts, but by the time we're talking about AWS Graviton v7 or whatever versus the equivalent Microsoft and Google chips they will have diverged significantly. Enough that workload portability will not be trivial.

Just look how hard it is to migrate a significant application from Oracle to SQL Server or Postgres. It's easy for a trivial application, but there are lots of things to trip you up if you're migrating some big hairy complicated application.

I'm not looking forward to platform balkanization again. I guess the web at least works everywhere. Sorta.
In the article, the source suggests Microsoft is exploring the idea of designing CPUs that could end up in future Surface devices. Certainly this makes some sense for the Surface Pro X, which is their very unpopular, poor-performing ARM device. And Microsoft has partnered with AMD for lightly customized AMD Ryzen APUs for their Surface Laptop. But Surface devices are a very small slice of Windows devices sold, because they are "premium" devices merely showing off what can be done with some integration between hardware and software. Most Windows computers are sold by HP, Dell, Acer and other smaller players. And most of them will be choosing between AMD and Intel for the next several years, at least, unless someone surprises with a high-performing ARM chip (and Microsoft fixes x86 emulation performance on ARM.)
> And most of them will be choosing between AMD and Intel for the next several years, at least, unless someone surprises with a high-performing ARM chip (and Microsoft fixes x86 emulation performance on ARM.)

Crystal ball tells me that someone will likely be Microsoft. If Microsoft has high performance Surface chips, there is little in the way of them licensing it to OEM partners. Intel, AMD, Qualcomm, etc... won't be able to compete with MS, due to the vertical integration between the Windows operating system and Microsoft silicon.

Microsoft can't do vertical integration right. It's not a part of their DNA.
It certainly didn't seem like it in the Balmer era. Today though? Officw 365, Azure AD, Microsoft (VS LOCAL) Accounts half forced on consumers indicate to me that times might be changing for MS.
I wonder if Microsoft could gain ground on hp/dell etc by offering something new in terms of vendor management,device management, and maintenance. For example by offering laptop's on Azure with next day delivery. Vertical integration could make a lot of sense for that.
Do you see Nvidia offering ARM based CPUs in the near future? And maybe a complete unit with a CPU and dGPU along with unified memory?
That has to be the shot, right? Why else would they have bought ARM?

Imagine this: stick an M1-like CPU and GPU combo on a PCIe card. Run the games entirely on the card, using the host system as merely a way to provide data to the card. In one shot, you murder the AMD and Intel processor market - everyone can just buy the cheapest model and still play games, saving their money for the unified GPU/CPU board. It also paves the way for eGPU products for laptops becoming more mainstream, and could work towards a play for the Shield to become a console competitor (if cannibalizing their existing console business is worth it to them).

Aren't you just suggesting "big Tegra"? If the host PC isn't providing anything but maybe storage and networking...why not just buy a console?
A console with upgradable CPU/GPU.
So they'd have to be socketed? That means no HBM, which seems unfortunate. (If you mean just replacing the entire card... why not replace the entire console? All you'd be getting from the host system would be power (probably as 12V, so you need several DC/DC converters on the card), storage, and networking - besides storage, all of these are commodities; and for storage, existing consoles already support swapping drives out just fine.)
Nvidia has been offering ARM SoCs since 2008.
NVIDIA has multiple generations of ARM SoCs. All of them are focused on GPU performance, though.

Also NVIDIA quit the mobile market a while ago. They are focused on Autonomous driving and embedded market. The only consumer product on the market with NVIDIA SoC is Nintendo Switch (which sells millions)

Everything old is new again right? IBM, DEC, HP all built their own chips as part of their development. That got eaten alive by people like Sun and Apollo who started building workstations on commodity microprocessors, which got better and better so that even the "toy" computers (which is what the IBM PC started out as) became capable of eating their lunch, so they moved "into chips" with SPARC, PA-RISC, PowerPC which forced Intel to abortively try Itanium except that AMD kicked them in the nuts with AMD64. And that was where we lived until the computer architecture "for the masses" became the phone, with ARM chips and they started trickling down into the masses, and then Samsung and Apple started pushing advantages because they could customize their SoC chips and others couldn't, and all the while Intel kept adding specialized instruction sets to try to hold off ARM and AMD from their slipping hold on the Data center and what was left of the "laptop" business. Intel won some small battles in the "ARM Laptop" wars, with Microsoft's limited support for ARM applying pressure and Google's largely unsuccessful ChromeOS system of Chromebooks. But then Apple started making waves with their "tablet" the iPad and iPad pro and were getting margins that the laptop folks could only drool over so laptop makers started making bespoke chips to "up" their game like the pixel / pen processor in the Surface line. And as the iPad and the Surface and the other "ultralight" tablettops collided with overlapping features Apple went ahead and did the unthinkable and put a bespoke CPU into a laptop, and somehow once again managed to pull of huge margins.

That pretty much sealed the deal for any serious laptop makers and now we've got Microsoft embracing "alternate" instruction sets, Amazon embracing non-Intel data center architectures, and Apple out competing with a bespoke CPU in a bespoke laptop form factor.

<opinion!> Intel is toast. (if you were still wondering) Which truly sucks because you really really want and need a chip fab business that can compete on the global scale. Intel needs to be that business for the US (Sorry Global Foundries you had your chance)

RISC-V is the new 8080A, FPGAs are the new SoC. Look for a huge number of computers available in all price points based on RISC-V sitting inside FPGA fabrics. This is going to be driven by open source tools and a set of open source HDL cores for all of the "essential" peripherals.

The consumer device kingmakers will be graphics architecture suppliers. The biggest differentiator for the next few years will be "can your graphics card do this?!" </opinion!>

> Everything old is new again right?

Not really. All this shuffling to "custom hardware" is due to the fact that Moore's Law broke a couple generations back.

Custom hardware makes no sense if you can just wait 18 months and the performance of a generic chip will double.

Once you can't just "wait for performance increases" then building your own silicon starts to make sense.

I think we are saying the same thing, but would like to understand if you see it the same way I do. I see this pair of sentences:

Custom hardware makes no sense if you can just wait 18 months and the performance of a generic chip will double. Once you can't just "wait for performance increases" then building your own silicon starts to make sense.

As a restatement of the economics of building competitive systems.

My comment was that the economic forces that allowed IBM, HP, and DEC to build custom hardware and recover those costs through sales have returned. The mechanism of that return is that Apple has shown that product differentiation through custom silicon is sufficient to add margin to a product above and beyond the cost of developing that custom silicon.

Your comment appears to say the same thing; which is that the previous strategy of maximizing margins of letting a semiconductor company produce a better chip and then use it, is no longer more effective than you telling a semiconductor fab to make the chip you want to use and then using that.

That is what you are saying isn't it?

Yes, I would say that we are probably in violent agreement. :)
(comment deleted)
IMHO system libraries and OS architecture are more important for portability than the processor. In that sense x86 Windows and x86 Macs are already about as unportable as you can get.
Well, good job security for compiler and VM developers.
I think this is a very real concern. On the other hand, now that we’re approaching the limits of miniaturization specialized silicon seems like the clearest path, on the hardware side, to achieve continued performance gains.
If you can't run Java, C#, Node, Python, Ruby, Rust and Go at a baseline, you're really going to piss off enough developers that you won't get uptake/use on your custom chip platform.

I'm not sure how much we will see divergence, or how much it matters to most developers. If the tools can compile/target a given CPU and operate, devs largely won't care. Some will, most won't.

I don't think that MS and Amazon will stray too far from generally supported 64-bit arm instructions as a base. Maybe hardware optimizations that will work better in some workloads, but the baseline will likely work. This is only because of the diverse languages and tools that they need to support.

I think it's more about shoring up options, reducing costs and optimizing data center layouts. When targeting cloud, many apps are already scaling horizontally. So you don't need to perform like an M1 for general use as long as you can scale horizontally enough at a competitive price point, you can get a very long way without a ton of custom extension.

I got it, it's everyone-design-all-you-need days.

    Apple designs all its shit.
    So does google/facebook/microsoft/amazon
    Huawei designs its own OS
    China designs/manufactures its own chips too.
    It's rumored more companies are designing their own OS
Regarding all that China stuff: that is the result of the world finally beginning to grow some spine against the CCCP tactics.
Yes, you are not a serious software developer unless you also build your own CPU.

In fact, if you want to prevent anyone else from taking control over your market, you will have to design your own CPU/ecosystem.

The Raspberry Pi Foundation is the only company I can rely on to bring me into the future.
I know the direct impact is to Intel but think AMD just can’t catch a break. They finally have something going against Intel and now Apple and Microsoft will eat its lunch.
> Microsoft’s efforts are more likely to result in a server chip than one for its Surface devices

In my opinion, the majority of people have too much faith in their ability to predict the future.

I was terrible at predicting the real world performance of the Apple Silicon M1. It is, in fact, much better than I expected. On the other hand, Microsoft has thus far only had slightly modified AMD chips in their Surface Laptop, and poor performing ARM-designed Qualcomm chips in their Surface Pro X. Maybe I'll be bad at predicting the future, but I do not expect excellent performance out of Microsoft's Surface chips in the next 365 days. Probably longer.

In the meantime, more Windows computers will be sold than MacOS, and they will have mostly Intel chips, but an increasingly large number of AMD chips.

AMD has survived with less diverse revenue streams and much worse product portfolios. I'm optimistic for how they'll do over the next several years.

> I was terrible at predicting the real world performance of the Apple Silicon M1. It is, in fact, much better than I expected.

I expected what came out in the end. Apple would never put up the amount of money and the promise to ditch Intel if they were not absolutely certain that they could actually beat Intel performance-wise and have a working Rosetta to keep "old" software running.

The writing was on the wall for a long time, iPhone and iPad processor power has been taking decent shots at moderately powerful PC hardware for years now - the key thing why Apple didn't do it two years ago was software support and developer tooling, they wanted to avoid cloning the Windows RT fiasco which fizzled out because no one had working software and there was no translation layer.

Not sure why you're getting voted down - this is an excellent point.

It's also the case that now Apple has shown what can be done more firms will be seeing how they can try to reproduce that which will spur more investment in the Arm ecosystem.

Anybody remember the Zune? How different is Microsoft nowadays to make this actually work?

Most of their hardware products (not all... but most) end up being good, but not earth-shatteringly so, and either keep kind of moving on without taking any crowns (like Xbox), or slowly wither and die (Zune, Windows Phone).

Surface seems to be a good Halo product (not the game, ha!) so far, but I see very few Surfaces in the wild compared to any other laptop/tablet/desktops (mostly HP, some Dell, etc.).

Be careful with anecdotes! Even your own experiences! The world is a very big place. The few different jobs I've worked over the past, say... 5 years... I've seen lots of places that were Dell from door to door, a mix of Macbooks and Surface, all Macbooks but a few had Surface as personal/toys, etc. At some places, they are popular and I think when you see them all the time you're more likely to buy one yourself. When no one you know has one you're less likely to get one. So it's helpful to dig up sales statistics if you can find them...

Perhaps the closest thing to a Zune that Microsoft makes today is the Surface Duo. It's very expensive with nice hardware, but the initial launch got some bad press from mediocre software. The software has likely gotten a lot better over time, so it will be interesting to see a version 2 here. But no one will be buying a $1400 Zune :)

Microsoft is terrible at marketing anything to the common consumer and they always have been. That Windows dominates the consumer desktop dominant is a side effect.

Microsoft must always 2nd tier any consumer effort to their business of business.

Zune was instrumental in many of the design systems we have today.
I really liked the Zune. Also, it had a streaming service before Spotify was a thing, and you got to keep 10 songs per month permanently even if you canceled your subscription. I think it was much better than it got credit for.
I'm pretty inclined to think any custom CPUs will be for Azure specifically. They already have some custom hardware (e.g. FPGAs, ASICs) for different parts of the stack like storage and networking.
(comment deleted)
After M1, I am definitely holding out for Mac Pro rather than going the AMD route. I am sure there will be a ton of professionals thinking the same. While I’ve always cheered for AMD as a company, I think Apple will gain substantial market share in the next decade. And AMD just doesn’t have the resources to fight that wave.
They aren't going to have their lunch eaten. Apple doesn't have nearly the volume to make a meaningful impact, neither does Microsoft. Neither of them make up a substantial segment of cpu sales.

It does put healthy pressure on them, but I think AMD is fine for the near future, they're also working on ARM chips as well.

Apple now probably makes close to a half billion ARM chips a year, between iPhones, iPads, Macs, AppleTV, HomePod, and embedded controllers.
What if they start selling server chips? Slap an ‘Azure’ label on them and they’ll sell like hot-cakes.
They've already caught breaks in terms of their Xbox and PS5 deals. I doubt they are going to lose their production rights there anytime soon.
I would honestly rather Microsoft work directly with Intel/AMD/Nvidia to make a chip. I don't generally like Apple's direction to make the chips in house, and not sure I want Microsoft going the same path.
Assuming Microsoft has the talent to pull it off, Microsoft designing their own chips to run Windows is the best case scenario for performance. Apple has been a case study in how vertical integration, and how designing software and hardware together, can yield immense performance benefits.

However, it would be a terrible move for interoperability. OEMs would be inclined to purchase Microsoft's chips (MS's vertical integration would mean that their chips would outperform the competition when running Windows), and Microsoft could in turn restrict their chips to the Windows operating system.

I suspect one side aspect of the "integration" angle for Apple was that they were able to force the "recompile the world" moment on demand.

How much performance do you get by taking, say, code originally written for a 10-year-old compiler whose default target was vanilla i486, and build wuuth a recently built compiler? I'd expect wins from targeting a more modern instruction set, plus 10 years of general "we've learned more about optimization".

Microsoft can't do that without an architecture change, and if they do that, they're basically abandoning their primary push to consumers: your established software and workflow investments are no longer safe on Windows.

They already did that with SQ1 and SQ2. They collaborated with Qualcomm on this.

Also, the main motivation is the cost. Any other vendor would want the highest profit out of their design.

I understand the reasons, but I believe it is likely bad for the industry overall. Soon we'll have Apple, Microsoft and Google chips instead of AMD, Intel and Qualcomm chips; and they can leverage them to lock people even more into their walled garden ecosystems. That is a big worry to me, that feels like going backwards.
A wild guess: the big chip makers have been compromised (e.g. adversaries have figured how to use the Intel's ME module to exfiltrate data or even send commands), and the software corps have no choice but to manufacture their own.
Alternative theory, demand is high and supply low which pushes back channel prices higher. This is a bid by MS and Apple to cut prices.
Alternative alternative theory, the chipmakers are stuck.

Chipmakers have been crawling forward with progress for years. Meanwhile in house chips like Amazon's and Apple's have been coming out that seem to be miles ahead.

The general theory for this seems to be the chipmakers just don't get how to design their chips to work well with the real software being ran on them. So the mega-corps are just taking matters in to their own hands.

Considering none of them are actually manufacturing their own chips, I can't see how that would help?
I guess we're back to vertical integration. Amazon has already been building their own custom chips for AWS for a couple years.
Is this vertical integration turning into a different kind of monopolizing, centralization of power?

Vertical integration at face value is very appealing, it can lead to better products and better prices. On the other hand, Apple, Microsoft, Amazon, are the likes are platform companies. They control the end user's applications, social networking effects, and consumer branding. The OS interfaces, APIs, standards, programming languages that ISVs and a large portions of the software and IT industry rely on. And increasingly leverage over hardware makers, the OEMs, ODMs, silicon designers, chips makers. The first two were getting concentrated first. Think about Microsoft makes Office run only or the best on Windows. Think about Apple is bundling the Apple software ecosystem (Apple Music, iCloud) with the OS and the device. Think about Google bundling its Mapping and office software if you use their search product. But any technology will have a high barrier to entry first and as time passes gets democratized. Chip design and manufacturing is no different. Now it seems like chip design barrier to entry is low enough and platform companies are powerful enough that it makes organic sense for them to dive into the chip design sector.

Fast forward 10 years, it could be that a company will be at competitive disadvantage without its own chips just like how now a company is at a competitive disadvantage without its own ecosystem, platform and multiple products each enforcing each other to create moat. Yelp and Spotify are always at disadvantage compared to Google and Apple Music because they don't have Search and IPhone. This world, likes of Apple, Google, Microsoft, Amazon must have its own chips in order to compete and survive. In that world, what happens to pure play hardware vendors like Intel, AMD, Nvidia? Right now ARM is an instruction set everyone has to agree to because it enables portability, and right now portability is important for survival in the market. But in that world, the market condition will be that portability has disadvantages and "your own thing" has advantages. For example, Apple can add a unique instruction to their CPU that makes a operation 2X faster. Its easily adopted because software developers all use Apple's APIs and compilers so taking advantage of it is automatic. And you want less portability so a ISV can't support your competitor's product as easily. You can imagine this will happen then standards like ARM doesn't matter anymore.

Seems like this tendency towards concentration is natural. My question is at what point does the natural course to concentration stops? Should we artificially put up barrier to stop or slow down this natural tendency before it runs it course (IE, create anti-monopoly regulations, limit a player to enter a different market if they dominate in the other market).

> Should we artificially put up barrier to stop or slow down this natural tendency before it runs it course

We should always ask: would a project like Linux be possible now? Can somebody become the next Linus Torvalds? If not, then these companies have locked down their devices too far.

Exciting news for users of Microsoft services. This could mean great improvements in the SaaS, PaaS, and IaaS offerings of Microsoft Azure. These service offerings are the hottest trend currently.
We’ll probably get a Microsoft SoC (subscription on chip). Lol.
If they are truly designing chips for Surface PCs... I have hopes, but Apple has a, what, 10-year head start?

Plus, it's very likely that unlike Apple, Microsoft will not be able to find a way to economically design their own CPU cores. They'll just be premade Cortex X1 or whatever licensed ARM core, but Apple will remain ahead with Firestorm/Icestorm and whatever comes after. Kind of like Qualcomm right now.

So many assumptions.

Microsoft is just as rich as Apple. They can do whatever they want.

I highly doubt they would get into the trouble of designing their own chips only to settle for something mediocre.

If the price, scale and power envelope is right, they can absolutely be mediocre. Server CPUs are core for core clocked much lower than consumer chips, cooling and power are huge issues.

If you can fit 500-1000 mediocre arm cores in the same space as 128 x86 cores at half the power/heat, it absolutely makes sense for something like Azure. They don't have to beat Intel/AMD on a core for core basis as long as they can compete on compute/space/power requirements horizontally.

It's not the best option for some loads, but is a good enough option for enough loads that the diversification can really work out. There's plenty of software/systems/services that don't need x86 per core performance and a single ARM core is enough per node.

Microsoft has done chips since they started making them for xbox since 2003, so they have been in this space longer than Apple.

Can read about another chip they are making here: https://www.geekwire.com/2020/microsoft-pluton-new-chip-desi...

The CPU on the Xbox was a slightly customized Pentium III. Microsoft didn't necessarily design it, they worked with Intel to ensure it met the requirements they had in mind for the Xbox.

The CPU on the Xbox 360 was co-designed with IBM, working to integrate their PowerPC-based PPE cores with an AMD GPU.

As an outsider looking in, Microsoft definitely dabbles its toes into designing chips but they've always done it with a partner already big in the space of chip design. Even with that Pluton "chip", its more about creating a standard secure enclave system between existing CPU manufacturers based on some Microsoft specifications rather than an entire chip design ready to get sent to a fab.

>They'll just be premade Cortex X1 or whatever licensed ARM core, but Apple will remain ahead with Firestorm/Icestorm and whatever comes after. Kind of like Qualcomm right now.

The chips don't have to be better than Apple, they just have to be better than Intel (and AMD).

The benchmarks of the Snapdragon 888, which utilizes the Cortex-X1 core design, look decent. I mean, they're not as good as the A14 and M1 with the Firestorm/Icestorm cores, but they're decent. Decent enough that Microsoft could likely build upon the X1 core and tweak those designs to have competitive performance to Intel.

Google, Amazon and Microsoft are all confirmed or rumoured to be working on their own ARM-based server CPUs. Apple is almost certainly mulling the option too. This has huge implications for x86. If all the big internet players start developing their own chips, we could very quickly see ARM powering a huge portion of the worlds servers.

This is all happening because ARM licenses it’s core design and ISA to anyone. It’s becoming relatively easy for major internet companies to design and implement their own bespoke CPU designs, optimized for their unique workloads. This means better performance, and lower energy costs, which is critical for these massive datacentres. The optimization benefits offered by that degree of vertical integration is something Intel may not be able to compete with.

For Intel this is obviously terrible news. Severs are their second biggest cash cow, and MS might end up being merely among the first of many internet companies to pursue their own CPU designs. This could foretell a rapid shift away from Intel and x86 in the server space.

This has implications for their PC chip business too. More money invested into ARM processors, means more R&D for ARM-based designs, which means better ARM chips in PC and mobile. This makes Intel less competitive in the PC space.

Here is an utterly terrifying thought for Intel: These Microsoft processors are clearly destined for their own servers. That’s bad for Intel, but not existential.

But what if Microsoft takes the lessons learned from making their server chips, and uses that to develop their own chips for the Surface. Again, bad for Intel, but hardly a huge deal.

But what if Microsoft then takes these Surface chips, and licenses them to Windows manufacturers to create the next generation of PCs... PCs that can compete with the M1 in terms of performance and efficiency.

For Microsoft, the benefits would be immense. Microsoft obviously knows Windows better than anyone, and would be able to tailor both the operating system and their CPUs to work far more efficiently than Wintel. This also increases Microsoft’s vertical integration and control over the Windows operating system, which they’d no doubt view as positive. Microsoft becomes vendor of the Windows operating system and the CPUs it runs on. Intel systems would be at a permanent competitive disadvantage, as they don’t have the tight level of integration of Windows and MS-designed chips.

The off the shelf ARM core designs are likely good enough for Microsoft to create an offering that’s competitive with Intel, if they implement some tweaks to make it integrate and perform better with Windows (as Apple has done with M1 and macOS)

This might sound bonkers right now, but there’s definitely a version of the future where we’re buying a Dell XPS powered by Windows 10 and “Microsoft Silicon”

Already done with the SQ1 and SQ2 in the surface pro X. Only reason it was done with Qualcomm was the radio I believe.
Interesting. To what degree did Microsoft design this chip? Did Qualcomm only provide the parts related to the radio? I was aware of SQ, but had assumed it was just a modified Qualcomm chip
It is a slightly modified 8cx.
The SQ1 is practically identical to Qualcomm's 8cx.
It's not bonkers, that is what Apple has done.
My biggest concern is what this means for legacy PC games.

Is there an emulation layer for ARM CPU that would allow for near seamless operation of all the golden age games from, say...1995 to 2008?

If they do as good a job as Apple, I'm pretty sure they can emulate a 12 year old CPU pretty well.
Oh, Microsoft innovating again.

So Apple has iPhone? Now we will have Lumia!

So Apple has iPad? Now we will have Surface!

So Apple has M1? Now we will have something!

Too bad OSX came too late and Microsoft couldn't just copy it by then.

This is nonsense and a bit childish but if you want to compare, here are some things that Microsoft had before Apple:

1. A journaling filesystem

2. Protected memory

3. Preemptive multitasking

4. Access control

5. Intel chips

6. Tablet computers

Well, I never pretended to say that Microsoft has just one source of inspiration. But even admitting* that Microsoft got those before, they were not the pioneers either.

* I say that because Mac OS classic was not the only operating system Apple developed. They had their A/UX operating system from 1988 to 1995 where things like protected memory, preemptive multitasking and the usual stuff from a Unix system of the time were present.

Then what was exactly the point of your post? People pointed out Microsoft did everything you listed in your OP before Apple, including a SoC - Apple and Microsoft both aren't pioneers in your definition.
Yes, we know Microsoft "invented" the iPhone 15 years before Apple did... but here we're talking about real things. No vaporware. It's a joke to say Microsoft invented the smartphone as we know it today. Otherwise, we may as well say that Microsoft invented the most advanced file system in the world before nobody else (and for many years to come), WinFs... despite it does exist only in some engineers' minds.