Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

Sydde

macrumors 68030
Aug 17, 2009
2,563
7,061
IOKWARDI
Just because Apple conducts experiments to collect data doesn't mean it doesn't need a large infrastructure to train its models. How do you think Apple trains its models?
What advantage would RISC-V have to offer in terms of model training?
 

leman

macrumors Core
Oct 14, 2008
19,517
19,664
By the way, last month Luca Benini gave a very interesting talk on tricks to improve the efficiency of cores.

Finally managed to watch it, a fascinating talk and easy enough to understand for someone without a background in CPU design.

Although I’m not quite sure what this has to do with RISC-V? In the end they modify the ISA so heavily that almost nothing is left…
 

leman

macrumors Core
Oct 14, 2008
19,517
19,664
Can academia use any ISA other than RISC-V?

RISC-V is open source, which of course makes it a prime candidate if you are in academia and want to start with something already there. What I mean is that the talk does not make any arguments in favour of RISC-V, it simply discusses a way to design an energy-efficient domain-specific accelerator.
 

deconstruct60

macrumors G5
Mar 10, 2009
12,493
4,053
There are no base instructions added in v9. It adds SVE2, but that remains optional. Mosty, 9 adds new security domain architecture and makes AArch32 optional.

SVE2 is optional so far in the early v9 sequence. That doesn't mean it will be optional by the end.

I don't think the arch licenses are doled out on a 'dot' granularity. ( buy 9.2 but not 9.6 and every time Arm does another x.(y+1) have to write another check). Payments on the overall 9 could be spread out , but it isn't a 'nickel and dime' exercise). Stuff that is optional at x.1 , x.2. , x.3 isn't necessarily optional at x.5 , x.6, x.7

By the time Arm gets to the end of v9 updates there is probably no good reason for it not to be pragmatically required for everything that isn't some niche embedded controller. If enough implementers do it , defacto needed for portable code.
 
Last edited:

Sydde

macrumors 68030
Aug 17, 2009
2,563
7,061
IOKWARDI
SVE2 is optional so far in the early v9 sequence. That doesn't mean it will be optional by the end.
ARM themselves has yet to design an SVE2 (or even SVE) capable core. There is only one implementation of SVE so far: the Fugaku supercomputer; the AWS Graviton3 is supposed to have it, if it has been deployed yet. I have not yet checked, but I do not believe nVidia's Grace cores even have it.
 
Last edited:

leman

macrumors Core
Oct 14, 2008
19,517
19,664
ARM themselves has yet to design an SVE2 (or even SVE) capable core. There is only one implementation of SVE so far: the Fugaku supercomputer; the AWS Graviton3 is supposed to have it, if it has been deployed yet. I have not yet checked, but I do not believe nVidia's Grace cores even have it.

I think your info is a bit outdated? SVE2 is supported on majority of ARMs current performance-focused designs, both on server and consumer.
 

deconstruct60

macrumors G5
Mar 10, 2009
12,493
4,053
ARM themselves has yet to design an SVE2 (or even SVE) capable core. There is only one implementation of SVE so far: the Fugaku supercomputer; the AWS Graviton3 is supposed to have it, if it has been deployed yet. I have not yet checked, but I do not believe nVidia's Grace cores even have it.

Doesn't match up with Arm's documentation.

" ...
The Cortex®‑X2 core supports the Scalable Vector Extension (SVE) and the Scalable Vector Extension 2 (SVE2). SVE and SVE2 complement and do not replace AArch64 Advanced SIMD and floating-point functionality.

SVE is an optional extension introduced by the Armv8.2 architecture. SVE is supported in AArch64 state only. SVE provides vector instructions that, primarily, support wider vectors than the Arm Advanced SIMD instruction set.

The Cortex®‑X2 core implements a scalable vector length of 128 bits. ...
"

[ X2 is in Dimensity 9000 , Snapdragon 7+ gen 2 and 8+ Gen 1 , Exynos 2200

upcoming Google Tensor 3 reportedly has an X3 core in it. ( X3 is just a superset of X2 ) ]


Graviton 3 has SVE1 and has been deployed for a while.




These don't have many license implementators yet, but the pipeline is coming:

Neoverse N2 and V2 have SVE2


In particular Nvidia Grace

" Neoverse V2 Cores: Armv9 with 4x128b SVE2 ..."


P.S. the 'prize' the Fujitsu Fugaku still owns is vector length 512. I don't think anyone has tried to match that yet.



P.P.S. The 510 and 710 also

" ... The Cortex-A510 is the first small core from Arm to feature the Armv9 ISA along with the Scalable Vector Extension (SVE) and SVE2 extensions. ..."
 
Last edited:

leman

macrumors Core
Oct 14, 2008
19,517
19,664
P.S. the 'prize' the Fujitsu Fugaku still owns is vector length 512. I don't think anyone has tried to match that yet.

One has to note however that A64FX is a very specialized design that is dead slow on general-purpose code. It’s pretty much a vector processing machine where everything revolves around its 2x512bit FP SIMD.
 

Xiao_Xi

macrumors 68000
Oct 27, 2021
1,627
1,101
Qualcomm advocates removing the C extension from RISC-V profiles for computer and server CPUs. Kudos @leman! They should have listen to you sooner.
 

Attachments

  • A case to remove the C extension from app profiles - Profiltes TG 20230929.pdf
    171 KB · Views: 376
  • Like
Reactions: Chuckeee

Xiao_Xi

macrumors 68000
Oct 27, 2021
1,627
1,101
I wonder though what is this Znew they refer to?
Qualcomm has shared a pdf with more slides, where it explains it.

1696618571285.png


You can follow the conversation on the mailing list
 

Attachments

  • A case to remove the C extension from app profiles, part 2 - Profiles TG 20231005.pdf
    314.4 KB · Views: 125
  • Like
Reactions: Basic75

leman

macrumors Core
Oct 14, 2008
19,517
19,664
  • Like
  • Haha
Reactions: Basic75 and Xiao_Xi

leman

macrumors Core
Oct 14, 2008
19,517
19,664
Asanovic, one of the creators of RISC-V, has prepared a presentation to defend the extension to C.


I think this is a very interesting dialogue because it shows very clearly where different parties see their priorities. Qualcomm is interested in high-performance computing and their suggestions aim to close certain deficiencies in RISC-C that make high-performance computing a challenge. On the other hand, Asanovich represents the group that cares more about simple processors and low complexity implementations rather than high-performance computing. Incidentally, this was the impression I always had about RISC-V, so it’s interesting to have a confirmation from the source.

In the end, I wouldn’t be surprised if Qualcomm rolls their own extension anyway (with or without the group’s blessing), and it’s likely that other companies who actually care about performance will join them. So we might end up with multiple strictly separated dialects of RISC-V that require different compiler backends.

For what its worth, I think that Qualcomm is right, and that their suggestion is much better than “just fuse instructions” proposal that dominated RISC-V until then.
 

Xiao_Xi

macrumors 68000
Oct 27, 2021
1,627
1,101
I think that Qualcomm is right, and that their suggestion is much better than “just fuse instructions” proposal that dominated RISC-V until then.
Qualcomm favors cracking over fusion instruction.
I realize that this is flipping the current gospel on its head -- rather than promoting instruction fusion, we'd be promoting instruction cracking. We think this is a better path:

* We can save 75% of the 32-bit opcode space.
* We don't have the complexity issues of unaligned fetch.
* Implementations can take advantage of the "pre-fused" instructions. For example, some of the code size instructions, like the new addressing modes, may already be fusion targets in some implementations.
* Cracking is deterministic -- when you see an instruction to crack, you do it. Fusion is best-effort. For all kinds of reasons, you may miss fusion targets: instructions aren't on the same line, aren't in the same fetch group, etc...
 

Xiao_Xi

macrumors 68000
Oct 27, 2021
1,627
1,101
The plot thickens and gets more and more interesting. Qualcomm has refuted SiFive's arguments and it appears that some of the new ideas run so counter to the initial RISC-V vision that Andrew Waterman, one of the creators of RISC-V, has stated:
We briefly note we are veering off into the territory of designing an entirely different ISA…
 

Attachments

  • Response to SiFive C Presentation.pdf
    315.4 KB · Views: 96

Xiao_Xi

macrumors 68000
Oct 27, 2021
1,627
1,101
profiles perfectly handles all of this Balkanization stuff
Do you mean Qualcomm is against every other company? Some people on Reddit believe that Qualcomm is pushing to get rid of the C extension to make RISC-V look more like ARM, so they can reuse their ARM cores.

Can you see it now? It has been there for a long while now.
Edit: I don't deny that you may be right and that profiles don't solve the problem of extensions, but I think you have based your reasoning on a hunch and not on evidence. I would consider that profiles don't serve their purpose if Linux applications and distros aren't compiled using the corresponding profile.

By the way, the word Balkanization brings back terrible memories for Europeans. So unless you think these companies are going to kill each other like the people in those countries did, you should find a better metaphor.
 
Last edited:

leman

macrumors Core
Oct 14, 2008
19,517
19,664
And while we are discussing the future of RISC-V, it looks like SiFive, one of the most influential companies in the space, has instigated mass layoffs. Can't say I am surprised, I never really understood their business model or goals. Still, this will likely be a major setback for the public perception of RISC-V. It is possible that none of the advanced SiFive designs will actually enter the general market.

Curious what Tenstorrent Ascalon will deliver at this point.
 
Last edited:
  • Like
Reactions: Basic75 and Xiao_Xi

Xiao_Xi

macrumors 68000
Oct 27, 2021
1,627
1,101
it looks like SiFive, one of the most influential companies in the space, has instigated mass layoffs
Ian Cutress got confirmation from SiFive.
1698145340127.png


SiFive's opening position seems suspicious. It is possible that SiFive is focusing more on its Indian office than on the American ones. In any case, it doesn't look good for either SiFive or RISC-V.
 

deconstruct60

macrumors G5
Mar 10, 2009
12,493
4,053
And while we are discussing the future of RISC-V, it looks like SiFive, one of the most influential companies in the space, has instigated mass layoffs. Can't say I am surprised, I never really understood their business model or goals. Still, this will likely be a major setback for the public perception of RISC-V. It is possible that none of the advanced SiFive designs will actually enter the general market.

SiFive has been 'influx' for a while.

They spun out part of the company last year for ~ $200M .

" ... Alphawave will be acquiring a 300+ person team from the California-based firm, located primarily in India. ..."

Note the size there is in the same range as the size been whispered as the current layoff size ( 100-300 ).

" ...
through multiple sources, SiFive has instigated a large number of layoffs. Numbers vary, from 100 to 300+, but multiple sources confirm that most of the engineering team, especially the physical design engineers, sales, and product team. The management team have also been fired from what I've been told, ..."


SiFive physical products have been kind of 'odd' for a long while. They'd talk about releasing demo boards but it would almost be like a kickstarter projects. It would wonder around for a while in pre-release. Then they would distribute some. And then it would be "oh the next board is so exciting we aren't going to make any more of these current ones so can focus on the next one. " Rinse and repeat.

If look at the range of vendors doing RISC-V development boards

https://riscv.org/risc-v-developer-boards/

If RISC-V goes from 8 to 7 options for boards that isn't much of a loss. In fact, might actually be healthier ecosystem. "StarFive" ( similar sounding name) is a chinese vendor


But it is kind of a long way from Intel tossing around the idea of spending $2B on them. Likely would have been $2B wasted by Intel that they sorely need now to cover other Intel 'bets' that went sideways. There could have been a problem if SiFive went off and did something relatively expensive to encourage Intel to buy them out and then it fell through ( e.g. spin up a fancy Intel fabbed chip that never went on sale in substantive numbers. )





Curious what Tenstorrent Ascalon will deliver at this point.

The 'other half' of SiFive wanted to run an Arm-like model where they primarily just license IP. This may not mean very much for Tenstorrent as they likely still have whatever IP they licensed from SiFive.

The problem for SiFive is that many vendors in the embedded controller market are drifting away from Arm in part because of the licensing model. So SiFive copying that aspect.... is a bit dual edged. SiFive is more so going to be a 'significant subcontractor' on designs than then the primary contractor role that Arm plays in many cases . They aren't going to have that kind of pricing power.

That is bad if the VC investors expect them to be the 'next Arm' . It just isn't practical. This layoff looks like one of those inflection points when the money folks start to come back to reality of what they actually have as opposed to what they wished they had.
 

Xiao_Xi

macrumors 68000
Oct 27, 2021
1,627
1,101
Ventana yesterday unveiled Veyron v2, a 15-width out-of-order processor. It would be the widest processor, wouldn't it?

I hope that Ventana's presentation will soon be available on Youtube.
 
  • Like
Reactions: altaic and Basic75
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.