Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
If you need ten GPUs, I have a feeling that you should think about whether your needs are beyond what the Apple ecosystem can support.

If you want advice about Linux or Windows systems that support ten GPUs, just ask. (Although five Titan-X cards per system is as far as I've gone so far.)

Splitting the interface signal is the way to go with such high end internally connected arrays . And the next part of the project was to do exactly that . But hitting a brick wall so soon with three modern nVidia GPUs running a recent OS X version has dampened my spirits .

Now I am considering System configurations that would permit splitting a single host interface for the video rendering and freeing up the other host interfaces for other peripheral cards (EFI UI graphics card , controller cards, etc.) .

There should be more than enough bandwidth here , in a cMP .

In fact , with the Nehalem Mac Pro available bandwidth should be :

PCIe slot 1 = 8 GB/s (16 x 500 MB/s)
PCIe slot 2 = 8 GB/s (16 x 500 MB/s)
PCIe slot 3 = 2 GB/s (4 x 500 MB/s)
PCIe slot 4 = 2 GB/s (4 x 500 MB/s)

With keeping in mind slots 3 and 4 share resources .

So , you see , there's a lot to work with here . And the GPGPU array I have already built should , in theory , work fine connected to a single x16 PCIe slot with the appropriate splitting . We're talking 4 lanes of PCIe Rev 2 per graphics card .

For comparison purposes : the nMP (Cylinder) has just a 2.5 GB/s connection through a single TB2 port , which is how an eGPU expansion chassis would connect to this System .
 
Last edited:
For comparison purposes : the nMP (Cylinder) has just a 2.5 GB/s connection through a single TB2 port , which is how an eGPU expansion chassis would connect to this System .

PCIe 2.0 uses 8/10 encoding with 20% overhead. T-Bolt 2 has 2GB/s data throughput, 2.5GB/s raw.
 
:D Retail price? Who pays that? For HP?

We use consumer cards as well (machine learning and AI). Don't need FP64, and ECC isn't needed. GTX980Ti is sweet, although I've ordered three systems with five Titan-X in each.

Did HP actually ship a System with five Titans installed ? Did everything arrive safely ? These cards are getting so heavy the industry is beginning to reinforce the PCIe slot interfaces with metal shielding for structural integrity purposes .
 
80 percent efficiency either way ? Both are based on PCIe , after all .
The point I meant to make is that your post listed data bandwidth for the PCIe slots, and raw bandwidth for T-Bolt 2.

It made it look like T-Bolt 2 was faster than PCIe 2.0 x4, which of course is not true.
 
Last edited:
Did HP actually ship a System with five Titans installed ? Did everything arrive safely ? These cards are getting so heavy the industry is beginning to reinforce the PCIe slot interfaces with metal shielding for structural integrity purposes .

No - they're shipping with 6000 watt power supplies (4*1500 - N+2) and five dual 8-pin power leads for the GPUs.

The Titan-X cards are coming from Newegg. HPE sells them with Teslas and Quadros - I'd rather spend $1200 for a Titan-X than $5000 for a Tesla with ECC that I don't need.

HPE is shipping them with 8 TB of NVMe SSDs, though :D
 
Last edited:
No - they're shipping with 6000 watt power supplies (4*1500 - N+2) and five dual 8-pin power leads for the GPUs.

The Titan-X cards are coming from Newegg. HPE sells them with Teslas and Quadros - I'd rather spend $1200 for a Titan-X than $5000 for a Tesla with ECC that I don't need.

HPE is shipping them with 8 TB of NVMe SSDs, though :D

Holey Moley AldenShaw....
That is an enormously powerful machine!
What kind of work do you do with these?
 
I think his nick should direct you to the right trace... ;) :p :D

No offense Aiden, just couldn't resist :)
 
No - they're shipping with 6000 watt power supplies (4*1500 - N+2) and five dual 8-pin power leads for the GPUs.

The Titan-X cards are coming from Newegg. HPE sells them with Teslas and Quadros - I'd rather spend $1200 for a Titan-X than $5000 for a Tesla with ECC that I don't need.

HPE is shipping them with 8 TB of NVMe SSDs, though :D

Exactly what kind of super computer are you using , Aiden ??? :eek: It can't be a normal Z8xx series HP workstation . Is it some sort of 5U rackable ?
 
Exactly what kind of super computer are you using , Aiden ??? :eek: It can't be a normal Z8xx series HP workstation . Is it some sort of 5U rackable ?

hal9000.jpg
 
Exactly what kind of super computer are you using , Aiden ??? :eek: It can't be a normal Z8xx series HP workstation . Is it some sort of 5U rackable ?

ProLiant DL580 Gen9 - 4U rack.
  • quad 18 core processors
  • 96 DIMM slots (up to 6 TiB RAM)
  • five PCIe 3.0 x16 slots (all spaced for double-wide cards)
  • four PCIe 3.0 x8 slots (x16 mechanical - two blocked if five double-wide GPUs)
  • 8 TB NVMe SSD
  • 4.8 TB SAS 10K
  • dual 10GbE
http://www8.hp.com/us/en/products/proliant-servers/product-detail.html?oid=8090149#!tab=features

dl580.jpg
[doublepost=1456854901][/doublepost]
I think his nick should direct you to the right trace... ;) :p :D
And VR helps the experience ;)
 
It makes me wonder if Apple should again consider licensing a few select manufacturers for high end production machines that can run Mac OS.

Gawd that would be great but I doubt Apple will give users what they want because Apple is a hardware company and will sell us what they deem we "need".
:rolleyes:
 
ProLiant DL580 Gen9 - 4U rack.
  • quad 18 core processors
  • 96 DIMM slots (up to 6 TiB RAM)
  • five PCIe 3.0 x16 slots (all spaced for double-wide cards)
  • four PCIe 3.0 x8 slots (x16 mechanical - two blocked if five double-wide GPUs)
  • 8 TB NVMe SSD
  • 4.8 TB SAS 10K
  • dual 10GbE
http://www8.hp.com/us/en/products/proliant-servers/product-detail.html?oid=8090149#!tab=features

View attachment 619182
[doublepost=1456854901][/doublepost]
And VR helps the experience ;)

What a Beast - Dual Hazzy E7s .

Apple will never offer this configuration .

We'll be lucky if ,sometime this year, we get a traditional MidTower Mac Pro refresh with Dual Broadwell E5s and - gasp ! - interface slots !

If we don't I might just go the Boxx route and build whitebox workstations all day long .

VR ? That's so yesterday . :rolleyes: AR is where the real fun is ! :p A buddy of mine is coding that stuff in Chi-town .
[doublepost=1456870819][/doublepost]

Every System I build comes with a thick and heavy power cord that can be yanked out with a single, determined tug . I already anticipated this :) . End Of Line .
 
Quad, not dual. ;)

Oh , this is how badly I am stuck in the Mac universe . Stuck at two pieces of silicon ... I can't even count beyond two .

On the other hand , we did have some massive processor counts back in the legal Mac clone era (1990s) with both production models and experimental rigs . If memory serves , the experimental rigs had eight or ten CPUs . Wicked fast Photoshop Macs . They never made it to market , sadly . I think the only ones to make it to market were Quad Processor Clones .
[doublepost=1456884433][/doublepost]I just finished building a Mac Pro 1,1 (2006) and installed a copy of Yosemite on it . Should I attach the 3 x 980 Ti Array to it and run some benchmarks ??? ;)

A 2006 will have a lot more available bandwidth for the Array than a Cylinder would through an expansion chassis.
 
Last edited:
  • Like
Reactions: LightBulbFun
Doesn't it make you a bit sad that you could do all that inside a Z-series using the factory power supply - and have more RAM and much faster processors?

Meanwhile, I'm awaiting delivery of three systems each with 72 cores/144 threads, 1 TiB of RAM (up to 6 TiB max if I need more) and five Titan-X per system. Each has five 1.6 TB NVMe SSD drives (8 TB of NVMe per system) and 5 TB of SAS drives.

Apple just doesn't care anymore.

Do you know if that applies to the Z800? Could I fit 3x GTX 780 ti, Plus 1x Quadro 2000? But I would need external PSU for the 6x 8pins connectors?
 
[doublepost=1456884433][/doublepost]I just finished building a Mac Pro 1,1 (2006) and installed a copy of Yosemite on it . Should I attach the 3 x 980 Ti Array to it and run some benchmarks ??? ;)

A 2006 will have a lot more available bandwidth for the Array than a Cylinder would through an expansion chassis.
No test to share ?
 
I see similar machines popping up all over Los Angeles. Usually they are Supermicro based with 8 (10?) Titan (12GB) cards. Shops are using them to render Octane and run Resolve for color grading RAW footage from the Arri 65, Sony F65 etc.

It's a mix of Windows and Linux.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.