Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Status
The first post of this thread is a WikiPost and can be edited by anyone with the appropiate permissions. Your edits will be public.

joevt

macrumors 604
Jun 21, 2012
6,971
4,262
ok managed to find the device with lspci
+-1c.0-[04]----00.0 Micron/Crucial Technology P2 NVMe PCIe SSD [c0a9:540a]

and found some more details with spci -nnvvv to see the speed capabilities:

not sure how to use setpci to effect the pci link speed. That is beyond my ken for this evening.
Need info about the parent PCI bridges. Try pcitree.sh
 
  • Like
Reactions: Ulysses_UK

Ulysses_UK

macrumors member
Jan 3, 2022
30
9
Need info about the parent PCI bridges. Try pcitree.sh
Hi, Thanks for this! Appreciated.
I found your pcitree.sh, script. Here's the output that i think matters. (editied: see below for full output.)
Code:
 ┬[0000:00]
├┬00:1c.0-[04]     # g1x2           [8086:3a40] [060400]          PCI bridge [Normal decode]           : Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 1
│└─04:00.0         # g3x4 > g1x2    [c0a9:540a] [010802] (rev 01) Non-Volatile memory controller [NVM Express] : Micron/Crucial Technology P2 NVMe PCIe SSD

Here's the whole thing.

Code:
#=========================================================================================

┬[0000:00]

├─00:00.0          # g1x4           [8086:3406] [060000] (rev 13) Host bridge                          : Intel Corporation 5520 I/O Hub to ESI Port

├┬00:01.0-[01]     # g2x4 > g1x4    [8086:3408] [060400] (rev 13) PCI bridge [Normal decode]           : Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 1

│└─01:00.0         # g1x8 > g1x4    [1000:0056] [010000] (rev 08) SCSI storage controller              : Broadcom / LSI SAS1064ET PCI-Express Fusion-MPT SAS

├┬00:03.0-[02]     # g2x16 > g1x0   [8086:340a] [060400] (rev 13) PCI bridge [Normal decode]           : Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 3

├┬00:07.0-[03]     # g2x16 > g1x16  [8086:340e] [060400] (rev 13) PCI bridge [Normal decode]           : Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 7

│├─03:00.0         # g3x16 > g1x16  [1002:67df] [030000] (rev e1) VGA compatible controller [VGA controller] : Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere [Radeon RX 470/480/570/570X/580/580X/590]

│└─03:00.1         # g3x16 > g1x16  [1002:aaf0] [040300]          Audio device                         : Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere HDMI Audio [Radeon RX 470/480 / 570/580/590]

├─00:0d.0          # g0x0           [8086:343a] [060000] (rev 13) Host bridge                          : Intel Corporation Device

├─00:0d.1          # g0x0           [8086:343b] [060000] (rev 13) Host bridge                          : Intel Corporation Device

├─00:0d.2          # g0x0           [8086:343c] [060000] (rev 13) Host bridge                          : Intel Corporation Device

├─00:0d.3          # g0x0           [8086:343d] [060000] (rev 13) Host bridge                          : Intel Corporation Device

├─00:0d.4          # g0x0           [8086:3418] [060000] (rev 13) Host bridge                          : Intel Corporation 7500/5520/5500/X58 Physical Layer Port 0

├─00:0d.5          # g0x0           [8086:3419] [060000] (rev 13) Host bridge                          : Intel Corporation 7500/5520/5500 Physical Layer Port 1

├─00:0d.6          # g0x0           [8086:341a] [060000] (rev 13) Host bridge                          : Intel Corporation Device

├─00:0d.7          # g0x0           [8086:341b] [060000] (rev 13) Host bridge                          : Intel Corporation Device

├─00:0e.0          # g0x0           [8086:341c] [060000] (rev 13) Host bridge                          : Intel Corporation Device

├─00:0e.1          # g0x0           [8086:341d] [060000] (rev 13) Host bridge                          : Intel Corporation Device

├─00:0e.2          # g0x0           [8086:341e] [060000] (rev 13) Host bridge                          : Intel Corporation Device

├─00:0e.3          # g0x0           [8086:341f] [060000] (rev 13) Host bridge                          : Intel Corporation Device

├─00:0e.4          # g0x0           [8086:3439] [060000] (rev 13) Host bridge                          : Intel Corporation Device

├─00:0f.0          # g0x0           [8086:3424] [110100] (rev 13) Performance counters                 : Intel Corporation Device

├─00:10.0          #                [8086:3425] [080000] (rev 13) PIC [8259]                           : Intel Corporation 7500/5520/5500/X58 Physical and Link Layer Registers Port 0

├─00:10.1          #                [8086:3426] [080000] (rev 13) PIC [8259]                           : Intel Corporation 7500/5520/5500/X58 Routing and Protocol Layer Registers Port 0

├─00:11.0          #                [8086:3427] [080000] (rev 13) PIC [8259]                           : Intel Corporation 7500/5520/5500 Physical and Link Layer Registers Port 1

├─00:11.1          #                [8086:3428] [080000] (rev 13) PIC [8259]                           : Intel Corporation 7500/5520/5500 Routing # 0000:00:11.1 Protocol Layer Register Port 1

├─00:13.0          #                [8086:342d] [080020] (rev 13) PIC [IO(X)-APIC]                     : Intel Corporation 7500/5520/5500/X58 I/O Hub I/OxAPIC Interrupt Controller

├─00:14.0          # g0x0           [8086:342e] [080000] (rev 13) PIC [8259]                           : Intel Corporation 7500/5520/5500/X58 I/O Hub System Management Registers

├─00:14.1          # g0x0           [8086:3422] [080000] (rev 13) PIC [8259]                           : Intel Corporation 7500/5520/5500/X58 I/O Hub GPIO and Scratch Pad Registers

├─00:14.2          # g0x0           [8086:3423] [080000] (rev 13) PIC [8259]                           : Intel Corporation 7500/5520/5500/X58 I/O Hub Control Status and RAS Registers

├─00:14.3          #                [8086:3438] [080000] (rev 13) PIC [8259]                           : Intel Corporation 7500/5520/5500/X58 I/O Hub Throttle Registers

├─00:15.0          #                [8086:342f] [080020] (rev 13) PIC [IO(X)-APIC]                     : Intel Corporation 7500/5520/5500/X58 Trusted Execution Technology Registers

├─00:16.0          # g0x0           [8086:3430] [088000] (rev 13) System peripheral                    : Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device

├─00:16.1          # g0x0           [8086:3431] [088000] (rev 13) System peripheral                    : Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device

├─00:16.2          # g0x0           [8086:3432] [088000] (rev 13) System peripheral                    : Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device

├─00:16.3          # g0x0           [8086:3433] [088000] (rev 13) System peripheral                    : Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device

├─00:16.4          # g0x0           [8086:3429] [088000] (rev 13) System peripheral                    : Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device

├─00:16.5          # g0x0           [8086:342a] [088000] (rev 13) System peripheral                    : Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device

├─00:16.6          # g0x0           [8086:342b] [088000] (rev 13) System peripheral                    : Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device

├─00:16.7          # g0x0           [8086:342c] [088000] (rev 13) System peripheral                    : Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device

├─00:1a.0          #                [8086:3a37] [0c0300]          USB controller [UHCI]                : Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #4

├─00:1a.1          #                [8086:3a38] [0c0300]          USB controller [UHCI]                : Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #5

├─00:1a.2          #                [8086:3a39] [0c0300]          USB controller [UHCI]                : Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6

├─00:1a.7          #                [8086:3a3c] [0c0320]          USB controller [EHCI]                : Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #2

├─00:1b.0          # g0x0           [8086:3a3e] [040300]          Audio device                         : Intel Corporation 82801JI (ICH10 Family) HD Audio Controller

├┬00:1c.0-[04]     # g1x2           [8086:3a40] [060400]          PCI bridge [Normal decode]           : Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 1

│└─04:00.0         # g3x4 > g1x2    [c0a9:540a] [010802] (rev 01) Non-Volatile memory controller [NVM Express] : Micron/Crucial Technology P2 NVMe PCIe SSD

├┬00:1c.2-[05]     # g1x1           [8086:3a44] [060400]          PCI bridge [Normal decode]           : Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 3

│└─05:00.0         # g1x1           [8086:10f6] [020000]          Ethernet controller                  : Intel Corporation 82574L Gigabit Network Connection

├┬00:1c.3-[06]     # g1x1           [8086:3a46] [060400]          PCI bridge [Normal decode]           : Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 4

│└─06:00.0         # g1x1           [8086:10f6] [020000]          Ethernet controller                  : Intel Corporation 82574L Gigabit Network Connection

├┬00:1c.4-[07-08]  # g1x1           [8086:3a48] [060400]          PCI bridge [Normal decode]           : Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 5

│└┬07:00.0-[08]    # g1x1           [104c:823e] [060400] (rev 01) PCI bridge [Normal decode]           : Texas Instruments XIO2213A/B/XIO2221 PCI Express to PCI Bridge [Cheetah Express]

│ └─08:00.0        #                [104c:823f] [0c0010] (rev 01) FireWire (IEEE 1394) [OHCI]          : Texas Instruments XIO2213A/B/XIO2221 IEEE-1394b OHCI Controller [Cheetah Express]

├┬00:1c.5-[09]     # g1x1           [8086:3a4a] [060400]          PCI bridge [Normal decode]           : Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 6

│└─09:00.0         # g1x1           [102b:0522] [030000] (rev 02) VGA compatible controller [VGA controller] : Matrox Electronics Systems Ltd. MGA G200e [Pilot] ServerEngines (SEP1)

├─00:1d.0          #                [8086:3a34] [0c0300]          USB controller [UHCI]                : Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1

├─00:1d.1          #                [8086:3a35] [0c0300]          USB controller [UHCI]                : Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2

├─00:1d.2          #                [8086:3a36] [0c0300]          USB controller [UHCI]                : Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3

├─00:1d.7          #                [8086:3a3a] [0c0320]          USB controller [EHCI]                : Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1

├┬00:1e.0-[0a]     #                [8086:244e] [060401] (rev 90) PCI bridge [Subtractive decode]      : Intel Corporation 82801 PCI Bridge

├─00:1f.0          #                [8086:3a18] [060100]          ISA bridge                           : Intel Corporation 82801JIB (ICH10) LPC Interface Controller

├─00:1f.2          #                [8086:3a22] [010601]          SATA controller [AHCI 1.0]           : Intel Corporation 82801JI (ICH10 Family) SATA AHCI Controller

└─00:1f.3          #                [8086:3a30] [0c0500]          SMBus                                : Intel Corporation 82801JI (ICH10 Family) SMBus Controller
 
Last edited:

joevt

macrumors 604
Jun 21, 2012
6,971
4,262
I found your pcitree.sh, script. Here's the output that i think matters. (Can post the full thing if needed)

Code:
┬[0000:00]
├┬00:1c.0-[04]     # g1x2           [8086:3a40] [060400]          PCI bridge [Normal decode]           : Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 1
│└─04:00.0         # g3x4 > g1x2    [c0a9:540a] [010802] (rev 01) Non-Volatile memory controller [NVM Express] : Micron/Crucial Technology P2 NVMe PCIe SSD
The full thing would be interesting but won't give more info about this slot. Surround the text with [code] [/code] to format it correctly.

From what you've posted so far, it seems that it cannot do more than 2.5 GT/s x2 which is < 500 MB/s and matches your benchmarks.

ICH10 chipset manual doesn't mention anything greater than 2.5 Gb/s per lane for PCIe and DMI.
 
  • Like
Reactions: Ulysses_UK

Ulysses_UK

macrumors member
Jan 3, 2022
30
9
The full thing would be interesting but won't give more info about this slot. Surround the text with [code] [/code] to format it correctly.

From what you've posted so far, it seems that it cannot do more than 2.5 GT/s x2 which is < 500 MB/s and matches your benchmarks.

ICH10 chipset manual doesn't mention anything greater than 2.5 Gb/s per lane for PCIe and DMI.
Ok, I'm puzzled by this. So Noob question follows....

The Xserve 3.1 sports two full 16x pcie 2.0 slots on the x58 Northbridge, but, the MXM slot is on the slower ICH10 southbridge, limiting it this slot to PCIe 1.0 performance?
Is that right?
 

Ulysses_UK

macrumors member
Jan 3, 2022
30
9
Ok, I'm puzzled by this. So Noob question follows....

The Xserve 3.1 sports two full 16x pcie 2.0 slots on the x58 Northbridge, but, the MXM slot is on the slower ICH10 southbridge, limiting it this slot to PCIe 1.0 performance?
Is that right?
Ah okay found a block diagram confirming this. I had no idea. That is so weird!
Explains why the mxm slot is so slow for more modern AMD GPUs definitively though. PCIe 1.0 X2. Yikes.
 

Attachments

  • XServe 2009 Block.png
    XServe 2009 Block.png
    120.8 KB · Views: 103

joevt

macrumors 604
Jun 21, 2012
6,971
4,262
Ah okay found a block diagram confirming this. I had no idea. That is so weird!
Explains why the mxm slot is so slow for more modern AMD GPUs definitively though. PCIe 1.0 X2. Yikes.
There's two gen 2 x16 slots but you're only using one of them for an RX 560. Is the GPU two slots wide? How does that fit in an Xserve? Are you planning on using something else in the other slot?
 

Ludacrisvp

macrumors 6502a
May 14, 2008
797
363
There's two gen 2 x16 slots but you're only using one of them for an RX 560. Is the GPU two slots wide? How does that fit in an Xserve? Are you planning on using something else in the other slot?
The Xserve is only 1 rack unit tall so you can’t run a dual slot wide card in it. The slot on one side also has less clearance for something larger than 1 slot because there’s the mxm slot heatsink to compete with.
you can see some photos of the guts here.
 

Ulysses_UK

macrumors member
Jan 3, 2022
30
9
There's two gen 2 x16 slots but you're only using one of them for an RX 560. Is the GPU two slots wide? How does that fit in an Xserve? Are you planning on using something else in the other slot?
Well my Xserve has not been 1U for a few years now.... There are some single slot Rx 560's Yeston make one, XFX another. Not too easy to find.

I run an Rx 590 8gb currently, but have run a 6600XT, 5700 XT, Vega 56.....I use a PCI extender with dual slot bracket and an external PSU.

I was not happy with the noise of my xserve, and when i upgraded to dual 6 cores, i felt it need a cooling system upgrade. So im more like 4U-ish

I use the other PCIe 2.0 for an Kyro evo M.2 NVME. Bootable and works great. I've probably try using the mxm slot for usb 3.0 with m.2 to pcie x4 adaptor. or for a second nvme.
 

joevt

macrumors 604
Jun 21, 2012
6,971
4,262
Well my Xserve has not been 1U for a few years now.... There are some single slot Rx 560's Yeston make one, XFX another. Not too easy to find.

I run an Rx 590 8gb currently, but have run a 6600XT, 5700 XT, Vega 56.....I use a PCI extender with dual slot bracket and an external PSU.

I was not happy with the noise of my xserve, and when i upgraded to dual 6 cores, i felt it need a cooling system upgrade. So im more like 4U-ish

I use the other PCIe 2.0 for an Kyro evo M.2 NVME. Bootable and works great. I've probably try using the mxm slot for usb 3.0 with m.2 to pcie x4 adaptor. or for a second nvme.
Another option (though super expensive) is external PCIe chassis, like the Netstor NA255A that I have for my MacPro3,1. It gives you 4 double wide PCIe gen 3 x8 slots. Comes with a PSU.
 

Ulysses_UK

macrumors member
Jan 3, 2022
30
9
Another option (though super expensive) is external PCIe chassis, like the Netstor NA255A that I have for my MacPro3,1. It gives you 4 double wide PCIe gen 3 x8 slots. Comes with a PSU.
That is interesting, but, yes kind of expensive is an understatement! You'd definitely need to have the extra PCIe.
I'm content in gaining the use of one PCIe 1.0 X2 port from the mxm slot for potentially 40 euros.

I ran two Vegas in my xserve for a while just to see how OS X would detect them. It worked. Two or more GPU's connecting through one PCIe 2.0 x16. That'd be fun to see. Look nice and beefy PSU as well.

Curious what you use in that?
 

joevt

macrumors 604
Jun 21, 2012
6,971
4,262
Curious what you use in that?
Mostly for experiments. The slots are gen 3 so I can get full performance from gen 3 PCIe cards up to x8.

I've got a ASUS ThunderboltEX 4, Gigabyte GC-TITAN RIDGE, and Gigabyte GC-ALPINE RIDGE. They all work as USB 3.1 gen 2 cards (the Alpine Ridge requires some EFI code before startup to enable USB). I haven't done a lot of Thunderbolt stuff with them. A warm boot from Windows can enable PCIe tunnelling but not hot plug. I would need to flash the cards and/or add a Thunderbolt SSDT. The Thunderbolt cards can convert DisplayPort to USB-C DisplayPort Alt Mode.
https://forums.macrumors.com/threads/testing-tb3-aic-with-mp-5-1.2143042/

Recently, I did some testing with a Radeon HD 4870 Mac Upgrade GPU that I had before I got the EVGA GTX 680 Mac Edition.
https://forums.macrumors.com/thread...ngs-another-t221-thread.2387219/post-32118394
 
  • Like
Reactions: Ulysses_UK

Ulysses_UK

macrumors member
Jan 3, 2022
30
9
That is a lot of thunderbolt. I've considered a thunderbolt card, but, have no real need for it just now. Seen a few flashed cards for sale on ebay. I'll keep limping by on fw800.


I had a mac pro 3.1 and EVGA 680 (PC version but flashed for mac.) It's was a fast card. Not far off a GTX 970.
 

osxster

macrumors member
Mar 7, 2012
59
53
Hello,

Question for anyone who is running the MacPro 5,1 firmware on the 3,1 Xserve using the x5690 CPU's (assuming that is the fastest you can get), how is the noise on the server? Does the fan array stay quiet except when there is load on the system, or does it ramp up at 100% because it is an unsupported CPU or unsupported firmware? I'm running the x5570 2.93 GHz CPU's in my 3,1 right now with the latest stock firmware. The Fans respond properly and they only are loud during initial boot and under high CPU / high heat conditions. I had put in the 3.33 CPU's a while back, with those CPU's which were never supported with the 3,1 firmware, the fans run at 100% and the thing is just way too loud. I'd consider the MacPro 5,1 firmware hack to put in x5690's, but only if the fan array works properly. There is no way to silence the box otherwise.
 

Ludacrisvp

macrumors 6502a
May 14, 2008
797
363
Hello,

Question for anyone who is running the MacPro 5,1 firmware on the 3,1 Xserve using the x5690 CPU's (assuming that is the fastest you can get), how is the noise on the server? Does the fan array stay quiet except when there is load on the system, or does it ramp up at 100% because it is an unsupported CPU or unsupported firmware? I'm running the x5570 2.93 GHz CPU's in my 3,1 right now with the latest stock firmware. The Fans respond properly and they only are loud during initial boot and under high CPU / high heat conditions. I had put in the 3.33 CPU's a while back, with those CPU's which were never supported with the 3,1 firmware, the fans run at 100% and the thing is just way too loud. I'd consider the MacPro 5,1 firmware hack to put in x5690's, but only if the fan array works properly. There is no way to silence the box otherwise.
The fan array should work fine. They are controlled by the SMC rather than the bootROM.

We don’t change the SMC in this crossflashing of the rom.

I have L5640 in my 3,1 crossflashed which I’m not sure if they were ever used by Apple and the fans seem to behave properly to me.
 

osxster

macrumors member
Mar 7, 2012
59
53
The fan array should work fine. They are controlled by the SMC rather than the bootROM.

We don’t change the SMC in this crossflashing of the rom.

I have L5640 in my 3,1 crossflashed which I’m not sure if they were ever used by Apple and the fans seem to behave properly to me.
Interesting though, I wonder why when I upgraded to the W5590 processors, the fans ramped up to 100%? The processors worked, but the box was so loud I couldn't really leave it like that. That was my primary concern with this upgrade. Do the hard drive lights, ethernet, and power lights still work as intended? The article in this thread says those work, but I read from other people that they don't after the flash.
 

stcm

macrumors member
Aug 30, 2020
48
34
Japan
I finally succeeded in installing Windows on the Xserve(MP5,1 flashed ).
What I used was OCLP, WX7100(GOP), and Windows 2019SV(USB).
Needless to say, without BOOTCAMP; UEFI mode.
IMG_3501.JPG IMG_3480.JPG IMG_3481.JPG IMG_3482.JPG IMG_3483.JPG
IMG_3484.JPG IMG_3488.JPG IMG_3492.JPG IMG_3493.JPG IMG_3494.JPG

Naturally, it's a good to also install BOOTCAMP after the installation is complete.
Also, the "Intel 82574L" was not automatically recognized, so I had to manually install the driver.
IMG_3498.JPG IMG_3502.JPG IMG_3503.JPG
IMG_3504.JPG Screenshot 2024-03-18 at 19.30.55.jpg


Have a good Xserve ;)
 
  • Like
Reactions: Ludacrisvp

Ludacrisvp

macrumors 6502a
May 14, 2008
797
363
need to do anything special to make it happen?
what's your RAM setup? with 192GB i assume you're doing opencore custom memory layout with the 12 dimms populated? curious if windows will handle the 12 dimms directly.
 

stcm

macrumors member
Aug 30, 2020
48
34
Japan
need to do anything special to make it happen?
what's your RAM setup? with 192GB i assume you're doing opencore custom memory layout with the 12 dimms populated? curious if windows will handle the 12 dimms directly.
Sorry for the late reply. In order to use 12 ram sticks, you need to manually configure them using OC. Don't forget to set 'Custom Memory' to "True".
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.