Highpoint 7101A - PCIe 3.0 SSD performance for the cMP

handheldgames · Jul 2, 2018

More details.....

Unexpected slowdowns
Running in the following configuration, slots 1 & 2 drop to an 8x connection, limiting performance to 3000 MB/sec.

slot1: hpt ssd 7101a 16x (max bandwidth = 3000MB/sec)
slot2: amfeltec squid 16x (max bandwidth = 3000MB/sec)
slot3: apple 1tb ssd 4x
slot4: nvs 510 video card 16x

Regained performance
Rearranging and rebooting, the amfeltec delivered x16 performance with 5900MB/sec with 4 SM951's.

slot1: nvs 510 video card 16x
slot2: amfeltec squid 16x (max bandwidth = 5900MB/sec)
slot3: apple 1tb ssd 4x

Raid scaling capped at 3000MB/Sec
Booting with the Highpoint 7101a in place of the amfeltec, performance is still locked with a maximum of 3000 MB/Sec.

slot1: nvs 510 video card 16x
slot2: hpt ssd 7101a 16x (max bandwidth = 3000MB/sec)
slot3: apple 1tb ssd 4x

Until Highpoint deliver's the drivers promised for July of 2018, The ssd7101a stands as the fastest bootable PCIe SSD card available today, leaving the PCIe SSD Raid 0 Crown to the Amfeltec squid.

... to be continued

handheldgames · Jul 2, 2018

I need help from a setpci expert, perhaps @h9826790?

Without drivers to setup the ssd7101a is running at x16 2.5 gt/s in slot 2. I need help setting up a setpci terminal command to force the connection change to 5.0 gt/s and to refresh the bus.

The 7101a is sitting at connect 07.0

Code:

-[0000:00]-+-00.0  Intel Corporation 5520/5500/X58 I/O Hub to ESI Port
           +-01.0-[0000:01-04]----00.0-[0000:02-04]--+-02.0-[0000:03]----00.0  Samsung Electronics Co Ltd Apple PCIe SSD
           |                                         \-04.0-[0000:04]--
           +-03.0-[0000:05]--+-00.0  NVIDIA Corporation GK107 [NVS 510]
           |                 \-00.1  NVIDIA Corporation GK107 HDMI Audio Controller
           +-07.0-[0000:06-0b]----00.0-[0000:07-0b]--+-08.0-[0000:08]--
           |                                         +-09.0-[0000:09]--
           |                                         +-10.0-[0000:0a]----00.0  Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981
           |                                         \-11.0-[0000:0b]----00.0  Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981

Details from port 06

Code:

MacPro:~ thomasfessler$ lspci -nnvv -s 06:00.0
06:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747] (rev ca) (prog-if 00 [Normal decode])
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0, Cache Line Size: 256 bytes
    Region 0: Memory at 93600000 (32-bit, non-prefetchable)
    Bus: primary=06, secondary=07, subordinate=0b, sec-latency=0
    Memory behind bridge: 93400000-935fffff
    Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
    BridgeCtl: Parity- SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
        PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
    Capabilities: [40] Power Management version 3
        Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
        Status: D0 PME-Enable- DSel=0 DScale=0 PME-
    Capabilities: [48] Message Signalled Interrupts: Mask+ 64bit+ Queue=0/3 Enable-
        Address: 0000000000000000  Data: 0000
        Masking: 00000000  Pending: 00000000
    Capabilities: [68] Express (v2) Upstream Port, MSI 00
        DevCap:    MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
            ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-SlotPowerLimit 0.000000W
        DevCtl:    Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
            RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
            MaxPayload 128 bytes, MaxReadReq 128 bytes
        DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
        LnkCap:    Port #0, Speed unknown, Width x16, ASPM unknown, Latency L0 <4us, L1 <4us
            ClockPM- Suprise- LLActRep- BwNot-
        LnkCtl:    ASPM Disabled; Disabled- Retrain- CommClk-
            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
        LnkSta:    Speed 2.5GT/s, Width x16, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
    Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747]
    Capabilities: [100] #10b5
    Capabilities: [874] #6903
    Capabilities: [004] Root Complex Event Collector <?>
    Capabilities: [001] #4710
    Capabilities: [078] #00
    Capabilities: [010] #00
    Capabilities: [936] #40

edgerider · Jul 3, 2018

Now that i have received my 8x16 pcie swich lets see what we can get of a 10 year old macpro!
to be honest, I have now idea if it’s gona work, but hey at least it will go in the basement to mine etherium with 8 gtx 1060

h9826790 · Jul 3, 2018

handheldgames said:

I need help from a setpci expert, perhaps @h9826790?

Without drivers to setup the ssd7101a is running at x16 2.5 gt/s in slot 2. I need help setting up a setpci terminal command to force the connection change to 5.0 gt/s and to refresh the bus.

The 7101a is sitting at connect 07.0

Code:

-[0000:00]-+-00.0  Intel Corporation 5520/5500/X58 I/O Hub to ESI Port
           +-01.0-[0000:01-04]----00.0-[0000:02-04]--+-02.0-[0000:03]----00.0  Samsung Electronics Co Ltd Apple PCIe SSD
           |                                         \-04.0-[0000:04]--
           +-03.0-[0000:05]--+-00.0  NVIDIA Corporation GK107 [NVS 510]
           |                 \-00.1  NVIDIA Corporation GK107 HDMI Audio Controller
           +-07.0-[0000:06-0b]----00.0-[0000:07-0b]--+-08.0-[0000:08]--
           |                                         +-09.0-[0000:09]--
           |                                         +-10.0-[0000:0a]----00.0  Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981
           |                                         \-11.0-[0000:0b]----00.0  Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981

Details from port 06

Code:

MacPro:~ thomasfessler$ lspci -nnvv -s 06:00.0
06:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747] (rev ca) (prog-if 00 [Normal decode])
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0, Cache Line Size: 256 bytes
    Region 0: Memory at 93600000 (32-bit, non-prefetchable)
    Bus: primary=06, secondary=07, subordinate=0b, sec-latency=0
    Memory behind bridge: 93400000-935fffff
    Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
    BridgeCtl: Parity- SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
        PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
    Capabilities: [40] Power Management version 3
        Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
        Status: D0 PME-Enable- DSel=0 DScale=0 PME-
    Capabilities: [48] Message Signalled Interrupts: Mask+ 64bit+ Queue=0/3 Enable-
        Address: 0000000000000000  Data: 0000
        Masking: 00000000  Pending: 00000000
    Capabilities: [68] Express (v2) Upstream Port, MSI 00
        DevCap:    MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
            ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-SlotPowerLimit 0.000000W
        DevCtl:    Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
            RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
            MaxPayload 128 bytes, MaxReadReq 128 bytes
        DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
        LnkCap:    Port #0, Speed unknown, Width x16, ASPM unknown, Latency L0 <4us, L1 <4us
            ClockPM- Suprise- LLActRep- BwNot-
        LnkCtl:    ASPM Disabled; Disabled- Retrain- CommClk-
            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
        LnkSta:    Speed 2.5GT/s, Width x16, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
    Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747]
    Capabilities: [100] #10b5
    Capabilities: [874] #6903
    Capabilities: [004] Root Complex Event Collector <?>
    Capabilities: [001] #4710
    Capabilities: [078] #00
    Capabilities: [010] #00
    Capabilities: [936] #40

Tried this yet?

https://forums.macrumors.com/thread...-ssds-5900-mb-s.1936311/page-13#post-26209797

handheldgames · Jul 3, 2018

h9826790 said:
Tried this yet?

https://forums.macrumors.com/thread...-ssds-5900-mb-s.1936311/page-13#post-26209797

Using this script:

#!/bin/bash
# No arguments sanity checking done

rootport=$1
speed=2;

linkstatus=$(sudo setpci -s $rootport CAP_EXP+12.w);
echo '# Initial PCIe' $(( 0x$linkstatus & 15)).0 x$(( 0x$linkstatus >> 4 & 31))

sudo setpci -s $rootport CAP_EXP+30.w=$speed:F
sudo setpci -s $rootport CAP_EXP+10.w=20:20

linkstatus=$(sudo setpci -s $rootport CAP_EXP+12.w);
echo '# Final PCIe' $(( 0x$linkstatus & 15)).0 x$(( 0x$linkstatus >> 4 & 31))

It errors out on the slot number:

MacPro:desktop $ sh set_pciv2.sh
setpci: -s: Invalid slot number
# Initial PCIe 0.0 x0
setpci: -s: Invalid bus number
setpci: -s: Invalid bus number
setpci: -s: Invalid slot number
# Final PCIe 0.0 x0

h9826790 · Jul 3, 2018

So, what will happen if you run

Code:

sudo setpci -s 00:7 CAP_EXP+30.w=2:F

and

Code:

sudo setpci -s 00:7 CAP_EXP+10.w=20:20

handheldgames · Jul 3, 2018

h9826790 said:
So, what will happen if you run

Code:

sudo setpci -s 00:7 CAP_EXP+30.w=2:F

and

Code:

sudo setpci -s 00:7 CAP_EXP+10.w=20:20

setpci: Unknown register "CAP_EXP+30"

h9826790 · Jul 3, 2018

What's the return if you enter

Code:

sudo lspci -nnvv -s 00:7

handheldgames · Jul 3, 2018

h9826790 said:
What's the return if you enter

Code:

sudo lspci -nnvv -s 00:7

with 07:

Code:

MacPro:desktop thomasfessler$ sudo lspci -nnvv -s 00:7
00:07.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 7 [8086:340e] (rev 13) (prog-if 00 [Normal decode])
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0, Cache Line Size: 256 bytes
    Bus: primary=00, secondary=06, subordinate=0b, sec-latency=0
    Memory behind bridge: 93400000-936fffff
    Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
    BridgeCtl: Parity- SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
        PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
    Capabilities: [40] Subsystem: Intel Corporation Unknown device [8086:0000]
    Capabilities: [60] Message Signalled Interrupts: Mask+ 64bit- Queue=0/1 Enable-
        Address: 00000020  Data: 0000
        Masking: 00000000  Pending: 00000000
    Capabilities: [90] Express (v2) Root Port (Slot+), MSI 00
        DevCap:    MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
            ExtTag+ RBE+ FLReset-
        DevCtl:    Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
            RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
            MaxPayload 128 bytes, MaxReadReq 128 bytes
        DevSta:    CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
        LnkCap:    Port #7, Speed 5GT/s, Width x16, ASPM unknown, Latency L0 <512ns, L1 <4us
            ClockPM- Suprise+ LLActRep+ BwNot+
        LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
            ExtSynch+ ClockPM- AutWidDis- BWInt- AutBWInt-
        LnkSta:    Speed 2.5GT/s, Width x16, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-
        SltCap:    AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug- Surpise+
            Slot # 80, PowerLimit 0.000000; Interlock+ NoCompl-
        SltCtl:    Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
            Control: AttnInd Off, PwrInd Off, Power- Interlock-
        SltSta:    Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
            Changed: MRL- PresDet- LinkState-
        RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible-
        RootCap: CRSVisible-
        RootSta: PME ReqID 0000, PMEStatus- PMEPending-
    Capabilities: [e0] Power Management version 3
        Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
        Status: D0 PME-Enable- DSel=0 DScale=0 PME-
    Capabilities: [100] #8086
    Capabilities: [340] #600d

I had to use address 00:6:0 to see the card

Code:

MacPro:desktop thomasfessler$ sudo lspci -nnvv -s 00:6:0
06:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747] (rev ca) (prog-if 00 [Normal decode])
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0, Cache Line Size: 256 bytes
    Region 0: Memory at 93600000 (32-bit, non-prefetchable)
    Bus: primary=06, secondary=07, subordinate=0b, sec-latency=0
    Memory behind bridge: 93400000-935fffff
    Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
    BridgeCtl: Parity- SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
        PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
    Capabilities: [40] Power Management version 3
        Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
        Status: D0 PME-Enable- DSel=0 DScale=0 PME-
    Capabilities: [48] Message Signalled Interrupts: Mask+ 64bit+ Queue=0/3 Enable-
        Address: 0000000000000000  Data: 0000
        Masking: 00000000  Pending: 00000000
    Capabilities: [68] Express (v2) Upstream Port, MSI 00
        DevCap:    MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
            ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-SlotPowerLimit 0.000000W
        DevCtl:    Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
            RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
            MaxPayload 128 bytes, MaxReadReq 128 bytes
        DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
        LnkCap:    Port #0, Speed unknown, Width x16, ASPM unknown, Latency L0 <4us, L1 <4us
            ClockPM- Suprise- LLActRep- BwNot-
        LnkCtl:    ASPM Disabled; Disabled- Retrain- CommClk-
            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
        LnkSta:    Speed 2.5GT/s, Width x16, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
    Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747]
    Capabilities: [100] #10b5
    Capabilities: [874] #6903
    Capabilities: [004] Root Complex Event Collector <?>
    Capabilities: [001] #4710
    Capabilities: [078] #00
    Capabilities: [010] #00
    Capabilities: [936] #40

h9826790 · Jul 3, 2018

handheldgames said:

with 07:

Code:

MacPro:desktop thomasfessler$ sudo lspci -nnvv -s 00:7
00:07.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 7 [8086:340e] (rev 13) (prog-if 00 [Normal decode])
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0, Cache Line Size: 256 bytes
    Bus: primary=00, secondary=06, subordinate=0b, sec-latency=0
    Memory behind bridge: 93400000-936fffff
    Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
    BridgeCtl: Parity- SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
        PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
    Capabilities: [40] Subsystem: Intel Corporation Unknown device [8086:0000]
    Capabilities: [60] Message Signalled Interrupts: Mask+ 64bit- Queue=0/1 Enable-
        Address: 00000020  Data: 0000
        Masking: 00000000  Pending: 00000000
    Capabilities: [90] Express (v2) Root Port (Slot+), MSI 00
        DevCap:    MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
            ExtTag+ RBE+ FLReset-
        DevCtl:    Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
            RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
            MaxPayload 128 bytes, MaxReadReq 128 bytes
        DevSta:    CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
        LnkCap:    Port #7, Speed 5GT/s, Width x16, ASPM unknown, Latency L0 <512ns, L1 <4us
            ClockPM- Suprise+ LLActRep+ BwNot+
        LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
            ExtSynch+ ClockPM- AutWidDis- BWInt- AutBWInt-
        LnkSta:    Speed 2.5GT/s, Width x16, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-
        SltCap:    AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug- Surpise+
            Slot # 80, PowerLimit 0.000000; Interlock+ NoCompl-
        SltCtl:    Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
            Control: AttnInd Off, PwrInd Off, Power- Interlock-
        SltSta:    Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
            Changed: MRL- PresDet- LinkState-
        RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible-
        RootCap: CRSVisible-
        RootSta: PME ReqID 0000, PMEStatus- PMEPending-
    Capabilities: [e0] Power Management version 3
        Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
        Status: D0 PME-Enable- DSel=0 DScale=0 PME-
    Capabilities: [100] #8086
    Capabilities: [340] #600d

I had to use address 00:6:0 to see the card

Code:

MacPro:desktop thomasfessler$ sudo lspci -nnvv -s 00:6:0
06:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747] (rev ca) (prog-if 00 [Normal decode])
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0, Cache Line Size: 256 bytes
    Region 0: Memory at 93600000 (32-bit, non-prefetchable)
    Bus: primary=06, secondary=07, subordinate=0b, sec-latency=0
    Memory behind bridge: 93400000-935fffff
    Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
    BridgeCtl: Parity- SERR+ NoISA- VGA- MAbort- >Reset- FastB2B-
        PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
    Capabilities: [40] Power Management version 3
        Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
        Status: D0 PME-Enable- DSel=0 DScale=0 PME-
    Capabilities: [48] Message Signalled Interrupts: Mask+ 64bit+ Queue=0/3 Enable-
        Address: 0000000000000000  Data: 0000
        Masking: 00000000  Pending: 00000000
    Capabilities: [68] Express (v2) Upstream Port, MSI 00
        DevCap:    MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
            ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-SlotPowerLimit 0.000000W
        DevCtl:    Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
            RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
            MaxPayload 128 bytes, MaxReadReq 128 bytes
        DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
        LnkCap:    Port #0, Speed unknown, Width x16, ASPM unknown, Latency L0 <4us, L1 <4us
            ClockPM- Suprise- LLActRep- BwNot-
        LnkCtl:    ASPM Disabled; Disabled- Retrain- CommClk-
            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
        LnkSta:    Speed 2.5GT/s, Width x16, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
    Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747]
    Capabilities: [100] #10b5
    Capabilities: [874] #6903
    Capabilities: [004] Root Complex Event Collector <?>
    Capabilities: [001] #4710
    Capabilities: [078] #00
    Capabilities: [010] #00
    Capabilities: [936] #40

My understanding is to set the root port's (the slot) speed, but not the card.

And 00:7 looks correct to me, that should be your slot 2.

LnkCap: Port #7, Speed 5GT/s, Width x16, ASPM unknown, Latency L0 <512s

LnkSta: Speed 2.5GT/s, Width x16, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-

LnkCap suggest that's a 5GT/s x16 slot. And LnkSta shows that the current connection is 2.5GT/s x16. Which perfectly fit your situation.

But I never see "setpci: Unknown register "CAP_EXP+30"" before.

I just tested on my cMP. I can run "sudo setpci -s 00:7 CAP_EXP+30.w=2:F" and "sudo setpci -s 00:7 CAP_EXP+10.w=20:20" without any error (I put my USB 3.0 card at slot 2 to simulate your situation).

handheldgames · Jul 3, 2018

which version of setpci are you running? I've downloaded / make and make install with the latest version from GitHub. Running on 10.3.5.

h9826790 · Jul 3, 2018

handheldgames said:
which version of setpci are you running? I've downloaded / make and make install with the latest version from GitHub. Running on 10.3.5.

same here.

handheldgames · Jul 3, 2018

Ok.. it looks like version 2.29 is installed somewhere on this version of macOS. I've downloaded and installed 3.6 from the terminal.

h9826790 · Jul 3, 2018

handheldgames said:
Ok.. it looks like version 2.29 is installed somewhere on this version of macOS. I've downloaded and installed 3.6 from the terminal.

I though I am running the latest version. But it's just 3.5.6.

handheldgames · Jul 3, 2018

Getting closer,

DirectHW.kext not loaded.... Version 1.3 does not like high sierra.

I found version 1.4 of directHW on a forum...Installs with KextDrop in High Sierra.

running
sudo setpci -s 00:7 CAP_EXP+30.w=2:F
sudo setpci -s 00:7 CAP_EXP+10.w=20:20

Thanks for all your help @h9826790 !!!!!

This is for TWO 970 pro's in the ssd7101a. To be exact, I created a 256GB Partition on 970 PRO 512 AND a 256GB partition on a 970 Pro 1TB. Booting off a 1TB SSBUX in PCIe slot 3.

handheldgames · Jul 9, 2018

Some additional insight..

Speed comes with a price.. Fan noise. The expression of "silence is golden" clearly does not apply to the 7101A. My Mac Pro used to be silent with the Amfeltec Squid, not any more.

Whilst the small fan on card does a great job of cooling the SSD, the effort to push air through a low profile / channeled heatsink cover could make some users cringe.

Amfeltec Squid for comparison

crjackson2134 · Jul 9, 2018

handheldgames said:
Getting closer,

DirectHW.kext not loaded.... Version 1.3 does not like high sierra.

I found version 1.4 of directHW on a forum...Installs with KextDrop in High Sierra.

running
sudo setpci -s 00:7 CAP_EXP+30.w=2:F
sudo setpci -s 00:7 CAP_EXP+10.w=20:20

Thanks for all your help @h9826790 !!!!!

This is for TWO 970 pro's in the ssd7101a. To be exact, I created a 256GB Partition on 970 PRO 512 AND a 256GB partition on a 970 Pro 1TB. Booting off a 1TB SSBUX in PCIe slot 3.

View attachment 768901
View attachment 768903
View attachment 768905

That's scary fast... It might eventually suck your whole Mac inside the SSD.

Hopefully it won't create a blackhole

handheldgames · Jul 9, 2018

crjackson2134 said:
That's scary fast... It might eventually suck your whole Mac inside the SSD.

Hopefully it won't create a blackhole

No black hole. LOL. Unfortunately, the 7101A hits the same 6000 MB/sec ceiling encountered by the amfeltec squid.

I'll leave the task of making blackholes to the scientists with overclocked lasers. Scarily, they seem to be getting better at it.

w1z · Jul 9, 2018

handheldgames said:
Some additional insight..

Speed comes with a price.. Fan noise. The expression of "silence is golden" clearly does not apply to the 7101A. My Mac Pro used to be silent with the Amfeltec Squid, not any more.

Whilst the small fan on card does a great job of cooling the SSD, the effort to push air through a low profile / channeled heatsink cover could make some users cringe.

Good candidate for a custom cooling mod or by simply adding a variable resistor.. A couple of more days and I should have this card.

nekton1 · Jul 9, 2018

W1SS
Looking forward to seeing the results of your NVMe boot rom experiment with 7101a on Mojave and MP3,1.

handheldgames · Jul 10, 2018

W1SS said:
Good candidate for a custom cooling mod or by simply adding a variable resistor.. A couple of more days and I should have this card.

Great ideas. It will be interesting to see how your results with the Amfeltec Squid from this post

...tested various link speeds of the gen 3 amfeltec card in both a 2008 Mac Pro and a Hackintosh (GA-Z170X Gaming 7). The 2008 Mac Pro seems to be able to get only slightly above 4000 MB/s using 5GT/s x16. This is much lower than the 2010 Mac Pro is capable of with the gen 2 amfeltec card, but it is still greater than what 2.5 GT/s x16 allows which proves that 5 GT/s x16 is working. It may be that the 2008 Mac Pro's CPU and RAM don't allow this benchmark to saturate the PCIe slot's bandwidth which means that a gen 2 amfeltec card would have the same result in the 2008 Mac Pro.

edgerider · Jul 10, 2018

handheldgames said:
Getting closer,

DirectHW.kext not loaded.... Version 1.3 does not like high sierra.

I found version 1.4 of directHW on a forum...Installs with KextDrop in High Sierra.

running
sudo setpci -s 00:7 CAP_EXP+30.w=2:F
sudo setpci -s 00:7 CAP_EXP+10.w=20:20

Thanks for all your help @h9826790 !!!!!

This is for TWO 970 pro's in the ssd7101a. To be exact, I created a 256GB Partition on 970 PRO 512 AND a 256GB partition on a 970 Pro 1TB. Booting off a 1TB SSBUX in PCIe slot 3.

View attachment 768901
View attachment 768903
View attachment 768905

can you detail?
I cant get over 3800Mb r/w with 4sm951 256

TTAX · Jul 11, 2018

handheldgames said:
Without drivers, the Highpoint 7101A card appears to have a max transfer rate of 3000 MB/S in the cMP. So it doesn't scale well, but it delivers enthusiast class PCIe 3.0 transfer rates to an aging Mac from 2009.

With 2 970 Pro's in RAID0,
average Maximum Read speed is 3126 MB/Sec.
average Maximum write speed is 2932 MB/Sec.

970 Pro 1TB
average Maximum Read speed is 3071 MB/Sec.
average Maximum write speed is 2622 MB/Sec.

970 Pro 512GB
average Maximum Read speed is 3051 MB/Sec.
average Maximum write speed is 2236 MB/Sec.

FWIW.. This brings back memories of adding a Radius Rocket to my mac IIx.

First of all, thank you for the amazing guide. But I have a question. Adding the NVMe boot support, it's possible to boot from the Nvme or it will just be a scratch disk. Thank you

h9826790 · Jul 11, 2018

TTAX said:
First of all, thank you for the amazing guide. But I have a question. Adding the NVMe boot support, it's possible to boot from the Nvme or it will just be a scratch disk. Thank you

Boot

TTAX · Jul 11, 2018

h9826790 said:
Boot

Thank you very much for the information. I have a
Samsung 960 EVO NVMe M.2 on the way. will make test and share!

Highpoint 7101A - PCIe 3.0 SSD performance for the cMP

macrumors 68000

macrumors 68000

macrumors 6502

macrumors P6

macrumors 68000

macrumors P6

macrumors 68000

macrumors P6

macrumors 68000

macrumors P6

macrumors 68000

macrumors P6

macrumors 68000

macrumors P6

macrumors 68000

macrumors 68000

macrumors 601

macrumors 68000

macrumors 6502a

macrumors 65816

macrumors 68000

macrumors 6502

macrumors newbie

macrumors P6

macrumors newbie

Our Staff