MP 1,1-5,1 Help please - 4,1 random restarts

[vel0city]

Our studio Mac Pro 4, 1 flashed to 5, 1 randomly restarts. It has an Nvidia GTX 1080ti and Pixlas Mod professionally installed. Nothing specific appears to trigger the restarts, it could be using Finder, a Browser, Adobe CC, or C4D. They seem to be getting more frequent which perhaps points to a component failing but maybe it's just random.

So far we've tried replacing all the RAM, swapped out the processors, tried running with all peripherals disconnected, ensured everything is dust free, reseated all RAM, CPU and GPU, updating to latest High Sierra and Nvidia/CUDA drivers, but nothing has solved it.

Could it be a faulty PSU?

Can anyone running a similar setup confirm that they are using a 4, 1 or 5, 1 with no issues?

Latest Panic report in the spoiler. Thank you so much for any pointers.

Spoiler: Panic report

*** Panic Report *** Panic(CPU 0, time 89534611903704): NMIPI for unresponsive processor: TLB flush timeout, TLB state:0x0 RAX: 0xffffff80a513e7c0, RBX: 0xffffff8014ebfc70, RCX: 0x0000000000000378, RDX: 0x000119bc00000000 RSP: 0xffffff8748c837f0, RBP: 0xffffff8748c83830, RSI: 0xffffff80a5708000, RDI: 0xffffff8014ebfc70 R8: 0xfffffffffffff000, R9: 0x0000000000000000, R10: 0x0000000000af26a9, R11: 0xffffff80b0c837a1 R12: 0xffffff80a5708000, R13: 0xffffff80a513e7c0, R14: 0x000119bc5d8b58ee, R15: 0x0000000000000000 RFL: 0x0000000000000087, RIP: 0xffffff8014679df2, CS: 0x0000000000000008, SS: 0x0000000000000010 Backtrace (CPU 0), Frame : Return Address 0xffffff871766cf70 : 0xffffff8014785e44 0xffffff871766cfd0 : 0xffffff801461d016 0xffffff8748c83830 : 0xffffff8014679f04 0xffffff8748c83860 : 0xffffff801477d5ff 0xffffff8748c838a0 : 0xffffff8014768a68 0xffffff8748c83a00 : 0xffffff80146f0b3c 0xffffff8748c83ae0 : 0xffffff80146b79e3 0xffffff8748c83c10 : 0xffffff801464c906 0xffffff8748c83c40 : 0xffffff801464d503 0xffffff8748c83c90 : 0xffffff8014670b12 0xffffff8748c83cd0 : 0xffffff7f94f987e5 0xffffff8748c83d10 : 0xffffff7f94fefe11 0xffffff8748c83d30 : 0xffffff7f950a8386 0xffffff8748c83d80 : 0xffffff7f950ed928 0xffffff8748c83da0 : 0xffffff7f9597fa5f 0xffffff8748c83e10 : 0xffffff7f94ff7004 0xffffff8748c83ed0 : 0xffffff8014c988a5 0xffffff8748c83f30 : 0xffffff8014c97012 0xffffff8748c83f70 : 0xffffff8014c9663c 0xffffff8748c83fa0 : 0xffffff801461c557 Kernel Extensions in backtrace: com.nvidia.web.NVDAResmanWeb(10.3.3)[B8392A73-F83A-3D0D-B4A8-174F9BFFDE06]@0xffffff7f94f91000->0xffffff7f95609fff dependency: com.apple.iokit.IOPCIFamily(2.9)[F763C275-306F-358F-B6B0-0FD93486BD5F]@0xffffff7f94e94000 dependency: com.apple.iokit.IONDRVSupport(519.21)[B9EB0174-55E4-3CB1-9802-E74BB1BD5EF0]@0xffffff7f94f75000 dependency: com.apple.iokit.IOGraphicsFamily(519.23)[81D774E8-DD11-3866-B90A-E855215EDB60]@0xffffff7f94f1f000 dependency: com.apple.AppleGraphicsDeviceControl(3.20.18)[39C0D061-25CF-3D9B-815F-D99FF4E1455B]@0xffffff7f94f85000 com.nvidia.web.NVDAGP100HalWeb(10.3.3)[76B91C29-8578-33E2-9C91-A6CB7C5E2C56]@0xffffff7f95838000->0xffffff7f959defff dependency: com.nvidia.web.NVDAResmanWeb(10.3.3)[B8392A73-F83A-3D0D-B4A8-174F9BFFDE06]@0xffffff7f94f91000 dependency: com.apple.iokit.IOPCIFamily(2.9)[F763C275-306F-358F-B6B0-0FD93486BD5F]@0xffffff7f94e94000 BSD process name corresponding to current thread: kernel_task Mac OS version: 17G14042 Kernel version: Darwin Kernel Version 17.7.0: Fri Oct 30 13:34:27 PDT 2020; root:xnu-4570.71.82.8~1/RELEASE_X86_64 Kernel UUID: 5E83A13A-32F5-3604-8591-50E2F2F70DC6 Kernel slide: 0x0000000014400000 Kernel text base: 0xffffff8014600000 __HIB text base: 0xffffff8014500000 System model name: MacPro5,1 (Mac-F221BEC8) System uptime in nanoseconds: 89534612033000 last loaded kext at 89327862605937: com.apple.driver.usb.cdc.acm 5.0.0 (addr 0xffffff7f97bb6000, size 57344) last unloaded kext at 89388075312807: com.apple.driver.AppleUSBMergeNub 900.4.1 (addr 0xffffff7f97b90000, size 12288) loaded kexts: com.getdropbox.dropbox.kext 1.13.0 com.nvidia.CUDA 1.1.0 com.nvidia.web.GeForceWeb 10.3.3 com.nvidia.web.NVDAGP100HalWeb 10.3.3 com.nvidia.web.NVDAResmanWeb 10.3.3 at.obdev.nke.LittleSnitch 4740 com.apple.filesystems.smbfs 3.2.3 com.apple.filesystems.afpfs 11.1 com.apple.nke.asp-tcp 8.0.2 com.apple.driver.AppleUSBStorageCoexistentDriver 439.70.3 com.apple.driver.AudioAUUC 1.70 com.apple.driver.AppleTopCaseHIDEventDriver 135 com.apple.driver.AppleTyMCEDriver 1.0.3d2 com.apple.driver.AGPM 110.23.37 com.apple.filesystems.autofs 3.0 com.apple.driver.AppleUpstreamUserClient 3.6.5 com.apple.driver.AppleMCCSControl 1.5.5 com.apple.AGDCPluginDisplayMetrics 3.20.18 com.apple.driver.AppleHDA 281.52 com.apple.driver.AppleMikeyHIDDriver 131 com.apple.driver.AppleHV 1 com.apple.iokit.IOUserEthernet 1.0.1 com.apple.iokit.IOBluetoothSerialManager 6.0.7f22 com.apple.driver.AppleMikeyDriver 281.52 com.apple.driver.pmtelemetry 1 com.apple.Dont_Steal_Mac_OS_X 7.0.0 com.apple.driver.AppleLPC 3.1 com.apple.driver.ACPI_SMC_PlatformPlugin 1.0.0 com.apple.driver.AppleIntelSlowAdaptiveClocking 4.0.0 com.apple.driver.AppleOSXWatchdog 1 com.apple.filesystems.apfs 748.51.0 com.apple.driver.AppleUSBDisplays 380 com.apple.filesystems.hfs.kext 407.50.6 com.apple.AppleFSCompression.AppleFSCompressionTypeDataless 1.0.0d1 com.apple.BootCache 40 com.apple.AppleFSCompression.AppleFSCompressionTypeZlib 1.0.0 com.apple.AppleSystemPolicy 1.0 com.apple.iokit.SCSITaskUserClient 404.30.3 com.apple.driver.AppleFWOHCI 5.5.9 com.apple.driver.Intel82574LEthernet 2.7.2 com.apple.driver.AirPort.Brcm4331 800.21.30 com.apple.driver.AppleAHCIPort 329.50.2 com.apple.driver.AppleHPET 1.8 com.apple.driver.AppleRTC 2.0 com.apple.driver.AppleACPIButtons 6.1 com.apple.driver.AppleSMBIOS 2.1 com.apple.driver.AppleACPIEC 6.1 com.apple.driver.AppleAPIC 1.7 com.apple.driver.AppleIntelCPUPowerManagementClient 220.50.1 com.apple.nke.applicationfirewall 186 com.apple.security.TMSafetyNet 8 com.apple.security.quarantine 3 com.apple.driver.AppleIntelCPUPowerManagement 220.50.

 

[Macsonic]

Our studio Mac Pro 4, 1 flashed to 5, 1 randomly restarts. It has an Nvidia GTX 1080ti and Pixlas Mod professionally installed. Nothing specific appears to trigger the restarts, it could be using Finder, a Browser, Adobe CC, or C4D. They seem to be getting more frequent which perhaps points to a component failing but maybe it's just random.

So far we've tried replacing all the RAM, swapped out the processors, tried running with all peripherals disconnected, ensured everything is dust free, reseated all RAM, CPU and GPU, updating to latest High Sierra and Nvidia/CUDA drivers, but nothing has solved it.

Could it be a faulty PSU?

Can anyone running a similar setup confirm that they are using a 4, 1 or 5, 1 with no issues?

Latest Panic report in the spoiler. Thank you so much for any pointers.

Spoiler: Panic report

*** Panic Report *** Panic(CPU 0, time 89534611903704): NMIPI for unresponsive processor: TLB flush timeout, TLB state:0x0 RAX: 0xffffff80a513e7c0, RBX: 0xffffff8014ebfc70, RCX: 0x0000000000000378, RDX: 0x000119bc00000000 RSP: 0xffffff8748c837f0, RBP: 0xffffff8748c83830, RSI: 0xffffff80a5708000, RDI: 0xffffff8014ebfc70 R8: 0xfffffffffffff000, R9: 0x0000000000000000, R10: 0x0000000000af26a9, R11: 0xffffff80b0c837a1 R12: 0xffffff80a5708000, R13: 0xffffff80a513e7c0, R14: 0x000119bc5d8b58ee, R15: 0x0000000000000000 RFL: 0x0000000000000087, RIP: 0xffffff8014679df2, CS: 0x0000000000000008, SS: 0x0000000000000010 Backtrace (CPU 0), Frame : Return Address 0xffffff871766cf70 : 0xffffff8014785e44 0xffffff871766cfd0 : 0xffffff801461d016 0xffffff8748c83830 : 0xffffff8014679f04 0xffffff8748c83860 : 0xffffff801477d5ff 0xffffff8748c838a0 : 0xffffff8014768a68 0xffffff8748c83a00 : 0xffffff80146f0b3c 0xffffff8748c83ae0 : 0xffffff80146b79e3 0xffffff8748c83c10 : 0xffffff801464c906 0xffffff8748c83c40 : 0xffffff801464d503 0xffffff8748c83c90 : 0xffffff8014670b12 0xffffff8748c83cd0 : 0xffffff7f94f987e5 0xffffff8748c83d10 : 0xffffff7f94fefe11 0xffffff8748c83d30 : 0xffffff7f950a8386 0xffffff8748c83d80 : 0xffffff7f950ed928 0xffffff8748c83da0 : 0xffffff7f9597fa5f 0xffffff8748c83e10 : 0xffffff7f94ff7004 0xffffff8748c83ed0 : 0xffffff8014c988a5 0xffffff8748c83f30 : 0xffffff8014c97012 0xffffff8748c83f70 : 0xffffff8014c9663c 0xffffff8748c83fa0 : 0xffffff801461c557 Kernel Extensions in backtrace: com.nvidia.web.NVDAResmanWeb(10.3.3)[B8392A73-F83A-3D0D-B4A8-174F9BFFDE06]@0xffffff7f94f91000->0xffffff7f95609fff dependency: com.apple.iokit.IOPCIFamily(2.9)[F763C275-306F-358F-B6B0-0FD93486BD5F]@0xffffff7f94e94000 dependency: com.apple.iokit.IONDRVSupport(519.21)[B9EB0174-55E4-3CB1-9802-E74BB1BD5EF0]@0xffffff7f94f75000 dependency: com.apple.iokit.IOGraphicsFamily(519.23)[81D774E8-DD11-3866-B90A-E855215EDB60]@0xffffff7f94f1f000 dependency: com.apple.AppleGraphicsDeviceControl(3.20.18)[39C0D061-25CF-3D9B-815F-D99FF4E1455B]@0xffffff7f94f85000 com.nvidia.web.NVDAGP100HalWeb(10.3.3)[76B91C29-8578-33E2-9C91-A6CB7C5E2C56]@0xffffff7f95838000->0xffffff7f959defff dependency: com.nvidia.web.NVDAResmanWeb(10.3.3)[B8392A73-F83A-3D0D-B4A8-174F9BFFDE06]@0xffffff7f94f91000 dependency: com.apple.iokit.IOPCIFamily(2.9)[F763C275-306F-358F-B6B0-0FD93486BD5F]@0xffffff7f94e94000 BSD process name corresponding to current thread: kernel_task Mac OS version: 17G14042 Kernel version: Darwin Kernel Version 17.7.0: Fri Oct 30 13:34:27 PDT 2020; root:xnu-4570.71.82.8~1/RELEASE_X86_64 Kernel UUID: 5E83A13A-32F5-3604-8591-50E2F2F70DC6 Kernel slide: 0x0000000014400000 Kernel text base: 0xffffff8014600000 __HIB text base: 0xffffff8014500000 System model name: MacPro5,1 (Mac-F221BEC8) System uptime in nanoseconds: 89534612033000 last loaded kext at 89327862605937: com.apple.driver.usb.cdc.acm 5.0.0 (addr 0xffffff7f97bb6000, size 57344) last unloaded kext at 89388075312807: com.apple.driver.AppleUSBMergeNub 900.4.1 (addr 0xffffff7f97b90000, size 12288) loaded kexts: com.getdropbox.dropbox.kext 1.13.0 com.nvidia.CUDA 1.1.0 com.nvidia.web.GeForceWeb 10.3.3 com.nvidia.web.NVDAGP100HalWeb 10.3.3 com.nvidia.web.NVDAResmanWeb 10.3.3 at.obdev.nke.LittleSnitch 4740 com.apple.filesystems.smbfs 3.2.3 com.apple.filesystems.afpfs 11.1 com.apple.nke.asp-tcp 8.0.2 com.apple.driver.AppleUSBStorageCoexistentDriver 439.70.3 com.apple.driver.AudioAUUC 1.70 com.apple.driver.AppleTopCaseHIDEventDriver 135 com.apple.driver.AppleTyMCEDriver 1.0.3d2 com.apple.driver.AGPM 110.23.37 com.apple.filesystems.autofs 3.0 com.apple.driver.AppleUpstreamUserClient 3.6.5 com.apple.driver.AppleMCCSControl 1.5.5 com.apple.AGDCPluginDisplayMetrics 3.20.18 com.apple.driver.AppleHDA 281.52 com.apple.driver.AppleMikeyHIDDriver 131 com.apple.driver.AppleHV 1 com.apple.iokit.IOUserEthernet 1.0.1 com.apple.iokit.IOBluetoothSerialManager 6.0.7f22 com.apple.driver.AppleMikeyDriver 281.52 com.apple.driver.pmtelemetry 1 com.apple.Dont_Steal_Mac_OS_X 7.0.0 com.apple.driver.AppleLPC 3.1 com.apple.driver.ACPI_SMC_PlatformPlugin 1.0.0 com.apple.driver.AppleIntelSlowAdaptiveClocking 4.0.0 com.apple.driver.AppleOSXWatchdog 1 com.apple.filesystems.apfs 748.51.0 com.apple.driver.AppleUSBDisplays 380 com.apple.filesystems.hfs.kext 407.50.6 com.apple.AppleFSCompression.AppleFSCompressionTypeDataless 1.0.0d1 com.apple.BootCache 40 com.apple.AppleFSCompression.AppleFSCompressionTypeZlib 1.0.0 com.apple.AppleSystemPolicy 1.0 com.apple.iokit.SCSITaskUserClient 404.30.3 com.apple.driver.AppleFWOHCI 5.5.9 com.apple.driver.Intel82574LEthernet 2.7.2 com.apple.driver.AirPort.Brcm4331 800.21.30 com.apple.driver.AppleAHCIPort 329.50.2 com.apple.driver.AppleHPET 1.8 com.apple.driver.AppleRTC 2.0 com.apple.driver.AppleACPIButtons 6.1 com.apple.driver.AppleSMBIOS 2.1 com.apple.driver.AppleACPIEC 6.1 com.apple.driver.AppleAPIC 1.7 com.apple.driver.AppleIntelCPUPowerManagementClient 220.50.1 com.apple.nke.applicationfirewall 186 com.apple.security.TMSafetyNet 8 com.apple.security.quarantine 3 com.apple.driver.AppleIntelCPUPowerManagement 220.50.

Sorry to hear about your problem. If you can borrow another power supply to pinpoint the problem as it could be the PSU. I had a 2006 Mac Pro that kept on restarting and it was the PSU that had the problem. Try to also get another GPU or a different set of ram. I’m not familiar in reading kernel panic reports, I only saw in the report “unresponsive cpu”. If you can borrow another 2009 Mac Pro to test, that would help.

 

[tsialex]

Did you checked the Northbridge heatsink plastic rivets? NMI and NMIPI crashes are related to the Northbridge and most times are thermally induced.

 

[vel0city]

Thanks both, much appreciated - the Northbridge heatsink plastic rivets - I'm not familiar with that, is there a guide anywhere for checking please? Thanks.

 

[tsialex]

Thanks both, much appreciated - the Northbridge heatsink plastic rivets - I'm not familiar with that, is there a guide anywhere for checking please? Thanks.

Read this thread below:

clip (snap rivet) for Northbridge heat-sink on 2009 Mac Pro 2X2.26

So I just picked up a Mac Pro on the weekend. I tested it prior to purchase with the ASD S3132 diagnostic. It passed everything EXCEPT the TNOD test, where it gave an error that the IOH sensor was above operating temp. Knowing this i purchased the unit at a reduced rate in hopes of fixing it...

forums.macrumors.com

 

[vel0city]

Thanks for the link, my tech said they they checked all the thermals and replaced thermal paste the last time it was in for maintenance.

Is there anything else from the panic reports that we can investigate please?

 

[tsialex]

Don’t take it for granted, inspect it.

 

[vel0city]

I've thoroughly checked the Northbridge heatsink plastic rivets and everything is in order.

Is there anything else I can do before I give up on this machine completely?

 

[mikas]

Check the Pixlas. While easy to do and almost failsafe, you might want to doublecheck the connections.
While doing my dual Pixlas mod and before testing, doublechecking the connectors by pulling the wires, I got this:

Good I bothered to check it one more time.

Of course the PSU is a usual suspect too for these first world war tanks of ours.

 

[vel0city]

Thanks, we checked the Pixlas and all looks good.

The Mac was crashing before the Pixlas was done - we thought the GPU would fix the crashing but it's still the same. All the Panic reports point to the 1880ti.

Worth installing a new PSU? Is there any way of testing it? Thanks again for any ideas.

 

[14UG]

So it crashes in a similar way with 2 entirely different GPUs? Or it crashes with the 1080ti underpowered (before pixlas) and fully powered (after pixlas)?

If it is the latter & you’ve only had one GPU in it all along you definitely need to try another.