Help needed, for my 10GE on Mac Pro

[qiangge]

By great work from Squuiid, https://forums.macrumors.com/thread...nics-to-use-small-tree-macos-drivers.1968456/ Thanks him so much!!!!

I successfully installed a X540-T1 with Akitio Thunderbolt 2 box on my latest Mac Pro(Trash can).

Then I tried to test the throughput with my Synology 1817+ with a Synology 10GE card installed. I found a very wired situation, I need your guys' help, and instructions.

192.168.0.2 is the address for my Synology server, and I use iperf3 in both side to test the through put.

When Sinology as server, and Mac Pro as client, I got:
Connecting to host 192.168.0.2, port 5201
[ 5] local 192.168.0.21 port 49835 connected to 192.168.0.2 port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 68.3 MBytes 573 Mbits/sec
[ 5] 1.00-2.00 sec 67.9 MBytes 569 Mbits/sec
[ 5] 2.00-3.00 sec 66.0 MBytes 554 Mbits/sec
[ 5] 3.00-4.00 sec 64.1 MBytes 538 Mbits/sec
[ 5] 4.00-5.00 sec 67.1 MBytes 563 Mbits/sec
[ 5] 5.00-6.00 sec 66.9 MBytes 561 Mbits/sec
[ 5] 6.00-7.00 sec 66.5 MBytes 558 Mbits/sec
[ 5] 7.00-8.00 sec 67.2 MBytes 564 Mbits/sec
[ 5] 8.00-9.00 sec 66.6 MBytes 559 Mbits/sec
[ 5] 9.00-10.00 sec 67.0 MBytes 562 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 668 MBytes 560 Mbits/sec sender
[ 5] 0.00-10.00 sec 667 MBytes 560 Mbits/sec receiver

Then when I do it vice verse, I got:
Accepted connection from 192.168.0.2, port 48156
[ 5] local 192.168.0.21 port 5201 connected to 192.168.0.2 port 48157
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 933 MBytes 7.83 Gbits/sec
[ 5] 1.00-2.00 sec 1010 MBytes 8.47 Gbits/sec
[ 5] 2.00-3.00 sec 1009 MBytes 8.46 Gbits/sec
[ 5] 3.00-4.00 sec 1013 MBytes 8.50 Gbits/sec
[ 5] 4.00-5.00 sec 1009 MBytes 8.46 Gbits/sec
[ 5] 5.00-6.00 sec 1012 MBytes 8.49 Gbits/sec
[ 5] 6.00-7.00 sec 983 MBytes 8.25 Gbits/sec
[ 5] 7.00-8.00 sec 996 MBytes 8.36 Gbits/sec
[ 5] 8.00-9.00 sec 1003 MBytes 8.42 Gbits/sec
[ 5] 9.00-10.00 sec 1017 MBytes 8.53 Gbits/sec
[ 5] 10.00-10.04 sec 36.7 MBytes 8.52 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.04 sec 9.79 GBytes 8.38 Gbits/sec receiver

How can the speed diff so much?? more than 10 times. anything I made wrongly?

When I tried the smb file copy, the file transfer speed relect the same big difference on thoughtput.

Btw, I disabled smb signing on mac.

Thanks in advance!

 

[LK LAW]

By great work from Squuiid, https://forums.macrumors.com/thread...nics-to-use-small-tree-macos-drivers.1968456/ Thanks him so much!!!!

I successfully installed a X540-T1 with Akitio Thunderbolt 2 box on my latest Mac Pro(Trash can).

Then I tried to test the throughput with my Synology 1817+ with a Synology 10GE card installed. I found a very wired situation, I need your guys' help, and instructions.

192.168.0.2 is the address for my Synology server, and I use iperf3 in both side to test the through put.

When Sinology as server, and Mac Pro as client, I got:
Connecting to host 192.168.0.2, port 5201
[ 5] local 192.168.0.21 port 49835 connected to 192.168.0.2 port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 68.3 MBytes 573 Mbits/sec
[ 5] 1.00-2.00 sec 67.9 MBytes 569 Mbits/sec
[ 5] 2.00-3.00 sec 66.0 MBytes 554 Mbits/sec
[ 5] 3.00-4.00 sec 64.1 MBytes 538 Mbits/sec
[ 5] 4.00-5.00 sec 67.1 MBytes 563 Mbits/sec
[ 5] 5.00-6.00 sec 66.9 MBytes 561 Mbits/sec
[ 5] 6.00-7.00 sec 66.5 MBytes 558 Mbits/sec
[ 5] 7.00-8.00 sec 67.2 MBytes 564 Mbits/sec
[ 5] 8.00-9.00 sec 66.6 MBytes 559 Mbits/sec
[ 5] 9.00-10.00 sec 67.0 MBytes 562 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 668 MBytes 560 Mbits/sec sender
[ 5] 0.00-10.00 sec 667 MBytes 560 Mbits/sec receiver

Then when I do it vice verse, I got:
Accepted connection from 192.168.0.2, port 48156
[ 5] local 192.168.0.21 port 5201 connected to 192.168.0.2 port 48157
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 933 MBytes 7.83 Gbits/sec
[ 5] 1.00-2.00 sec 1010 MBytes 8.47 Gbits/sec
[ 5] 2.00-3.00 sec 1009 MBytes 8.46 Gbits/sec
[ 5] 3.00-4.00 sec 1013 MBytes 8.50 Gbits/sec
[ 5] 4.00-5.00 sec 1009 MBytes 8.46 Gbits/sec
[ 5] 5.00-6.00 sec 1012 MBytes 8.49 Gbits/sec
[ 5] 6.00-7.00 sec 983 MBytes 8.25 Gbits/sec
[ 5] 7.00-8.00 sec 996 MBytes 8.36 Gbits/sec
[ 5] 8.00-9.00 sec 1003 MBytes 8.42 Gbits/sec
[ 5] 9.00-10.00 sec 1017 MBytes 8.53 Gbits/sec
[ 5] 10.00-10.04 sec 36.7 MBytes 8.52 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.04 sec 9.79 GBytes 8.38 Gbits/sec receiver

How can the speed diff so much?? more than 10 times. anything I made wrongly?

When I tried the smb file copy, the file transfer speed relect the same big difference on thoughtput.

Btw, I disabled smb signing on mac.

Thanks in advance!

This could literally due to anything, need more info about system resource usage, clients and network config...

 

[qiangge]

This could literally due to anything, need more info about system resource usage, clients and network config...

Thank you LK!

I just tried the iperf3 with other two machine with 10GE as well, both are Windows, one is win10, and another one is Win server 2016, both show the similar results, so the problem can be narrow down to the mac pro.

My configuration on Mac Pro is:
1. Mac Pro late 2012, with 32G RAM
2. Akitio thunderbolt 2 to PCIe box
3. Intel X540-Ti 10GE network adaptor (intel original)
4. Installed SmallTree driver version 3.3.15
5. Disabled smb signing
6. MTU set to 1500

Thanks.

 

[LK LAW]

Thank you LK!

I just tried the iperf3 with other two machine with 10GE as well, both are Windows, one is win10, and another one is Win server 2016, both show the similar results, so the problem can be narrow down to the mac pro.

My configuration on Mac Pro is:
1. Mac Pro late 2012, with 32G RAM
2. Akitio thunderbolt 2 to PCIe box
3. Intel X540-Ti 10GE network adaptor (intel original)
4. Installed SmallTree driver version 3.3.15
5. Disabled smb signing
6. MTU set to 1500

Thanks.

I'm more interested in the NAS config, also send some system usage stats when you're doing the iPerf with the NAS as the server.

 

[qiangge]

I'm more interested in the NAS config, also send some system usage stats when you're doing the iPerf with the NAS as the server.

What kind of system usage? do you mean get on NAS or Mac?

 

[LK LAW]

What kind of system usage? do you mean get on NAS or Mac?

The NAS

 

[Kris Kelvin]

@qiangge Is the 10GbE card the only link to the network? If not, does it have the highest priority (is it at the top of the list of network interfaces in System Preferences)?

While we're at it, what the situation on the NAS? Multiple ethernet connections?

 

[LK LAW]

Also what drives do you have installed and in what config?

 

[qiangge]

@qiangge Is the 10GbE card the only link to the network? If not, does it have the highest priority (is it at the top of the list of network interfaces in System Preferences)?

While we're at it, what the situation on the NAS? Multiple ethernet connections?

Hi Kris,

On Mac Pro, the 10GE is the only connection, on NAS, the 10GE is also the only connection. so I think priority is not an issue. I suspect now the problem is on the supermicro soft routing board, I have purchased a 10GE switch to test it. will arrive tonight.
[doublepost=1545190298][/doublepost]

Also what drives do you have installed and in what config?

Hi LK,

I installed 4 512G Samsung 860 PRO SSD, in RAID5.

 

[LK LAW]

Hi Kris,

On Mac Pro, the 10GE is the only connection, on NAS, the 10GE is also the only connection. so I think priority is not an issue. I suspect now the problem is on the supermicro soft routing board, I have purchased a 10GE switch to test it. will arrive tonight.
[doublepost=1545190298][/doublepost]
Hi LK,

I installed 4 512G Samsung 860 PRO SSD, in RAID5.

- What is the block size?
- Can you check the internal read speed?
- Try reading from the nas with Black Magic speed test?
- Try iPerf from a different device on your network?
- During iPerf what is the CPU and RAM usage looking like on the NAS?