tag:blogger.com,1999:blog-8829446045630484531.post2012252790122656774..comments2023-07-02T04:58:24.112-07:00Comments on HPC-Opinion: InfiniBand for the Home in Less Than $150 (10Gb Networking on the Cheap)Ben "HPC" Smithhttp://www.blogger.com/profile/09363146663827380063noreply@blogger.comBlogger4125tag:blogger.com,1999:blog-8829446045630484531.post-11458980768513974122011-12-23T04:09:18.746-08:002011-12-23T04:09:18.746-08:00I got the speed up to about 900MB/sec using a ramd...I got the speed up to about 900MB/sec using a ramdisk: http://davidhunt.ie/wp/?p=2324<br />PCI-express slot choice is critial :)climberhunthttps://www.blogger.com/profile/02278693081307980864noreply@blogger.comtag:blogger.com,1999:blog-8829446045630484531.post-81781087904525756672011-12-18T11:03:41.762-08:002011-12-18T11:03:41.762-08:00Agreed. I need to bite the bullet and upgrade that...Agreed. I need to bite the bullet and upgrade that 6 year old motherboard/processor in the linux box. I was hoping to do this really cheaply, maybe I can get a donation from somewhere! :)climberhunthttps://www.blogger.com/profile/02278693081307980864noreply@blogger.comtag:blogger.com,1999:blog-8829446045630484531.post-20549707596233761392011-12-17T08:35:55.235-08:002011-12-17T08:35:55.235-08:00You definitely need the right storage system to ge...You definitely need the right storage system to get the higher bandwidth - but now it is the disks that you use, not the network as the bottleneck. As for IPoIB - in my datacenter I can get around 2GB/sec bandwidth with the newer InfiniBand adapters that include the Ethernet stateless offloads. With the older versions, I heard folks getting around 1.3GB/sec with latest drivers and probably a stronger CPU.Ben "HPC" Smithhttps://www.blogger.com/profile/09363146663827380063noreply@blogger.comtag:blogger.com,1999:blog-8829446045630484531.post-62658995856302220022011-12-17T01:29:44.469-08:002011-12-17T01:29:44.469-08:00It's important to read the edits in the second...It's important to read the edits in the second paragraph of the original blog article. A couple of 7gbps netperf readings don't accurately reflect the real-world throughput. I'm struggling to get past 200MB/sec with disk subsystems, pci-express lane allocation, protocol selection, etc. IPoIB seems to max out at about 125MB/sec which is what you'd most likely use for a home network. SRP is the fastest, but point to point only. So, there's limitations. Might be good to add this information to the above...climberhunthttps://www.blogger.com/profile/02278693081307980864noreply@blogger.com