NIC-assisted Cache-Efficient Receive Stack for Message Passing over Ethernet

Abstract : High-speed networking in clusters usually relies on advanced hardware features in the NICs, such as zero-copy. Open-MX is a high-performance message passing stack designed for regular Ethernet hardware without such capabilities. We present the addition of multiqueue support in the Open-MX receive stack so that all incoming packets for the same process are treated on the same core. We then introduce the idea of binding the target end process near its dedicated receive queue. This model leads to a more cache-efficient receive stack for Open-MX. It also proves that very simple and stateless hardware features may have a significant impact on message passing performance over Ethernet. The implementation of this model in a firmware reveals that it may not be as efficient as some manually tuned micro-benchmarks. But our multiqueue receive stack generally performs better than the original single queue stack, especially on large communication patterns where multiple processes are involved and manual binding is difficult.
Document type :
Conference papers
Springer Verlag. 15th International Euro-Par Conference, Aug 2009, Delft, Netherlands. Lecture Notes in Computer Science. <10.1007/978-3-642-03869-3_981>


https://hal.inria.fr/inria-00379168
Contributor : Brice Goglin <>
Submitted on : Monday, April 27, 2009 - 10:55:51 PM
Last modification on : Monday, June 14, 2010 - 9:05:22 AM

File

EuroPar09-submit.pdf
fileSource_public_author

Identifiers

Citation

Brice Goglin. NIC-assisted Cache-Efficient Receive Stack for Message Passing over Ethernet. Springer Verlag. 15th International Euro-Par Conference, Aug 2009, Delft, Netherlands. Lecture Notes in Computer Science. <10.1007/978-3-642-03869-3_981>. <inria-00379168>

Export

Share

Metrics

Consultation de
la notice

177

Téléchargement du document

48