STAC-M2 Report: IBM LLM with IBM-BNT 10GigE switch and Solarflare OpenOnload

Audited STAC-M2 Benchmark of IBM LLM on an IBM-BNT G8264 switch, using IBM x3550 servers and Solarflare SFN5122F NICs with OpenOnload

STAC has just released an audited STAC-M2(TM) Benchmark of the following stack:

- IBM WMQ Low Latency Messaging v2.4.0.2
- Red Hat Enterprise Linux AS 5.5
- 2 x Quad-Core Intel Xeon X5570 2.93 GHz
- IBM x3550 M2 Model Servers
- Solarflare SFN5122F 10GbE Adapters with OpenOnload
- IBM-BNT G8264 10Gb/40Gb Ethernet Switch

Using standard Ethernet and UDP protocols, at the base message rates set by the specs, the mean latency of the solution did not exceed 10 microseconds, while standard deviation of latency was measured at 0 microseconds. (Latency results in this version of STAC-M2 are reported with microsecond granularity.) At the highest tested rate of 2.3 million messages/second, the mean latency of the solution was just 14 microseconds while the standard deviation of latency was measured at 2 microseconds.

STAC Benchmark Council members with a premium subscription can request the full STAC Report. (Observer Members who have not already obtained a free sample report may also obtain the full report.) The report highlights are available to the public.

To understand the difference between the STAC Report Highlights and the full STAC Report, click here.

About STAC News

Read the latest about research, events, and other important news from STAC.

Subscribe to notifications of research, events, and more.

(If you're a human, don't change the following field)
Your first name.
(If you're a human, don't change the following field)
Your first name.

Enter your email above, then click "Sign Up" to join the STAC mail list and (optionally) register to access materials on the site. Click for terms.