STAC-M2 Report: IBM LLM with IBM-BNT 10GigE switch and Solarflare OpenOnload
Audited STAC-M2 Benchmark of IBM LLM on an IBM-BNT G8264 switch, using IBM x3550 servers and Solarflare SFN5122F NICs with OpenOnload
STAC has just released an audited STAC-M2(TM) Benchmark of the following stack:
- IBM WMQ Low Latency Messaging v22.214.171.124
- Red Hat Enterprise Linux AS 5.5
- 2 x Quad-Core Intel Xeon X5570 2.93 GHz
- IBM x3550 M2 Model Servers
- Solarflare SFN5122F 10GbE Adapters with OpenOnload
- IBM-BNT G8264 10Gb/40Gb Ethernet Switch
Using standard Ethernet and UDP protocols, at the base message rates set by the specs, the mean latency of the solution did not exceed 10 microseconds, while standard deviation of latency was measured at 0 microseconds. (Latency results in this version of STAC-M2 are reported with microsecond granularity.) At the highest tested rate of 2.3 million messages/second, the mean latency of the solution was just 14 microseconds while the standard deviation of latency was measured at 2 microseconds.
STAC Benchmark Council members with a premium subscription can request the full STAC Report. (Observer Members who have not already obtained a free sample report may also obtain the full report.) The report highlights are available to the public.
To understand the difference between the STAC Report Highlights and the full STAC Report, click here.
About STAC News
Read the latest about research, events, and other important news from STAC.