# GPU Benchmarking

Within the PoA's health check, the drill test incorporates sophisticated benchmarking techniques such as MLPerf to evaluate machine performance comprehensively. By conducting benchmarking assessments, including MLPerf, the algorithm quantifies the machine's efficiency. This quantitative measure serves as a reliable indicator of the machine's condition, ensuring robustness and reliability in its operational capabilities.&#x20;

<figure><img src="https://lh7-us.googleusercontent.com/docsz/AD_4nXcJ4BbD1Obz63ior11rvttFDNZeiCYLZLY_CzQ5AHlKcyaoaNdZNAfZqAgbRvSUL16xcmvhwe_-7yzVcIxCuLEeMy6gOMQsVACO2WDHLjpc50lcpBxlaEbXruj1KmHtf85536IpPJzFiw9pvIewxWLuazSg?key=JkONHaXvPgWODX70qOYtfw" alt=""><figcaption><p>Work flow of Drill Test</p></figcaption></figure>

Here are some sample results of the drill test on Nvidia A100:

**MLPerf Results Summary:**

SUT name : BERT SERVER

Scenario : Offline

Mode     : PerformanceOnly

Samples per second: 1532.17

Result is : VALID

Min duration satisfied : Yes

Min queries satisfied : Yes

Early stopping satisfied: Yes

**Additional Stats:**

Min latency (ns)                : 3559383281

Max latency (ns)                : 1292280950807

Mean latency (ns)               : 788846755872

50.00 percentile latency (ns)   : 840201049914

90.00 percentile latency (ns)   : 1234598190171

95.00 percentile latency (ns)   : 1268998116410

97.00 percentile latency (ns)   : 1280065956777

99.00 percentile latency (ns)   : 1289280826440

99.90 percentile latency (ns)   : 1292043266934

**Test Parameters Used:**

samples\_per\_query : 1980000

target\_qps : 3000

target\_latency (ns): 0

max\_async\_queries : 1

min\_duration (ms): 600000

max\_duration (ms): 0

min\_query\_count : 1

max\_query\_count : 0

qsl\_rng\_seed : 13281865557512327830

sample\_index\_rng\_seed : 198141574272810017

schedule\_rng\_seed : 7575108116881280410

accuracy\_log\_rng\_seed : 0

accuracy\_log\_probability : 0

accuracy\_log\_sampling\_target : 0

print\_timestamps : 0

performance\_issue\_unique : 0

performance\_issue\_same : 0

performance\_issue\_same\_index : 0

performance\_sample\_count : 10833<br>
