Release-candidate sitting

A path under benchmarks/ on this page names a record of the d-SEAMS 2.0 benchmark campaign. The records and the Snakemake rules that write them are in the private paper repository and the Hugging Face dataset d-SEAMS/dseams2-benchmark-records (docs/records/README.md names the revision); the scripts under scripts/ that time a run stay here.

The numbers below are benchmarks/rc3-sitting.csv, written by scripts/h2h_rc3_sitting.py, in the benchmark records dataset. The tables below are rendered from that file, with each stored median and interquartile range checked against the samples.

Methods

One warm-up is discarded. The column n is the number of timed calls that remain. In this file it is 6 on every row. samples_ms lists those calls, in milliseconds, to three decimal places.

The median of an even count is the mean of the two central samples after sorting. The interquartile range is the type-7 gap: the linear quantile at position \(q(n-1)\), with \(q = 0.75\) minus \(q = 0.25\), which is quantile_linear in scripts/h2h_protocol.py. median_ms and iqr_ms are that pair, written to three decimal places.

threads is the width requested for that row. The worker is started with OMP_NUM_THREADS set to that width and OMP_DYNAMIC=FALSE. One thread is pinned with taskset -c 0. Eight threads are pinned with taskset -c 0-7. Each guest code then receives the same width through its own setter (set_num_threads, OVITO_THREAD_COUNT, num_threads on the Rust ring call, n_threads for vesin).

cores is Cpus_allowed_list from /proc/self/status, read in the worker. It is the cpu affinity of the timed process, not a model name. The host name is not in the file. A one-thread guest that does not change its mask reports 0. d-SEAMS calls seams::widenAffinity before the timed work, which puts back every cpu the kernel still allows, so some one-thread d-SEAMS rows report 0-7 while OpenMP itself was one thread. Every eight-thread row reports 0-7.

Ideal ice Ic at 110592 and 884736 molecules is the neighbour, \(q_4\), \(q_6\), CHILL+, ring, and PTM block. Cages are the GenIce cells, where cages exist. King’s shortest-path count is included only at sizes whose first call returned within 10 minutes.

The algorithm pages are primitive rings, TRACE and signature cages, the symmetry classifier, and carried rings. The signature-search widths, and the kernel teams from 848426f9, are thread controls.

These tables are rendered from benchmarks/rc3-sitting.csv.

neighbours

code

version

molecules

threads

cores

n

median_ms

iqr_ms

d-SEAMS

2.14.0

110592

1

0-7

6

28.325

0.440

vesin

0.6.2

110592

1

0

6

51.194

1.190

d-SEAMS

2.14.0

110592

8

0-7

6

6.453

1.508

vesin

0.6.2

110592

8

0-7

6

22.269

1.481

d-SEAMS

2.14.0

884736

1

0-7

6

282.177

3.684

vesin

0.6.2

884736

1

0

6

1112.702

8.113

d-SEAMS

2.14.0

884736

8

0-7

6

60.408

0.806

vesin

0.6.2

884736

8

0-7

6

196.866

20.430

q4

code

version

molecules

threads

cores

n

median_ms

iqr_ms

PLUMED

2.10.2+symfunc

110592

1

0

6

1310.025

43.492

d-SEAMS

2.14.0

110592

1

0

6

23.747

0.471

freud

3.6.1

110592

1

0

6

276.580

5.118

mdapy

2.0.0

110592

1

0

6

64.687

1.094

PLUMED

2.10.2+symfunc

110592

8

0-7

6

1316.423

26.240

d-SEAMS

2.14.0

110592

8

0-7

6

6.094

1.114

freud

3.6.1

110592

8

0-7

6

51.302

7.021

mdapy

2.0.0

110592

8

0-7

6

12.400

0.324

PLUMED

2.10.2+symfunc

884736

1

0

6

10053.680

22.541

d-SEAMS

2.14.0

884736

1

0

6

281.416

1.834

freud

3.6.1

884736

1

0

6

2358.091

42.023

mdapy

2.0.0

884736

1

0

6

807.101

31.111

PLUMED

2.10.2+symfunc

884736

8

0-7

6

10122.158

238.143

d-SEAMS

2.14.0

884736

8

0-7

6

53.025

2.946

freud

3.6.1

884736

8

0-7

6

431.376

11.656

mdapy

2.0.0

884736

8

0-7

6

96.238

7.626

q6

code

version

molecules

threads

cores

n

median_ms

iqr_ms

PLUMED

2.10.2+symfunc

110592

1

0

6

1685.454

19.344

d-SEAMS

2.14.0

110592

1

0

6

25.832

1.264

freud

3.6.1

110592

1

0

6

362.326

1.594

mdapy

2.0.0

110592

1

0

6

79.232

1.587

PLUMED

2.10.2+symfunc

110592

8

0-7

6

1680.281

29.897

d-SEAMS

2.14.0

110592

8

0-7

6

5.820

0.314

freud

3.6.1

110592

8

0-7

6

68.760

9.206

mdapy

2.0.0

110592

8

0-7

6

14.572

0.478

PLUMED

2.10.2+symfunc

884736

1

0

6

12947.767

183.484

d-SEAMS

2.14.0

884736

1

0

6

303.544

8.373

freud

3.6.1

884736

1

0

6

2973.372

73.450

mdapy

2.0.0

884736

1

0

6

921.574

18.237

PLUMED

2.10.2+symfunc

884736

8

0-7

6

12818.837

42.484

d-SEAMS

2.14.0

884736

8

0-7

6

57.752

7.258

freud

3.6.1

884736

8

0-7

6

550.161

3.450

mdapy

2.0.0

884736

8

0-7

6

107.347

8.477

CHILL+

code

version

molecules

threads

cores

n

median_ms

iqr_ms

OVITO

3.17.2

110592

1

0

6

622.424

3.316

d-SEAMS

2.14.0

110592

1

0-7

6

24.102

0.308

mdapy

2.0.0

110592

1

0

6

61.938

0.226

OVITO

3.17.2

110592

8

0-7

6

88.685

1.045

d-SEAMS

2.14.0

110592

8

0-7

6

5.697

0.204

mdapy

2.0.0

110592

8

0-7

6

12.379

0.422

OVITO

3.17.2

884736

1

0

6

4890.789

11.870

d-SEAMS

2.14.0

884736

1

0-7

6

263.592

4.488

mdapy

2.0.0

884736

1

0

6

744.487

12.129

OVITO

3.17.2

884736

8

0-7

6

666.288

14.826

d-SEAMS

2.14.0

884736

8

0-7

6

47.444

0.579

mdapy

2.0.0

884736

8

0-7

6

125.578

1.466

rings

code

version

molecules

threads

cores

n

median_ms

iqr_ms

d-SEAMS

2.14.0

1000

1

0

6

1.019

0.021

d-SEAMS

2.14.0

1000

8

0-7

6

1.087

0.004

d-SEAMS

2.14.0

4096

1

0-7

6

3.499

0.061

d-SEAMS

2.14.0

4096

8

0-7

6

1.131

0.019

d-SEAMS

2.14.0

10648

1

0-7

6

8.972

0.056

d-SEAMS

2.14.0

10648

8

0-7

6

2.858

0.053

d-SEAMS

2.14.0

21952

1

0-7

6

18.111

0.184

d-SEAMS

2.14.0

21952

8

0-7

6

5.736

0.074

d-SEAMS

2.14.0

32768

1

0-7

6

26.227

0.199

d-SEAMS

2.14.0

32768

8

0-7

6

8.816

0.165

d-SEAMS

2.14.0

64000

1

0-7

6

49.326

0.294

d-SEAMS

2.14.0

64000

8

0-7

6

16.147

0.520

OVITO

3.17.2

110592

1

0

6

583.334

7.617

d-SEAMS

2.14.0

110592

1

0-7

6

88.959

1.764

d-SEAMS

2.14.0

110592

1

0-7

6

86.531

1.036

mdapy

2.0.0

110592

1

0

6

2276.747

13.477

rings-statistics-matter

0.3.0

110592

1

0

6

1151.862

46.483

OVITO

3.17.2

110592

8

0-7

6

354.605

17.902

d-SEAMS

2.14.0

110592

8

0-7

6

33.441

0.481

d-SEAMS

2.14.0

110592

8

0-7

6

32.665

0.343

mdapy

2.0.0

110592

8

0-7

6

375.967

3.766

rings-statistics-matter

0.3.0

110592

8

0-7

6

264.953

10.643

OVITO

3.17.2

884736

1

0

6

4883.899

57.162

d-SEAMS

2.14.0

884736

1

0-7

6

765.181

7.280

mdapy

2.0.0

884736

1

0

6

19221.718

42.226

rings-statistics-matter

0.3.0

884736

1

0

6

11504.451

100.097

OVITO

3.17.2

884736

8

0-7

6

2582.748

136.204

d-SEAMS

2.14.0

884736

8

0-7

6

301.039

29.359

mdapy

2.0.0

884736

8

0-7

6

3361.913

85.508

rings-statistics-matter

0.3.0

884736

8

0-7

6

2665.750

77.960

cages

code

version

molecules

threads

cores

n

median_ms

iqr_ms

ClavisCage

0.3.18

46

1

0

6

51.122

0.206

d-SEAMS

2.14.0

46

1

0-7

6

0.682

0.061

ClavisCage

0.3.18

46

8

0-7

6

51.206

0.941

d-SEAMS

2.14.0

46

8

0-7

6

0.583

0.013

ClavisCage

0.3.18

136

1

0

6

69.332

0.291

d-SEAMS

2.14.0

136

1

0-7

6

1.805

0.237

ClavisCage

0.3.18

136

8

0-7

6

69.657

0.243

d-SEAMS

2.14.0

136

8

0-7

6

1.623

0.038

ClavisCage

0.3.18

368

1

0

6

301.514

0.240

d-SEAMS

2.14.0

368

1

0-7

6

4.829

0.135

ClavisCage

0.3.18

368

8

0-7

6

302.471

1.124

d-SEAMS

2.14.0

368

8

0-7

6

3.893

0.070

PTM

code

version

molecules

threads

cores

n

median_ms

iqr_ms

OVITO

3.17.2

110592

1

0

6

2790.624

78.803

d-SEAMS

2.14.0

110592

1

0

6

30.475

1.072

OVITO

3.17.2

110592

8

0-7

6

370.341

1.536

d-SEAMS

2.14.0

110592

8

0-7

6

6.976

0.433

OVITO

3.17.2

884736

1

0

6

21304.364

33.420

d-SEAMS

2.14.0

884736

1

0

6

287.530

4.957

OVITO

3.17.2

884736

8

0-7

6

2849.382

16.947

d-SEAMS

2.14.0

884736

8

0-7

6

51.470

1.333

king

code

version

molecules

threads

cores

n

median_ms

iqr_ms

fastatomstruct

2.2.0

1000

1

0

6

24.865

0.098

fastatomstruct

2.2.0

1000

8

0-7

6

20.803

9.447

fastatomstruct

2.2.0

4096

1

0

6

289.722

1.096

fastatomstruct

2.2.0

4096

8

0-7

6

109.916

5.925

fastatomstruct

2.2.0

10648

1

0

6

1813.620

9.916

fastatomstruct

2.2.0

10648

8

0-7

6

306.073

6.164

fastatomstruct

2.2.0

21952

1

0

6

16849.495

160.385

fastatomstruct

2.2.0

21952

8

0-7

6

2166.371

41.791

fastatomstruct

2.2.0

32768

1

0

6

47798.094

300.283

fastatomstruct

2.2.0

32768

8

0-7

6

5787.638

121.065

fastatomstruct

2.2.0

64000

1

0

6

189511.480

2966.603

fastatomstruct

2.2.0

64000

8

0-7

6

20791.598

136.607

fastatomstruct

2.2.0

110592

1

0

6

572149.958

15966.181

fastatomstruct

2.2.0

110592

8

0-7

6

66413.885

3570.251