Release-candidate sitting¶
A path under benchmarks/ on this page names a record of the d-SEAMS 2.0
benchmark campaign. The records and the Snakemake rules that write them
are in the private paper repository and the Hugging Face dataset
d-SEAMS/dseams2-benchmark-records (docs/records/README.md names the
revision); the scripts under scripts/ that time a run stay here.
The numbers below are benchmarks/rc3-sitting.csv, written by
scripts/h2h_rc3_sitting.py, in the benchmark records dataset. The
tables below are rendered from that file, with each stored median and
interquartile range checked against the samples.
Methods¶
One warm-up is discarded. The column n is the number of timed calls
that remain. In this file it is 6 on every row. samples_ms lists
those calls, in milliseconds, to three decimal places.
The median of an even count is the mean of the two central samples
after sorting. The interquartile range is the type-7 gap: the linear
quantile at position \(q(n-1)\), with \(q = 0.75\) minus \(q = 0.25\),
which is quantile_linear in scripts/h2h_protocol.py. median_ms
and iqr_ms are that pair, written to three decimal places.
threads is the width requested for that row. The worker is started
with OMP_NUM_THREADS set to that width and OMP_DYNAMIC=FALSE.
One thread is pinned with taskset -c 0. Eight threads are pinned
with taskset -c 0-7. Each guest code then receives the same width
through its own setter (set_num_threads, OVITO_THREAD_COUNT,
num_threads on the Rust ring call, n_threads for vesin).
cores is Cpus_allowed_list from /proc/self/status, read in the
worker. It is the cpu affinity of the timed process, not a model name.
The host name is not in the file. A one-thread guest that does not
change its mask reports 0. d-SEAMS calls seams::widenAffinity
before the timed work, which puts back every cpu the kernel still
allows, so some one-thread d-SEAMS rows report 0-7 while OpenMP
itself was one thread. Every eight-thread row reports 0-7.
Ideal ice Ic at 110592 and 884736 molecules is the neighbour, \(q_4\), \(q_6\), CHILL+, ring, and PTM block. Cages are the GenIce cells, where cages exist. King’s shortest-path count is included only at sizes whose first call returned within 10 minutes.
The algorithm pages are
primitive rings,
TRACE and signature cages,
the symmetry classifier, and
carried rings.
The signature-search widths, and the kernel teams from 848426f9, are
thread controls.
These tables are rendered from
|
neighbours¶
code |
version |
molecules |
threads |
cores |
n |
median_ms |
iqr_ms |
|---|---|---|---|---|---|---|---|
d-SEAMS |
2.14.0 |
110592 |
1 |
0-7 |
6 |
28.325 |
0.440 |
vesin |
0.6.2 |
110592 |
1 |
0 |
6 |
51.194 |
1.190 |
d-SEAMS |
2.14.0 |
110592 |
8 |
0-7 |
6 |
6.453 |
1.508 |
vesin |
0.6.2 |
110592 |
8 |
0-7 |
6 |
22.269 |
1.481 |
d-SEAMS |
2.14.0 |
884736 |
1 |
0-7 |
6 |
282.177 |
3.684 |
vesin |
0.6.2 |
884736 |
1 |
0 |
6 |
1112.702 |
8.113 |
d-SEAMS |
2.14.0 |
884736 |
8 |
0-7 |
6 |
60.408 |
0.806 |
vesin |
0.6.2 |
884736 |
8 |
0-7 |
6 |
196.866 |
20.430 |
q4¶
code |
version |
molecules |
threads |
cores |
n |
median_ms |
iqr_ms |
|---|---|---|---|---|---|---|---|
PLUMED |
2.10.2+symfunc |
110592 |
1 |
0 |
6 |
1310.025 |
43.492 |
d-SEAMS |
2.14.0 |
110592 |
1 |
0 |
6 |
23.747 |
0.471 |
freud |
3.6.1 |
110592 |
1 |
0 |
6 |
276.580 |
5.118 |
mdapy |
2.0.0 |
110592 |
1 |
0 |
6 |
64.687 |
1.094 |
PLUMED |
2.10.2+symfunc |
110592 |
8 |
0-7 |
6 |
1316.423 |
26.240 |
d-SEAMS |
2.14.0 |
110592 |
8 |
0-7 |
6 |
6.094 |
1.114 |
freud |
3.6.1 |
110592 |
8 |
0-7 |
6 |
51.302 |
7.021 |
mdapy |
2.0.0 |
110592 |
8 |
0-7 |
6 |
12.400 |
0.324 |
PLUMED |
2.10.2+symfunc |
884736 |
1 |
0 |
6 |
10053.680 |
22.541 |
d-SEAMS |
2.14.0 |
884736 |
1 |
0 |
6 |
281.416 |
1.834 |
freud |
3.6.1 |
884736 |
1 |
0 |
6 |
2358.091 |
42.023 |
mdapy |
2.0.0 |
884736 |
1 |
0 |
6 |
807.101 |
31.111 |
PLUMED |
2.10.2+symfunc |
884736 |
8 |
0-7 |
6 |
10122.158 |
238.143 |
d-SEAMS |
2.14.0 |
884736 |
8 |
0-7 |
6 |
53.025 |
2.946 |
freud |
3.6.1 |
884736 |
8 |
0-7 |
6 |
431.376 |
11.656 |
mdapy |
2.0.0 |
884736 |
8 |
0-7 |
6 |
96.238 |
7.626 |
q6¶
code |
version |
molecules |
threads |
cores |
n |
median_ms |
iqr_ms |
|---|---|---|---|---|---|---|---|
PLUMED |
2.10.2+symfunc |
110592 |
1 |
0 |
6 |
1685.454 |
19.344 |
d-SEAMS |
2.14.0 |
110592 |
1 |
0 |
6 |
25.832 |
1.264 |
freud |
3.6.1 |
110592 |
1 |
0 |
6 |
362.326 |
1.594 |
mdapy |
2.0.0 |
110592 |
1 |
0 |
6 |
79.232 |
1.587 |
PLUMED |
2.10.2+symfunc |
110592 |
8 |
0-7 |
6 |
1680.281 |
29.897 |
d-SEAMS |
2.14.0 |
110592 |
8 |
0-7 |
6 |
5.820 |
0.314 |
freud |
3.6.1 |
110592 |
8 |
0-7 |
6 |
68.760 |
9.206 |
mdapy |
2.0.0 |
110592 |
8 |
0-7 |
6 |
14.572 |
0.478 |
PLUMED |
2.10.2+symfunc |
884736 |
1 |
0 |
6 |
12947.767 |
183.484 |
d-SEAMS |
2.14.0 |
884736 |
1 |
0 |
6 |
303.544 |
8.373 |
freud |
3.6.1 |
884736 |
1 |
0 |
6 |
2973.372 |
73.450 |
mdapy |
2.0.0 |
884736 |
1 |
0 |
6 |
921.574 |
18.237 |
PLUMED |
2.10.2+symfunc |
884736 |
8 |
0-7 |
6 |
12818.837 |
42.484 |
d-SEAMS |
2.14.0 |
884736 |
8 |
0-7 |
6 |
57.752 |
7.258 |
freud |
3.6.1 |
884736 |
8 |
0-7 |
6 |
550.161 |
3.450 |
mdapy |
2.0.0 |
884736 |
8 |
0-7 |
6 |
107.347 |
8.477 |
CHILL+¶
code |
version |
molecules |
threads |
cores |
n |
median_ms |
iqr_ms |
|---|---|---|---|---|---|---|---|
OVITO |
3.17.2 |
110592 |
1 |
0 |
6 |
622.424 |
3.316 |
d-SEAMS |
2.14.0 |
110592 |
1 |
0-7 |
6 |
24.102 |
0.308 |
mdapy |
2.0.0 |
110592 |
1 |
0 |
6 |
61.938 |
0.226 |
OVITO |
3.17.2 |
110592 |
8 |
0-7 |
6 |
88.685 |
1.045 |
d-SEAMS |
2.14.0 |
110592 |
8 |
0-7 |
6 |
5.697 |
0.204 |
mdapy |
2.0.0 |
110592 |
8 |
0-7 |
6 |
12.379 |
0.422 |
OVITO |
3.17.2 |
884736 |
1 |
0 |
6 |
4890.789 |
11.870 |
d-SEAMS |
2.14.0 |
884736 |
1 |
0-7 |
6 |
263.592 |
4.488 |
mdapy |
2.0.0 |
884736 |
1 |
0 |
6 |
744.487 |
12.129 |
OVITO |
3.17.2 |
884736 |
8 |
0-7 |
6 |
666.288 |
14.826 |
d-SEAMS |
2.14.0 |
884736 |
8 |
0-7 |
6 |
47.444 |
0.579 |
mdapy |
2.0.0 |
884736 |
8 |
0-7 |
6 |
125.578 |
1.466 |
rings¶
code |
version |
molecules |
threads |
cores |
n |
median_ms |
iqr_ms |
|---|---|---|---|---|---|---|---|
d-SEAMS |
2.14.0 |
1000 |
1 |
0 |
6 |
1.019 |
0.021 |
d-SEAMS |
2.14.0 |
1000 |
8 |
0-7 |
6 |
1.087 |
0.004 |
d-SEAMS |
2.14.0 |
4096 |
1 |
0-7 |
6 |
3.499 |
0.061 |
d-SEAMS |
2.14.0 |
4096 |
8 |
0-7 |
6 |
1.131 |
0.019 |
d-SEAMS |
2.14.0 |
10648 |
1 |
0-7 |
6 |
8.972 |
0.056 |
d-SEAMS |
2.14.0 |
10648 |
8 |
0-7 |
6 |
2.858 |
0.053 |
d-SEAMS |
2.14.0 |
21952 |
1 |
0-7 |
6 |
18.111 |
0.184 |
d-SEAMS |
2.14.0 |
21952 |
8 |
0-7 |
6 |
5.736 |
0.074 |
d-SEAMS |
2.14.0 |
32768 |
1 |
0-7 |
6 |
26.227 |
0.199 |
d-SEAMS |
2.14.0 |
32768 |
8 |
0-7 |
6 |
8.816 |
0.165 |
d-SEAMS |
2.14.0 |
64000 |
1 |
0-7 |
6 |
49.326 |
0.294 |
d-SEAMS |
2.14.0 |
64000 |
8 |
0-7 |
6 |
16.147 |
0.520 |
OVITO |
3.17.2 |
110592 |
1 |
0 |
6 |
583.334 |
7.617 |
d-SEAMS |
2.14.0 |
110592 |
1 |
0-7 |
6 |
88.959 |
1.764 |
d-SEAMS |
2.14.0 |
110592 |
1 |
0-7 |
6 |
86.531 |
1.036 |
mdapy |
2.0.0 |
110592 |
1 |
0 |
6 |
2276.747 |
13.477 |
rings-statistics-matter |
0.3.0 |
110592 |
1 |
0 |
6 |
1151.862 |
46.483 |
OVITO |
3.17.2 |
110592 |
8 |
0-7 |
6 |
354.605 |
17.902 |
d-SEAMS |
2.14.0 |
110592 |
8 |
0-7 |
6 |
33.441 |
0.481 |
d-SEAMS |
2.14.0 |
110592 |
8 |
0-7 |
6 |
32.665 |
0.343 |
mdapy |
2.0.0 |
110592 |
8 |
0-7 |
6 |
375.967 |
3.766 |
rings-statistics-matter |
0.3.0 |
110592 |
8 |
0-7 |
6 |
264.953 |
10.643 |
OVITO |
3.17.2 |
884736 |
1 |
0 |
6 |
4883.899 |
57.162 |
d-SEAMS |
2.14.0 |
884736 |
1 |
0-7 |
6 |
765.181 |
7.280 |
mdapy |
2.0.0 |
884736 |
1 |
0 |
6 |
19221.718 |
42.226 |
rings-statistics-matter |
0.3.0 |
884736 |
1 |
0 |
6 |
11504.451 |
100.097 |
OVITO |
3.17.2 |
884736 |
8 |
0-7 |
6 |
2582.748 |
136.204 |
d-SEAMS |
2.14.0 |
884736 |
8 |
0-7 |
6 |
301.039 |
29.359 |
mdapy |
2.0.0 |
884736 |
8 |
0-7 |
6 |
3361.913 |
85.508 |
rings-statistics-matter |
0.3.0 |
884736 |
8 |
0-7 |
6 |
2665.750 |
77.960 |
cages¶
code |
version |
molecules |
threads |
cores |
n |
median_ms |
iqr_ms |
|---|---|---|---|---|---|---|---|
ClavisCage |
0.3.18 |
46 |
1 |
0 |
6 |
51.122 |
0.206 |
d-SEAMS |
2.14.0 |
46 |
1 |
0-7 |
6 |
0.682 |
0.061 |
ClavisCage |
0.3.18 |
46 |
8 |
0-7 |
6 |
51.206 |
0.941 |
d-SEAMS |
2.14.0 |
46 |
8 |
0-7 |
6 |
0.583 |
0.013 |
ClavisCage |
0.3.18 |
136 |
1 |
0 |
6 |
69.332 |
0.291 |
d-SEAMS |
2.14.0 |
136 |
1 |
0-7 |
6 |
1.805 |
0.237 |
ClavisCage |
0.3.18 |
136 |
8 |
0-7 |
6 |
69.657 |
0.243 |
d-SEAMS |
2.14.0 |
136 |
8 |
0-7 |
6 |
1.623 |
0.038 |
ClavisCage |
0.3.18 |
368 |
1 |
0 |
6 |
301.514 |
0.240 |
d-SEAMS |
2.14.0 |
368 |
1 |
0-7 |
6 |
4.829 |
0.135 |
ClavisCage |
0.3.18 |
368 |
8 |
0-7 |
6 |
302.471 |
1.124 |
d-SEAMS |
2.14.0 |
368 |
8 |
0-7 |
6 |
3.893 |
0.070 |
PTM¶
code |
version |
molecules |
threads |
cores |
n |
median_ms |
iqr_ms |
|---|---|---|---|---|---|---|---|
OVITO |
3.17.2 |
110592 |
1 |
0 |
6 |
2790.624 |
78.803 |
d-SEAMS |
2.14.0 |
110592 |
1 |
0 |
6 |
30.475 |
1.072 |
OVITO |
3.17.2 |
110592 |
8 |
0-7 |
6 |
370.341 |
1.536 |
d-SEAMS |
2.14.0 |
110592 |
8 |
0-7 |
6 |
6.976 |
0.433 |
OVITO |
3.17.2 |
884736 |
1 |
0 |
6 |
21304.364 |
33.420 |
d-SEAMS |
2.14.0 |
884736 |
1 |
0 |
6 |
287.530 |
4.957 |
OVITO |
3.17.2 |
884736 |
8 |
0-7 |
6 |
2849.382 |
16.947 |
d-SEAMS |
2.14.0 |
884736 |
8 |
0-7 |
6 |
51.470 |
1.333 |
king¶
code |
version |
molecules |
threads |
cores |
n |
median_ms |
iqr_ms |
|---|---|---|---|---|---|---|---|
fastatomstruct |
2.2.0 |
1000 |
1 |
0 |
6 |
24.865 |
0.098 |
fastatomstruct |
2.2.0 |
1000 |
8 |
0-7 |
6 |
20.803 |
9.447 |
fastatomstruct |
2.2.0 |
4096 |
1 |
0 |
6 |
289.722 |
1.096 |
fastatomstruct |
2.2.0 |
4096 |
8 |
0-7 |
6 |
109.916 |
5.925 |
fastatomstruct |
2.2.0 |
10648 |
1 |
0 |
6 |
1813.620 |
9.916 |
fastatomstruct |
2.2.0 |
10648 |
8 |
0-7 |
6 |
306.073 |
6.164 |
fastatomstruct |
2.2.0 |
21952 |
1 |
0 |
6 |
16849.495 |
160.385 |
fastatomstruct |
2.2.0 |
21952 |
8 |
0-7 |
6 |
2166.371 |
41.791 |
fastatomstruct |
2.2.0 |
32768 |
1 |
0 |
6 |
47798.094 |
300.283 |
fastatomstruct |
2.2.0 |
32768 |
8 |
0-7 |
6 |
5787.638 |
121.065 |
fastatomstruct |
2.2.0 |
64000 |
1 |
0 |
6 |
189511.480 |
2966.603 |
fastatomstruct |
2.2.0 |
64000 |
8 |
0-7 |
6 |
20791.598 |
136.607 |
fastatomstruct |
2.2.0 |
110592 |
1 |
0 |
6 |
572149.958 |
15966.181 |
fastatomstruct |
2.2.0 |
110592 |
8 |
0-7 |
6 |
66413.885 |
3570.251 |