Performance

Head-to-head times for the neighbour list, primitive rings, local \(q_6\), CHILL+, cages, and PTM. The other codes are OVITO, freud, mdapy, ClavisCage, cycless, and SQQ. PTM is the OVITO polyhedral template match. Linkcell scaling is the cutoff-ring list against the older cell list.

The 884736-molecule sitting is ice and a TIP4P/ice liquid, at 1, 2, 4 and 8 threads. The rivals on that file are rings-statistics-matter, freud, mdapy, pyscal3, PLUMED, vesin and OVITO. The file is the sitting written at 2ed49e87. On the liquid, freud \(q_6\) is a hard-cutoff rounding gap, PLUMED is a rational-switch gap, and CHILL+ matches a counted subset of the molecules. The generated note prints those three CSV tokens.

The figure is an SVG of median time against thread count, ice and liquid side by side.

The tables are the frozen tables in docs/records, rendered from the benchmark records dataset (docs/records/README.md names the revision).

Median time against thread count for 884736 molecules

Ice and the TIP4P/ice liquid. Each line is one code. The vertical axis is logarithmic.

884736 sitting, ice and liquid

The rows are benchmarks/paper-cells/sitting-large.csv.

phase

code

version

operation

molecules

threads

median ms

n

ice

d-SEAMS

seams 2.14.0

rings

884736

1

662.186

8

ice

d-SEAMS

seams 2.14.0

q4

884736

1

144.664

8

ice

d-SEAMS

seams 2.14.0

q6

884736

1

150.095

8

ice

d-SEAMS

seams 2.14.0

q4+q6

884736

1

319.346

8

ice

d-SEAMS

seams 2.14.0

neighbours

884736

1

260.183

8

ice

d-SEAMS

seams 2.14.0

chill+

884736

1

235.591

8

ice

d-SEAMS

seams 2.14.0

classifier

884736

1

204.002

8

ice

rings-statistics-matter

0.3.0

rings

884736

1

11267.173

8

ice

mdapy

2.0.0

neighbours

884736

1

469.862

8

ice

mdapy

2.0.0

q4

884736

1

698.390

8

ice

mdapy

2.0.0

q6

884736

1

803.702

8

ice

mdapy

2.0.0

rings

884736

1

18678.338

8

ice

mdapy

2.0.0

chill+

884736

1

580.057

8

ice

vesin

0.6.2

neighbours

884736

1

1083.309

8

ice

freud

3.6.1

neighbours

884736

1

1033.405

8

ice

freud

3.6.1

q4

884736

1

2164.249

8

ice

freud

3.6.1

q6

884736

1

2870.108

8

ice

OVITO

3.17.2

chill+

884736

1

4927.647

8

ice

OVITO

3.17.2

q4

884736

1

393.774

8

ice

OVITO

3.17.2

q6

884736

1

476.740

8

ice

OVITO

3.17.2

ptm-default

884736

1

11787.795

8

ice

OVITO

3.17.2

ptm-ice

884736

1

21901.041

8

ice

pyscal3

4.1.0

neighbours

884736

1

708.702

8

ice

pyscal3

4.1.0

q6

884736

1

956.332

8

ice

PLUMED

2.10.0

q6

884736

1

15780.364

8

ice

OVITO

3.17.2

coordination

884736

1

287.170

8

ice

d-SEAMS

seams 2.14.0

rings

884736

2

505.692

8

ice

d-SEAMS

seams 2.14.0

q4

884736

2

102.619

8

ice

d-SEAMS

seams 2.14.0

q6

884736

2

106.332

8

ice

d-SEAMS

seams 2.14.0

q4+q6

884736

2

229.616

8

ice

d-SEAMS

seams 2.14.0

neighbours

884736

2

111.843

8

ice

d-SEAMS

seams 2.14.0

chill+

884736

2

145.025

8

ice

d-SEAMS

seams 2.14.0

classifier

884736

2

141.624

8

ice

rings-statistics-matter

0.3.0

rings

884736

2

6633.309

8

ice

mdapy

2.0.0

neighbours

884736

2

309.860

8

ice

mdapy

2.0.0

q4

884736

2

391.563

8

ice

mdapy

2.0.0

q6

884736

2

465.590

8

ice

mdapy

2.0.0

rings

884736

2

10185.177

8

ice

mdapy

2.0.0

chill+

884736

2

332.860

8

ice

vesin

0.6.2

neighbours

884736

2

622.438

8

ice

freud

3.6.1

neighbours

884736

2

661.254

8

ice

freud

3.6.1

q4

884736

2

1419.675

8

ice

freud

3.6.1

q6

884736

2

1588.593

8

ice

OVITO

3.17.2

chill+

884736

2

2581.741

8

ice

OVITO

3.17.2

q4

884736

2

217.174

8

ice

OVITO

3.17.2

q6

884736

2

258.950

8

ice

OVITO

3.17.2

ptm-default

884736

2

6012.222

8

ice

OVITO

3.17.2

ptm-ice

884736

2

11691.448

8

ice

pyscal3

4.1.0

neighbours

884736

2

425.185

8

ice

pyscal3

4.1.0

q6

884736

2

661.812

8

ice

PLUMED

2.10.0

q6

884736

2

9122.932

8

ice

OVITO

3.17.2

coordination

884736

2

145.636

8

ice

d-SEAMS

seams 2.14.0

rings

884736

4

322.999

8

ice

d-SEAMS

seams 2.14.0

q4

884736

4

51.170

8

ice

d-SEAMS

seams 2.14.0

q6

884736

4

54.602

8

ice

d-SEAMS

seams 2.14.0

q4+q6

884736

4

127.765

8

ice

d-SEAMS

seams 2.14.0

neighbours

884736

4

69.148

8

ice

d-SEAMS

seams 2.14.0

chill+

884736

4

74.372

8

ice

d-SEAMS

seams 2.14.0

classifier

884736

4

76.617

8

ice

rings-statistics-matter

0.3.0

rings

884736

4

3959.607

8

ice

mdapy

2.0.0

neighbours

884736

4

152.080

8

ice

mdapy

2.0.0

q4

884736

4

194.412

8

ice

mdapy

2.0.0

q6

884736

4

234.624

8

ice

mdapy

2.0.0

rings

884736

4

5536.568

8

ice

mdapy

2.0.0

chill+

884736

4

140.906

8

ice

vesin

0.6.2

neighbours

884736

4

325.513

8

ice

freud

3.6.1

neighbours

884736

4

455.454

8

ice

freud

3.6.1

q4

884736

4

784.121

8

ice

freud

3.6.1

q6

884736

4

856.660

8

ice

OVITO

3.17.2

chill+

884736

4

1255.920

8

ice

OVITO

3.17.2

q4

884736

4

115.910

8

ice

OVITO

3.17.2

q6

884736

4

138.717

8

ice

OVITO

3.17.2

ptm-default

884736

4

2980.835

8

ice

OVITO

3.17.2

ptm-ice

884736

4

5522.668

8

ice

pyscal3

4.1.0

neighbours

884736

4

235.857

8

ice

pyscal3

4.1.0

q6

884736

4

377.019

8

ice

PLUMED

2.10.0

q6

884736

4

5127.091

8

ice

OVITO

3.17.2

coordination

884736

4

85.382

8

ice

d-SEAMS

seams 2.14.0

rings

884736

8

246.607

8

ice

d-SEAMS

seams 2.14.0

q4

884736

8

31.895

8

ice

d-SEAMS

seams 2.14.0

q6

884736

8

32.188

8

ice

d-SEAMS

seams 2.14.0

q4+q6

884736

8

85.776

8

ice

d-SEAMS

seams 2.14.0

neighbours

884736

8

52.710

8

ice

d-SEAMS

seams 2.14.0

chill+

884736

8

45.688

8

ice

d-SEAMS

seams 2.14.0

classifier

884736

8

48.499

8

ice

rings-statistics-matter

0.3.0

rings

884736

8

2707.952

8

ice

mdapy

2.0.0

neighbours

884736

8

88.871

8

ice

mdapy

2.0.0

q4

884736

8

111.528

8

ice

mdapy

2.0.0

q6

884736

8

134.511

8

ice

mdapy

2.0.0

rings

884736

8

3447.121

8

ice

mdapy

2.0.0

chill+

884736

8

93.155

8

ice

vesin

0.6.2

neighbours

884736

8

218.651

8

ice

freud

3.6.1

neighbours

884736

8

366.366

8

ice

freud

3.6.1

q4

884736

8

457.446

8

ice

freud

3.6.1

q6

884736

8

506.237

8

ice

OVITO

3.17.2

chill+

884736

8

652.481

8

ice

OVITO

3.17.2

q4

884736

8

69.910

8

ice

OVITO

3.17.2

q6

884736

8

81.451

8

ice

OVITO

3.17.2

ptm-default

884736

8

1585.135

8

ice

OVITO

3.17.2

ptm-ice

884736

8

2856.862

8

ice

pyscal3

4.1.0

neighbours

884736

8

154.994

8

ice

pyscal3

4.1.0

q6

884736

8

185.698

8

ice

PLUMED

2.10.0

q6

884736

8

2864.697

8

ice

OVITO

3.17.2

coordination

884736

8

58.378

8

liquid

d-SEAMS

seams 2.14.0

rings

884736

1

2942.271

8

liquid

d-SEAMS

seams 2.14.0

q4

884736

1

286.448

8

liquid

d-SEAMS

seams 2.14.0

q6

884736

1

292.794

8

liquid

d-SEAMS

seams 2.14.0

q4+q6

884736

1

602.804

8

liquid

d-SEAMS

seams 2.14.0

neighbours

884736

1

358.812

8

liquid

d-SEAMS

seams 2.14.0

chill+

884736

1

388.618

8

liquid

d-SEAMS

seams 2.14.0

classifier

884736

1

231.571

8

liquid

rings-statistics-matter

0.3.0

rings

884736

1

46036.912

6

liquid

mdapy

2.0.0

neighbours

884736

1

771.802

8

liquid

mdapy

2.0.0

q4

884736

1

971.259

8

liquid

mdapy

2.0.0

q6

884736

1

1132.685

8

liquid

mdapy

2.0.0

rings

884736

1

27579.640

8

liquid

mdapy

2.0.0

chill+

884736

1

939.828

8

liquid

vesin

0.6.2

neighbours

884736

1

1208.267

8

liquid

freud

3.6.1

neighbours

884736

1

1432.248

8

liquid

freud

3.6.1

q4

884736

1

2704.072

8

liquid

freud

3.6.1

q6

884736

1

3476.079

8

liquid

OVITO

3.17.2

chill+

884736

1

6997.797

8

liquid

OVITO

3.17.2

q4

884736

1

579.641

8

liquid

OVITO

3.17.2

q6

884736

1

678.298

8

liquid

OVITO

3.17.2

ptm-default

884736

1

14735.477

8

liquid

OVITO

3.17.2

ptm-ice

884736

1

23780.638

8

liquid

pyscal3

4.1.0

neighbours

884736

1

5676.788

8

liquid

pyscal3

4.1.0

q6

884736

1

6518.490

8

liquid

PLUMED

2.10.0

q6

884736

1

14772.141

8

liquid

OVITO

3.17.2

coordination

884736

1

472.467

8

liquid

d-SEAMS

seams 2.14.0

rings

884736

2

1814.221

8

liquid

d-SEAMS

seams 2.14.0

q4

884736

2

166.068

8

liquid

d-SEAMS

seams 2.14.0

q6

884736

2

166.131

8

liquid

d-SEAMS

seams 2.14.0

q4+q6

884736

2

368.867

8

liquid

d-SEAMS

seams 2.14.0

neighbours

884736

2

170.156

8

liquid

d-SEAMS

seams 2.14.0

chill+

884736

2

227.416

8

liquid

d-SEAMS

seams 2.14.0

classifier

884736

2

188.597

8

liquid

rings-statistics-matter

0.3.0

rings

884736

2

26666.491

8

liquid

mdapy

2.0.0

neighbours

884736

2

429.870

8

liquid

mdapy

2.0.0

q4

884736

2

564.521

8

liquid

mdapy

2.0.0

q6

884736

2

650.004

8

liquid

mdapy

2.0.0

rings

884736

2

16194.822

8

liquid

mdapy

2.0.0

chill+

884736

2

552.703

8

liquid

vesin

0.6.2

neighbours

884736

2

762.717

8

liquid

freud

3.6.1

neighbours

884736

2

1030.022

8

liquid

freud

3.6.1

q4

884736

2

1853.304

8

liquid

freud

3.6.1

q6

884736

2

2099.024

8

liquid

OVITO

3.17.2

chill+

884736

2

3834.722

8

liquid

OVITO

3.17.2

q4

884736

2

332.145

8

liquid

OVITO

3.17.2

q6

884736

2

382.303

8

liquid

OVITO

3.17.2

ptm-default

884736

2

8274.600

8

liquid

OVITO

3.17.2

ptm-ice

884736

2

13316.135

8

liquid

pyscal3

4.1.0

neighbours

884736

2

5603.883

8

liquid

pyscal3

4.1.0

q6

884736

2

5480.307

8

liquid

PLUMED

2.10.0

q6

884736

2

9477.669

8

liquid

OVITO

3.17.2

coordination

884736

2

233.464

8

liquid

d-SEAMS

seams 2.14.0

rings

884736

4

998.384

8

liquid

d-SEAMS

seams 2.14.0

q4

884736

4

77.948

8

liquid

d-SEAMS

seams 2.14.0

q6

884736

4

80.106

8

liquid

d-SEAMS

seams 2.14.0

q4+q6

884736

4

176.935

8

liquid

d-SEAMS

seams 2.14.0

neighbours

884736

4

90.549

8

liquid

d-SEAMS

seams 2.14.0

chill+

884736

4

110.300

8

liquid

d-SEAMS

seams 2.14.0

classifier

884736

4

97.179

8

liquid

rings-statistics-matter

0.3.0

rings

884736

4

13185.891

8

liquid

mdapy

2.0.0

neighbours

884736

4

198.683

8

liquid

mdapy

2.0.0

q4

884736

4

250.628

8

liquid

mdapy

2.0.0

q6

884736

4

298.040

8

liquid

mdapy

2.0.0

rings

884736

4

8009.372

8

liquid

mdapy

2.0.0

chill+

884736

4

265.715

8

liquid

vesin

0.6.2

neighbours

884736

4

378.252

8

liquid

freud

3.6.1

neighbours

884736

4

603.890

8

liquid

freud

3.6.1

q4

884736

4

907.548

8

liquid

freud

3.6.1

q6

884736

4

1040.515

8

liquid

OVITO

3.17.2

chill+

884736

4

1805.622

8

liquid

OVITO

3.17.2

q4

884736

4

165.699

8

liquid

OVITO

3.17.2

q6

884736

4

188.867

8

liquid

OVITO

3.17.2

ptm-default

884736

4

3835.198

8

liquid

OVITO

3.17.2

ptm-ice

884736

4

6077.990

8

liquid

pyscal3

4.1.0

neighbours

884736

4

4754.237

8

liquid

pyscal3

4.1.0

q6

884736

4

5010.902

8

liquid

PLUMED

2.10.0

q6

884736

4

5653.948

8

liquid

OVITO

3.17.2

coordination

884736

4

142.571

8

liquid

d-SEAMS

seams 2.14.0

rings

884736

8

677.074

8

liquid

d-SEAMS

seams 2.14.0

q4

884736

8

51.916

8

liquid

d-SEAMS

seams 2.14.0

q6

884736

8

53.166

8

liquid

d-SEAMS

seams 2.14.0

q4+q6

884736

8

123.123

8

liquid

d-SEAMS

seams 2.14.0

neighbours

884736

8

70.649

8

liquid

d-SEAMS

seams 2.14.0

chill+

884736

8

70.502

8

liquid

d-SEAMS

seams 2.14.0

classifier

884736

8

63.954

8

liquid

rings-statistics-matter

0.3.0

rings

884736

8

7477.520

8

liquid

mdapy

2.0.0

neighbours

884736

8

112.969

8

liquid

mdapy

2.0.0

q4

884736

8

148.271

8

liquid

mdapy

2.0.0

q6

884736

8

178.443

8

liquid

mdapy

2.0.0

rings

884736

8

5137.782

8

liquid

mdapy

2.0.0

chill+

884736

8

168.668

8

liquid

vesin

0.6.2

neighbours

884736

8

249.099

8

liquid

freud

3.6.1

neighbours

884736

8

562.501

8

liquid

freud

3.6.1

q4

884736

8

621.275

8

liquid

freud

3.6.1

q6

884736

8

693.877

8

liquid

OVITO

3.17.2

chill+

884736

8

1035.081

8

liquid

OVITO

3.17.2

q4

884736

8

99.272

8

liquid

OVITO

3.17.2

q6

884736

8

112.396

8

liquid

OVITO

3.17.2

ptm-default

884736

8

2190.199

8

liquid

OVITO

3.17.2

ptm-ice

884736

8

3494.725

8

liquid

pyscal3

4.1.0

neighbours

884736

8

4853.308

8

liquid

pyscal3

4.1.0

q6

884736

8

4845.223

8

liquid

PLUMED

2.10.0

q6

884736

8

3248.878

8

liquid

OVITO

3.17.2

coordination

884736

8

89.174

8

On the TIP4P/ice liquid, freud q6 differs from d-SEAMS by a maximum absolute gap of 1.525e-04. That gap is hard-cutoff rounding. PLUMED’s rational switch leaves a gap of 0.168 (1.679e-01). CHILL+ agrees on 830736/884736 molecules.

Neighbours

The rows are benchmarks/paper-cells/sitting-large.csv.

code

version

phase

operation

molecules

threads

median ms

n

d-SEAMS

seams 2.14.0

ice

neighbours

884736

1

260.183

8

mdapy

2.0.0

ice

neighbours

884736

1

469.862

8

freud

3.6.1

ice

neighbours

884736

1

1033.405

8

d-SEAMS

seams 2.14.0

ice

neighbours

884736

8

52.710

8

mdapy

2.0.0

ice

neighbours

884736

8

88.871

8

freud

3.6.1

ice

neighbours

884736

8

366.366

8

d-SEAMS

seams 2.14.0

liquid

neighbours

884736

1

358.812

8

mdapy

2.0.0

liquid

neighbours

884736

1

771.802

8

freud

3.6.1

liquid

neighbours

884736

1

1432.248

8

d-SEAMS

seams 2.14.0

liquid

neighbours

884736

8

70.649

8

mdapy

2.0.0

liquid

neighbours

884736

8

112.969

8

freud

3.6.1

liquid

neighbours

884736

8

562.501

8

Rings

The rows are benchmarks/rc3-sitting.csv.

code

version

operation

molecules

threads

median ms

iqr ms

n

d-SEAMS

2.14.0

rings

110592

1

88.959

1.764

6

OVITO

3.17.2

rings

110592

1

583.334

7.617

6

mdapy

2.0.0

rings

110592

1

2276.747

13.477

6

d-SEAMS

2.14.0

rings

110592

8

33.441

0.481

6

OVITO

3.17.2

rings

110592

8

354.605

17.902

6

mdapy

2.0.0

rings

110592

8

375.967

3.766

6

d-SEAMS

2.14.0

rings

884736

1

765.181

7.280

6

OVITO

3.17.2

rings

884736

1

4883.899

57.162

6

mdapy

2.0.0

rings

884736

1

19221.718

42.226

6

d-SEAMS

2.14.0

rings

884736

8

301.039

29.359

6

OVITO

3.17.2

rings

884736

8

2582.748

136.204

6

mdapy

2.0.0

rings

884736

8

3361.913

85.508

6

d-SEAMS

2.14.0

rings

110592

1

86.531

1.036

6

d-SEAMS

2.14.0

rings

110592

8

32.665

0.343

6

Rings against cycless

The rows are benchmarks/h2h-watch-v3.csv.

code

operation

molecules

median ms

n

d-SEAMS

rings

1000

3.044

6

cycless

rings

1000

3295.845

6

d-SEAMS

rings

110592

2206.976

6

cycless

rings

110592

385129.916

6

Rings against SQQ

The rows are benchmarks/h2h-watch-v6-sqq.csv.

code

operation

molecules

threads

median ms

n

SQQ

rings

110592

1

18234.926

6

SQQ

rings

110592

8

17907.744

6

q6

The rows are benchmarks/rc3-sitting.csv.

code

version

operation

molecules

threads

median ms

n

d-SEAMS

2.14.0

q6

884736

1

303.544

6

mdapy

2.0.0

q6

884736

1

921.574

6

freud

3.6.1

q6

884736

1

2973.372

6

d-SEAMS

2.14.0

q6

884736

8

57.752

6

mdapy

2.0.0

q6

884736

8

107.347

6

freud

3.6.1

q6

884736

8

550.161

6

q6 against OVITO

The rows are benchmarks/paper-cells/sitting-large.csv.

code

version

phase

operation

molecules

threads

median ms

n

d-SEAMS

seams 2.14.0

ice

q6

884736

1

150.095

8

OVITO

3.17.2

ice

q6

884736

1

476.740

8

d-SEAMS

seams 2.14.0

ice

q6

884736

8

32.188

8

OVITO

3.17.2

ice

q6

884736

8

81.451

8

d-SEAMS

seams 2.14.0

liquid

q6

884736

1

292.794

8

OVITO

3.17.2

liquid

q6

884736

1

678.298

8

d-SEAMS

seams 2.14.0

liquid

q6

884736

8

53.166

8

OVITO

3.17.2

liquid

q6

884736

8

112.396

8

CHILL+

The rows are benchmarks/rc3-sitting.csv.

code

version

operation

molecules

threads

median ms

n

d-SEAMS

2.14.0

CHILL+

110592

1

24.102

6

mdapy

2.0.0

CHILL+

110592

1

61.938

6

OVITO

3.17.2

CHILL+

110592

1

622.424

6

d-SEAMS

2.14.0

CHILL+

110592

8

5.697

6

mdapy

2.0.0

CHILL+

110592

8

12.379

6

OVITO

3.17.2

CHILL+

110592

8

88.685

6

d-SEAMS

2.14.0

CHILL+

884736

1

263.592

6

mdapy

2.0.0

CHILL+

884736

1

744.487

6

OVITO

3.17.2

CHILL+

884736

1

4890.789

6

d-SEAMS

2.14.0

CHILL+

884736

8

47.444

6

mdapy

2.0.0

CHILL+

884736

8

125.578

6

OVITO

3.17.2

CHILL+

884736

8

666.288

6

Cages

The rows are benchmarks/rc3-sitting.csv.

code

version

operation

molecules

threads

median ms

n

d-SEAMS

2.14.0

cages

46

1

0.682

6

ClavisCage

0.3.18

cages

46

1

51.122

6

d-SEAMS

2.14.0

cages

46

8

0.583

6

ClavisCage

0.3.18

cages

46

8

51.206

6

d-SEAMS

2.14.0

cages

368

1

4.829

6

ClavisCage

0.3.18

cages

368

1

301.514

6

d-SEAMS

2.14.0

cages

368

8

3.893

6

ClavisCage

0.3.18

cages

368

8

302.471

6

d-SEAMS

2.14.0

cages

136

1

1.805

6

ClavisCage

0.3.18

cages

136

1

69.332

6

d-SEAMS

2.14.0

cages

136

8

1.623

6

ClavisCage

0.3.18

cages

136

8

69.657

6

PTM

The rows are benchmarks/rc3-sitting.csv.

code

version

operation

molecules

threads

median ms

n

d-SEAMS

2.14.0

PTM

110592

1

30.475

6

OVITO

3.17.2

PTM

110592

1

2790.624

6

d-SEAMS

2.14.0

PTM

110592

8

6.976

6

OVITO

3.17.2

PTM

110592

8

370.341

6

d-SEAMS

2.14.0

PTM

884736

1

287.530

6

OVITO

3.17.2

PTM

884736

1

21304.364

6

d-SEAMS

2.14.0

PTM

884736

8

51.470

6

OVITO

3.17.2

PTM

884736

8

2849.382

6

Linkcell scaling

The rows are benchmarks/cutoff-rings.csv.

code

operation

threads

median ms

iqr ms

n

linkcell

total

1

653.639

9.726

8

cell-list

total

1

654.896

8.296

8

linkcell

total

2

521.980

4.294

8

cell-list

total

2

418.741

3.510

8

linkcell

total

4

323.101

1.161

8

cell-list

total

4

252.877

1.991

8

linkcell

total

8

228.632

5.324

8

cell-list

total

8

173.215

2.554

8

benchmarks/one-sitting-v3.csv is the next one-sitting file. This page adds its table when the file is in the tree.