Home /Modules/comparison/ARITHMETIC.SPEED.001.md

ARITHMETIC.SPEED.001.md

comparison/ARITHMETIC.SPEED.001.md · 217 line(s) · markdown

Arithmetic Speed Series — Iteration 001

Suite: SCS-PERF-ARITH-001 Run status: PASS — local reference execution Recorded: 2026-11-07 Scope: C11, C++17, Java 21+, Basic Native SLeeLa VM, and Premium SLVM/1–11; four arithmetic operators across fixed-width integer and floating-point types. Native-language timings are measured; SLeeLa VM execution qualification is recorded separately.

1. Result

The full arithmetic operator sweep executed for all supported target/type combinations. The run completed five measured repetitions per case, after one native warm-up run and three in-process Java warm-up sweeps. All 40 common type/operator checksums matched across C11, C++17, and Java. C/C++ additionally ran four signed-128-bit cases; Java has no primitive 128-bit integer.

The reported values are median nanoseconds per operation (ns/op). Lower is faster for this specific microbenchmark. These are local-container observations, not universal language rankings or release-grade measurements.

2. Host and toolchain

PropertyValue
OSLinux 6.18.57 x86_64, glibc 2.41
CPUAMD EPYC 9V74 80-Core Processor (container allocation: 3 logical CPUs)
RAM visible to container6,091,004 kB
C compilerGCC 14.2.0
C++ compilerG++ 14.2.0
JavaOpenJDK 21.0.12.1
Native optimization-O2
Operations per case2,000,000
Operand set4,096 deterministic elements; shared seed 0x53435350
Repetitions5 measured samples per type/operator
Warm-upOne untimed native process; three Java warm-up sweeps inside each measured JVM
Timing sourceMonotonic high-resolution clock

3. Full results — median ns/op

TypeOperatorC11 (ns/op)C++17 (ns/op)Java 21+ (ns/op)Basic Native VM (ns/op)Premium SLVM/1 (ns/op)Premium SLVM/2 (ns/op)Premium SLVM/3 (ns/op)Premium SLVM/4 (ns/op)Premium SLVM/5 (ns/op)Premium SLVM/6 (ns/op)Premium SLVM/7 (ns/op)Premium SLVM/8 (ns/op)Premium SLVM/9 (ns/op)Premium SLVM/10 (ns/op)Premium SLVM/11 (ns/op)
i8+0.5750.6030.824NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i8-1.1281.1731.382NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i8*1.2411.2765.483NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i8/1.7041.7327.171NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u8+0.5930.5701.075NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u8-1.2200.8351.164NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u8*1.2810.9791.798NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u8/1.1161.1432.476NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i16+0.5670.6031.259NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i16-1.1211.1641.364NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i16*1.2641.1911.818NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i16/1.7681.7292.251NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u16+0.6620.6451.102NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u16-1.1751.1381.121NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u16*1.1621.2391.026NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u16/1.1601.1541.985NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i32+0.6630.6791.158NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i32-1.2300.9871.510NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i32*1.2621.0131.218NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i32/1.7541.6932.017NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u32+0.7070.7360.602NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u32-1.2441.1911.230NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u32*1.4211.3170.966NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u32/1.7101.8272.001NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i64+0.5870.6870.70855.67552.24852.61450.39049.72855.10954.66854.83951.69559.61055.95153.557
i64-1.1801.2541.11057.22752.16651.24549.20550.01253.94251.93252.34752.56160.22255.17055.662
i64*1.4171.4260.99254.75952.57854.59949.03149.25755.90453.92251.98551.21759.11856.08955.410
i64/2.0872.2232.01054.67852.70753.74950.98749.17455.87754.45051.25553.78459.36056.30556.485
u64+0.5770.6980.573NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u64-1.2091.1700.728NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u64*1.3271.3170.827NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
u64/1.9662.0431.933NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i128+0.6100.641N/ANOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i128-0.8620.798N/ANOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i128*1.0200.932N/ANOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
i128/2.4313.691N/ANOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
f32+1.2431.1420.813NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
f32-1.2611.2560.839NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
f32*1.2931.2360.867NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
f32/1.0190.9670.911NOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASUREDNOT MEASURED
f64+1.1281.1310.78286.75781.33085.27381.26678.70687.97483.61083.78285.13188.75787.55286.039
f64-1.2501.2230.84866.84359.11257.62857.50157.28964.17860.50761.12462.09264.11462.67365.329
f64*1.2241.2910.84263.73960.69462.31757.73656.32363.95960.41459.88761.58364.66063.15763.760
f64/1.3561.4101.31862.62461.33356.57156.34156.49361.59262.69861.27863.26566.67662.15563.656

SLeeLa VM table completion — hosted CI

Workflow: SLeeLa VM arithmetic table CI — run 42346969526

4. Coverage and qualifications

5. SLeeLa VM arithmetic results — hosted CI, validated

Workflow: Complete SLeeLa VM and Language Conformance — run 42342660507 Commit: ff75886e08bbff7f325d1ca84b0e86b930bda54c Artifact: sleela-complete-vm-matrix — comparison-sleela-vm-arithmetic-results.json Arithmetic result: PASS — 12/12 runnable targets, 96/96 target-operation cases, 480/480 sample checksum validations.

The arithmetic benchmark completed before the workflow's later Modium freshness check. That subsequent check failed because the checked-in MODIUM.json and rebuild.sql artifacts for Standard VM generations 001–010 were out of date. It did not fail the VM arithmetic test, invalidate its JSON artifact, or indicate a runtime arithmetic defect.

5.1 Host and measurement protocol

PropertyValue
Host OSLinux 7.0.0-1019-azure, x86_64, glibc 2.43
Logical cores4
TargetsBasic Native + Premium SLVM/1–11
Numeric casesint and double
OperatorsAddition, subtraction, multiplication, division
Iterations per case250,000
Warm-up50,000 iterations per case
Samples5 per target/case
Timing sourceSLeeLa timeMonotonicNanos()
Timed regionIn-VM measured loop; process startup, compilation, VM selection/admission, and warm-up excluded
StatisticMedian nanoseconds per operation (ns/op)

The benchmark covers the full in-VM loop, including loop-counter, branch, assignment, interpreter dispatch, arithmetic, and checksum work. It is not isolated hardware instruction latency. The double result is emitted as a scaled integer at 1e-6 resolution to avoid the runtime's lossy default floating-point text formatting. The checker validates the scaled checksums exactly; integer cases remain exact.

5.2 Median timing matrix — ns/op

SLeeLa targetint +int -int *int /double +double -double *double /
Basic Native72.10772.17872.11272.26080.55279.12479.76882.920
Premium SLVM/172.53772.32172.51972.48580.88179.68280.46583.057
Premium SLVM/272.54272.27772.24172.41080.65679.70279.91083.378
Premium SLVM/372.56672.51872.52072.32380.48679.80979.85483.057
Premium SLVM/472.57172.49872.21872.29780.57979.71079.97182.897
Premium SLVM/573.07472.51572.18772.25580.51879.74679.88982.993
Premium SLVM/672.80772.65072.43672.31880.73879.55479.91683.165
Premium SLVM/772.71872.18572.60772.30980.95479.65679.95083.103
Premium SLVM/875.77975.11175.32975.53082.88881.71782.72184.797
Premium SLVM/972.80572.52072.29772.23780.58179.73479.74983.080
Premium SLVM/1072.57672.34072.23872.33280.50679.60880.11983.183
Premium SLVM/1181.84281.70681.85382.46887.85887.16587.60691.017

5.3 Arithmetic correctness and VM execution qualification

5.4 Comparison limitations

The native C11/C++17/Java benchmark in sections 2–4 is a different harness with different operation counts and typed workloads. The SLeeLa VM numbers above should not be used for a direct speed ranking against those native-language numbers until a matched workload, host, compiler configuration, and timing boundary are established. The VM figures are useful as an internal baseline across the twelve runnable SLeeLa targets.

The SLeeLa workload currently measures only the language-level int and double types. It does not establish performance for every fixed-width integer type, float32, Boolean logic, RAM bandwidth/latency, allocation, or garbage collection.

6. Memory and RAM performance

The arithmetic runs do not measure RAM latency or bandwidth. A separate suite is required for sequential read/write bandwidth, random-access latency, cache-resident versus larger-than-cache working sets, strides, allocation, and garbage collection. The host's visible RAM figure is metadata, not a memory-speed result.

7. Boolean and logical-operation performance

Boolean arithmetic is not applicable. A separate suite should measure logical AND, OR, NOT, equality/inequality, and short-circuit behavior, with truth-table and side-effect validation before timings are accepted.

8. Reproduction and source artifacts

Native-language reference reproduction:

python3 comparison/tests/run_arithmetic_speed.py

SLeeLa VM reproduction after building the Basic Native and Premium VMs:

python3 comparison/tests/run_sleela_vm_arithmetic_speed.py

The VM runner writes comparison-sleela-vm-arithmetic-results.json; hosted CI retains it in the sleela-complete-vm-matrix artifact linked above. The raw five-sample arrays, checksums, target metadata, and host information are preserved in that JSON.

Conclusion: native C11, C++17, and Java 21+ retain their separately recorded local and hosted arithmetic datasets. SLeeLa Basic Native and Premium SLVM/1–11 now have validated internal arithmetic timings for the eight tested int/double operator cases. No cross-language speed ranking or RAM-performance claim is made.

Latest cross-platform CI status — 2026-11-07

The corrective reruns are still in progress at the time of this update:

Basic Native VM + Premium SLVM 1-11: in_progress Arithmetic speed — C11, C++17, Java 21+: completed (success) C11, C++17, Java 21+ (macos-latest): completed (success) C11, C++17, Java 21+ (ubuntu-latest): completed (success) C11, C++17, Java 21+ (windows-latest): in_progress

Native runtime (ubuntu-latest): in_progress Native runtime (macos-latest): in_progress Native runtime (Windows 10+ / MinGW-w64): in_progress

These jobs have not yet produced final cross-platform qualification results. The previously validated SLeeLa arithmetic benchmark remains PASS (12/12 runnable targets; 96/96 target-operation cases; 480/480 sample checksum validations). The separate C11/C++17/Java 21+ hosted comparator result remains PASS (128/128 cases). The cross-platform reruns must not be conflated with those completed arithmetic measurements.

Final corrective CI results — 2026-11-07

The two corrective workflows have now completed.

These failures are test-harness portability issues observed after the earlier native build and several OSLS checks succeeded. They do not overturn the successful VM/language conformance workflow or the separately validated arithmetic measurements. Native portability is NOT qualified on any of the three operating systems until the shell recipe and Windows path expectation are corrected and the workflow is rerun.