home / ci-timing

bench_verdicts

Nanosoldier's comparison of each benchmark against the baseline report.

Data source: JuliaCI/julia-ci-timing

time_ratio
this report's time over the baseline's; above 1 is slower
verdict
regression, improvement or invariant
time_tolerance
the ratio change Nanosoldier tolerates for this benchmark

90,445 rows

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: verdict

Link report_id bench_id time_ratio time_tolerance memory_ratio memory_tolerance verdict
95,6 95 95 accumulate/('accumulate!', 'Int') 6 1.11 0.05 1.0 0.01 regression
95,7 95 95 accumulate/('accumulate', 'Float64') 7 1.07 0.05 1.0 0.01 regression
95,8 95 95 accumulate/('accumulate', 'Int') 8 1.3 0.05 1.0 0.01 regression
95,11 95 95 accumulate/('cumsum!', 'Float64', 'dim2') 11 0.75 0.05 1.0 0.01 improvement
95,12 95 95 accumulate/('cumsum!', 'Int') 12 1.17 0.05 1.0 0.01 regression
95,13 95 95 accumulate/('cumsum', 'Float64') 13 1.1 0.05 1.0 0.01 regression
95,15 95 95 accumulate/('cumsum', 'Float64', 'dim2') 15 0.77 0.05 1.0 0.01 improvement
95,16 95 95 accumulate/('cumsum', 'Int') 16 1.32 0.05 1.0 0.01 regression
95,17 95 95 any/all/('all', 'BitArray') 17 0.79 0.05 1.0 0.01 improvement
95,23 95 95 any/all/('all', 'Vector{Float64} generator') 23 0.78 0.05 1.0 0.01 improvement
95,29 95 95 any/all/('any', 'BitArray') 29 0.8 0.05 1.0 0.01 improvement
95,33 95 95 any/all/('any', 'Vector{Float32} generator') 33 1.29 0.05 1.0 0.01 regression
95,34 95 95 any/all/('any', 'Vector{Float32}') 34 1.29 0.05 1.0 0.01 regression
95,35 95 95 any/all/('any', 'Vector{Float64} generator') 35 0.78 0.05 1.0 0.01 improvement
95,36 95 95 any/all/('any', 'Vector{Float64}') 36 1.27 0.05 1.0 0.01 regression
95,45 95 95 bool/boolarray_true_fill! 45 0.89 0.05 1.0 0.01 improvement
95,46 95 95 bool/boolarray_true_load! 46 2.73 0.05 1.0 0.01 regression
95,48 95 95 cat/('catnd', 500) 48 1.1 0.05 1.0 0.01 regression
95,51 95 95 cat/('hcat', 5) 51 1.58 0.05 1.0 0.01 regression
95,53 95 95 cat/('hcat_setind', 5) 53 1.1 0.05 1.0 0.01 regression
95,55 95 95 cat/('hvcat', 5) 55 1.07 0.05 1.0 0.01 regression
95,57 95 95 cat/('hvcat_setind', 5) 57 1.09 0.05 1.0 0.01 regression
95,59 95 95 cat/('vcat', 5) 59 1.13 0.05 1.0 0.01 regression
95,61 95 95 cat/('vcat_setind', 5) 61 1.13 0.05 1.0 0.01 regression
95,65 95 95 comprehension/('collect', 'StepRangeLen{Float64, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}}') 65 0.4 0.05 1.0 0.01 improvement
95,66 95 95 comprehension/('collect', 'Vector{Float64}') 66 0.3 0.05 1.0 0.01 improvement
95,68 95 95 comprehension/('comprehension_collect', 'StepRangeLen{Float64, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}}') 68 0.4 0.05 1.0 0.01 improvement
95,69 95 95 comprehension/('comprehension_collect', 'Vector{Float64}') 69 0.33 0.05 1.0 0.01 improvement
95,72 95 95 comprehension/('comprehension_indexing', 'Vector{Float64}') 72 0.67 0.3 1.0 0.01 improvement
95,74 95 95 comprehension/('comprehension_iteration', 'StepRangeLen{Float64, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}}') 74 0.82 0.05 1.0 0.01 improvement
95,75 95 95 comprehension/('comprehension_iteration', 'Vector{Float64}') 75 0.69 0.05 1.0 0.01 improvement
95,76 95 95 convert/('Complex{Float64}', 'Int') 76 0.81 0.05 1.0 0.01 improvement
95,80 95 95 equality/('==', 'BitArray') 80 0.53 0.05 1.0 0.01 improvement
95,81 95 95 equality/('==', 'UnitRange{Int64}') 81 0.0 0.05 1.0 0.01 improvement
95,88 95 95 equality/('==', 'Vector{Int16}') 88 1.05 0.05 1.0 0.01 regression
95,90 95 95 equality/('==', 'Vector{Int64} == Vector{Float32}') 90 1.31 0.05 1.0 0.01 regression
95,91 95 95 equality/('==', 'Vector{Int64} == Vector{Float64}') 91 1.3 0.05 1.0 0.01 regression
95,96 95 95 equality/('isequal', 'UnitRange{Int64}') 96 0.0 0.05 1.0 0.01 improvement
95,104 95 95 equality/('isequal', 'Vector{Int64} isequal UnitRange{Int64}') 104 0.75 0.05 1.0 0.01 improvement
95,105 95 95 equality/('isequal', 'Vector{Int64} isequal Vector{Float32}') 105 0.93 0.05 1.0 0.01 improvement
95,106 95 95 equality/('isequal', 'Vector{Int64} isequal Vector{Float64}') 106 1.17 0.05 1.0 0.01 regression
95,108 95 95 equality/('isequal', 'Vector{Int64} isequal Vector{Int64}') 108 0.12 0.05 1.0 0.01 improvement
95,110 95 95 growth/('append!', 2048) 110 1.37 0.05 1.66 0.01 regression
95,111 95 95 growth/('append!', 256) 111 1.26 0.05 1.19 0.01 regression
95,112 95 95 growth/('append!', 8) 112 0.52 0.05 0.91 0.01 improvement
95,113 95 95 growth/('prerend!', 2048) 113 1.05 0.05 0.78 0.01 regression
95,114 95 95 growth/('prerend!', 256) 114 1.71 0.05 0.63 0.01 regression
95,115 95 95 growth/('prerend!', 8) 115 0.75 0.05 0.49 0.01 improvement
95,116 95 95 growth/('push_multiple!', 2048) 116 1.08 0.05 1.0 0.01 regression
95,117 95 95 growth/('push_multiple!', 256) 117 1.14 0.05 1.48 0.01 regression
95,118 95 95 growth/('push_multiple!', 8) 118 0.77 0.05 0.93 0.01 improvement
95,119 95 95 growth/('push_single!', 2048) 119 0.0 0.05 0.0 0.01 improvement
95,120 95 95 growth/('push_single!', 256) 120 0.03 0.05 0.01 0.01 improvement
95,121 95 95 growth/('push_single!', 8) 121 0.2 0.05 0.11 0.01 improvement
95,162 95 95 index/('sumcartesian', 'Base.ReinterpretArray{BaseBenchmarks.ArrayBenchmarks.PairVals{Int32}, 2, Int64, Matrix{Int64}, false}') 162 0.26 0.5 1.0 0.01 improvement
95,262 95 95 index/('sumcolon_view', '1.0:0.00010001000100010001:2.0') 262 0.36 0.5 1.0 0.01 improvement
95,263 95 95 index/('sumcolon_view', '1.0:1.0:100000.0') 263 0.36 0.5 1.0 0.01 improvement
95,264 95 95 index/('sumcolon_view', '100000:-1:1') 264 0.44 0.5 1.0 0.01 improvement
95,265 95 95 index/('sumcolon_view', '1:100000') 265 0.34 0.5 1.0 0.01 improvement
95,298 95 95 index/('sumeach', '100000:-1:1') 298 0.21 0.5 1.0 0.01 improvement
95,299 95 95 index/('sumeach', '1:100000') 299 0.11 0.5 1.0 0.01 improvement
95,373 95 95 index/('sumelt', '1:100000') 373 0.1 0.5 1.0 0.01 improvement
95,403 95 95 index/('sumelt', 'SubArray{Int32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32, 2}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}') 403 1.59 0.5 1.0 0.01 regression
95,446 95 95 index/('sumlinear', '100000:-1:1') 446 0.21 0.5 1.0 0.01 improvement
95,447 95 95 index/('sumlinear', '1:100000') 447 0.12 0.5 1.0 0.01 improvement
95,620 95 95 index/('sumrange_view', '1.0:0.00010001000100010001:2.0') 620 0.37 0.5 1.0 0.01 improvement
95,621 95 95 index/('sumrange_view', '1.0:1.0:100000.0') 621 0.37 0.5 1.0 0.01 improvement
95,622 95 95 index/('sumrange_view', '100000:-1:1') 622 0.45 0.5 1.0 0.01 improvement
95,623 95 95 index/('sumrange_view', '1:100000') 623 0.34 0.5 1.0 0.01 improvement
95,731 95 95 reductions/('maxabs', 'Int64') 731 0.92 0.05 1.0 0.01 improvement
95,732 95 95 reductions/('mean', 'Float64') 732 0.76 0.05 1.0 0.01 improvement
95,733 95 95 reductions/('mean', 'Int64') 733 0.82 0.05 1.0 0.01 improvement
95,734 95 95 reductions/('norm', 'Float64') 734 0.94 0.05 1.0 0.01 improvement
95,736 95 95 reductions/('norm1', 'Float64') 736 0.71 0.05 1.0 0.01 improvement
95,741 95 95 reductions/('perf_mapreduce', 'Int64') 741 0.76 0.05 1.0 0.01 improvement
95,743 95 95 reductions/('perf_reduce', 'Int64') 743 0.76 0.05 1.0 0.01 improvement
95,744 95 95 reductions/('sum', 'Float64') 744 0.74 0.05 1.0 0.01 improvement
95,745 95 95 reductions/('sum', 'Int64') 745 0.7 0.05 1.0 0.01 improvement
95,746 95 95 reductions/('sumabs', 'Float64') 746 0.8 0.05 1.0 0.01 improvement
95,747 95 95 reductions/('sumabs', 'Int64') 747 0.77 0.05 1.0 0.01 improvement
95,748 95 95 reductions/('sumabs2', 'Float64') 748 0.78 0.05 1.0 0.01 improvement
95,749 95 95 reductions/('sumabs2', 'Int64') 749 0.86 0.05 1.0 0.01 improvement
95,750 95 95 reverse/rev_load_fast! 750 1.09 0.05 1.0 0.01 regression
95,752 95 95 reverse/rev_loadmul_fast! 752 1.08 0.05 1.0 0.01 regression
95,753 95 95 reverse/rev_loadmul_slow! 753 1.08 0.05 1.0 0.01 regression
95,754 95 95 setindex!/('setindex!', 1) 754 0.11 0.05 1.0 0.01 improvement
95,755 95 95 setindex!/('setindex!', 2) 755 0.1 0.05 1.0 0.01 improvement
95,756 95 95 setindex!/('setindex!', 3) 756 0.1 0.05 1.0 0.01 improvement
95,757 95 95 setindex!/('setindex!', 4) 757 0.1 0.05 1.0 0.01 improvement
95,758 95 95 setindex!/('setindex!', 5) 758 0.1 0.05 1.0 0.01 improvement
95,764 95 95 subarray/('lucompletepivCopy!', 1000) 764 0.87 0.05 1.0 0.01 improvement
95,779 95 95 mix_scalar_tuple/(10, 'scal_tup') 779 0.0 0.05 1.0 0.01 improvement
95,780 95 95 mix_scalar_tuple/(10, 'scal_tup_x3') 780 0.12 0.05 1.0 0.01 improvement
95,781 95 95 mix_scalar_tuple/(10, 'tup_tup') 781 0.08 0.05 1.0 0.01 improvement
95,782 95 95 mix_scalar_tuple/(3, 'scal_tup') 782 0.0 0.05 1.0 0.01 improvement
95,783 95 95 mix_scalar_tuple/(3, 'scal_tup_x3') 783 0.08 0.05 1.0 0.01 improvement
95,784 95 95 mix_scalar_tuple/(3, 'tup_tup') 784 0.0 0.05 1.0 0.01 improvement
95,785 95 95 mix_scalar_tuple/(5, 'scal_tup') 785 0.0 0.05 1.0 0.01 improvement
95,786 95 95 mix_scalar_tuple/(5, 'scal_tup_x3') 786 0.09 0.05 1.0 0.01 improvement
95,787 95 95 mix_scalar_tuple/(5, 'tup_tup') 787 0.07 0.05 1.0 0.01 improvement

Next page

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE bench_verdicts (
    report_id        INTEGER NOT NULL REFERENCES bench_reports (id),
    bench_id         INTEGER NOT NULL REFERENCES bench_names (id),
    time_ratio       REAL,
    time_tolerance   REAL,
    memory_ratio     REAL,
    memory_tolerance REAL,
    verdict          TEXT,                   
    PRIMARY KEY (report_id, bench_id)
) WITHOUT ROWID;
Powered by Datasette · Queries took 832.318ms · Data source: JuliaCI/julia-ci-timing