Skip to content

chore: add test coverage#924

Open
cdc-as81 wants to merge 4 commits into
mainfrom
cdc-as81-add-test-coverage
Open

chore: add test coverage#924
cdc-as81 wants to merge 4 commits into
mainfrom
cdc-as81-add-test-coverage

Conversation

@cdc-as81
Copy link
Copy Markdown
Collaborator

Summary

  • Add cargo-llvm-cov as a mise-managed tool.
  • Add a mise run coverage task for local Rust coverage generation across the workspace and all targets.
  • Generate both summary and HTML coverage reports, with HTML output available under target/llvm-cov/html/.
  • Ignore *.profraw coverage artifacts so raw profiling files do not show up as untracked files.

@github-actions
Copy link
Copy Markdown

Benchmark Results

Hyperfine

Command Mean [ms] Min [ms] Max [ms] Relative
large_sir::baseline 2.7 ± 0.0 2.6 2.8 1.00
large_sir::baseline_households 2.7 ± 0.0 2.6 2.8 1.02 ± 0.02
large_sir::entities 6.0 ± 0.1 5.8 6.4 2.24 ± 0.05
large_sir::households 5.8 ± 0.1 5.6 6.0 2.15 ± 0.04

Criterion

Regressions (slower)
Group Bench Param Change CI Lower CI Upper
sample_entity sample_entity_whole_population 10000 92.143% 89.043% 95.448%
large_dataset bench_match_entity 46.235% 42.190% 50.443%
sample_entity sample_entity_multi_property_indexed 100000 23.898% 22.216% 25.556%
sample_entity sample_entity_multi_property_indexed 10000 18.885% 17.003% 20.654%
sample_entity sample_entity_multi_property_indexed 1000 14.394% 13.305% 15.478%
large_dataset bench_filter_indexed_entity 11.443% 1.751% 22.245%
indexing query_people_count_indexed_multi-property_entities 6.781% 4.048% 9.716%
counts multi_property_unindexed_entities 6.248% 3.649% 8.859%
large_dataset bench_filter_unindexed_entity 5.994% 1.861% 10.429%
counts single_property_indexed_entities 5.031% 3.908% 6.256%
large_dataset bench_query_population_derived_property_entities 3.858% 3.195% 4.451%
sample_entity sample_entity_single_property_indexed 100000 2.900% 2.279% 3.529%
indexing query_people_count_multiple_individually_indexed_properties_enti 2.164% 1.948% 2.365%
sample_entity sample_entity_single_property_unindexed 10000 2.072% 1.763% 2.344%
Improvements (faster)
Group Bench Param Change CI Lower CI Upper
sampling sampling_multiple_l_reservoir_entities -5.470% -6.934% -4.048%
large_dataset bench_query_population_indexed_property_entities -4.972% -7.346% -2.508%
counts reindex_after_adding_more_entities -3.453% -3.685% -3.216%
sampling sampling_single_unindexed_entities -3.341% -3.634% -3.097%
sampling sampling_single_l_reservoir_entities -2.836% -3.934% -1.764%
sampling count_and_sampling_single_known_length_entities -2.499% -3.721% -1.198%
sampling sampling_multiple_unindexed_entities -2.463% -2.741% -2.162%
sample_entity sample_entity_single_property_indexed 10000 -2.314% -2.829% -1.795%
counts multi_property_indexed_entities -1.789% -2.297% -1.306%
indexing query_people_indexed_multi-property_entities -1.636% -2.010% -1.349%
Unchanged / inconclusive (CI crosses 0%)
Group Bench Param Change CI Lower CI Upper
examples example-basic-infection 2.312% -2.363% 11.189%
counts single_property_unindexed_entities 1.694% 0.638% 2.830%
counts index_after_adding_entities -1.297% -1.699% -0.901%
algorithm_benches algorithm_sampling_multiple_known_length -1.238% -1.847% -0.632%
indexing with_query_results_multiple_individually_indexed_properties_enti -1.018% -2.949% 0.690%
indexing with_query_results_single_indexed_property_entities 0.831% 0.299% 1.373%
sample_entity sample_entity_single_property_unindexed 1000 -0.787% -1.644% -0.169%
indexing query_people_count_single_indexed_property_entities -0.736% -1.039% -0.453%
sample_entity sample_entity_single_property_indexed 1000 -0.723% -1.289% -0.212%
sampling sampling_multiple_known_length_entities 0.667% 0.351% 0.983%
algorithm_benches algorithm_sampling_single_rand_reservoir -0.535% -1.194% 0.005%
counts concrete_plus_derived_unindexed_entities 0.519% -0.331% 1.454%
sample_entity sample_entity_whole_population 100000 0.483% 0.135% 0.912%
algorithm_benches algorithm_sampling_single_known_length 0.478% -0.328% 1.535%
large_dataset bench_query_population_multi_indexed_entities 0.447% -0.477% 1.424%
examples example-births-deaths 0.445% -0.100% 0.856%
sampling count_and_sampling_single_unindexed_concrete_plus_derived_entiti -0.375% -0.614% -0.118%
sampling sampling_single_unindexed_concrete_plus_derived_entities 0.278% -0.054% 0.608%
algorithm_benches algorithm_sampling_single_l_reservoir -0.236% -0.607% 0.146%
sample_entity sample_entity_whole_population 1000 0.208% -0.047% 0.463%
indexing query_people_multiple_individually_indexed_properties_entities -0.189% -0.428% 0.045%
indexing with_query_results_indexed_multi-property_entities 0.175% -0.430% 0.716%
indexing query_people_single_indexed_property_entities -0.082% -0.371% 0.379%
algorithm_benches algorithm_sampling_multiple_l_reservoir -0.067% -0.641% 0.475%
large_dataset bench_query_population_multi_unindexed_entities -0.057% -0.312% 0.318%
large_dataset bench_query_population_property_entities 0.046% -1.003% 0.954%
sampling sampling_single_known_length_entities -0.018% -1.019% 1.018%
sample_entity sample_entity_single_property_unindexed 100000 0.013% -0.339% 0.412%
Not Compared (no baseline yet)
Group Bench Reason
(none)

github-actions Bot added a commit that referenced this pull request May 27, 2026
@cdc-as81 cdc-as81 linked an issue May 27, 2026 that may be closed by this pull request
Copy link
Copy Markdown
Collaborator

@RobertJacobsonCDC RobertJacobsonCDC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please clarify what this PR does.

Comment thread mise.toml
@github-actions
Copy link
Copy Markdown

Benchmark Results

Hyperfine

Command Mean [ms] Min [ms] Max [ms] Relative
large_sir::baseline 3.4 ± 0.1 3.3 3.6 1.01 ± 0.02
large_sir::baseline_households 3.4 ± 0.0 3.3 3.5 1.00
large_sir::entities 7.6 ± 0.1 7.4 8.2 2.25 ± 0.05
large_sir::households 7.3 ± 0.1 7.1 7.7 2.16 ± 0.05

Criterion

Regressions (slower)
Group Bench Param Change CI Lower CI Upper
sample_entity sample_entity_multi_property_indexed 1000 18.473% 15.122% 21.448%
large_dataset bench_filter_indexed_entity 13.941% 3.657% 25.090%
large_dataset bench_filter_unindexed_entity 5.879% 1.825% 10.176%
large_dataset bench_match_entity 2.378% 1.793% 3.065%
sample_entity sample_entity_single_property_unindexed 10000 2.331% 2.059% 2.586%
indexing query_people_count_multiple_individually_indexed_properties_enti 2.312% 1.563% 3.346%
Improvements (faster)
Group Bench Param Change CI Lower CI Upper
counts single_property_indexed_entities -15.685% -17.828% -13.484%
sample_entity sample_entity_multi_property_indexed 100000 -7.521% -8.591% -6.470%
sampling sampling_single_l_reservoir_entities -4.671% -5.851% -3.560%
sampling sampling_single_known_length_entities -3.897% -4.863% -3.017%
indexing query_people_count_single_indexed_property_entities -2.705% -3.955% -1.712%
sample_entity sample_entity_multi_property_indexed 10000 -2.198% -2.998% -1.386%
large_dataset bench_query_population_derived_property_entities -2.146% -2.901% -1.407%
Unchanged / inconclusive (CI crosses 0%)
Group Bench Param Change CI Lower CI Upper
sample_entity sample_entity_single_property_indexed 100000 2.490% 0.921% 3.944%
sample_entity sample_entity_single_property_indexed 1000 2.419% 0.899% 4.137%
counts reindex_after_adding_more_entities 1.572% 0.890% 2.404%
indexing query_people_count_indexed_multi-property_entities 1.233% 0.902% 1.562%
examples example-births-deaths -1.089% -1.416% -0.648%
large_dataset bench_query_population_multi_indexed_entities 1.023% 0.696% 1.426%
large_dataset bench_query_population_property_entities 1.002% 0.195% 1.929%
sample_entity sample_entity_whole_population 10000 -0.999% -1.732% -0.266%
examples example-basic-infection -0.983% -1.210% -0.724%
sample_entity sample_entity_whole_population 100000 -0.954% -1.629% -0.223%
indexing query_people_multiple_individually_indexed_properties_entities -0.942% -3.072% 1.100%
counts multi_property_unindexed_entities -0.875% -1.683% -0.233%
indexing with_query_results_single_indexed_property_entities -0.735% -1.329% -0.191%
sample_entity sample_entity_single_property_indexed 10000 -0.712% -2.177% 0.757%
algorithm_benches algorithm_sampling_single_known_length -0.686% -1.701% 0.258%
sampling sampling_multiple_known_length_entities 0.651% 0.184% 1.236%
counts multi_property_indexed_entities -0.535% -1.163% -0.002%
large_dataset bench_query_population_indexed_property_entities -0.531% -1.321% 0.220%
counts index_after_adding_entities -0.472% -1.522% 0.460%
large_dataset bench_query_population_multi_unindexed_entities -0.414% -0.753% 0.031%
algorithm_benches algorithm_sampling_single_rand_reservoir -0.384% -0.804% 0.107%
counts concrete_plus_derived_unindexed_entities 0.347% 0.017% 0.792%
algorithm_benches algorithm_sampling_multiple_l_reservoir 0.276% -0.122% 0.660%
algorithm_benches algorithm_sampling_multiple_known_length 0.243% -0.182% 0.795%
sampling sampling_single_unindexed_entities 0.228% 0.136% 0.325%
indexing query_people_indexed_multi-property_entities -0.183% -1.766% 1.284%
sampling sampling_multiple_l_reservoir_entities -0.147% -0.247% -0.047%
sampling count_and_sampling_single_known_length_entities 0.135% -0.825% 1.070%
sample_entity sample_entity_single_property_unindexed 100000 0.129% -0.105% 0.500%
sample_entity sample_entity_single_property_unindexed 1000 -0.125% -0.380% 0.235%
algorithm_benches algorithm_sampling_single_l_reservoir 0.116% -0.068% 0.328%
indexing with_query_results_multiple_individually_indexed_properties_enti 0.112% -0.129% 0.370%
indexing query_people_single_indexed_property_entities 0.100% -0.061% 0.254%
sample_entity sample_entity_whole_population 1000 0.072% -0.449% 0.615%
sampling sampling_single_unindexed_concrete_plus_derived_entities -0.064% -0.128% -0.017%
sampling sampling_multiple_unindexed_entities -0.058% -0.122% -0.007%
sampling count_and_sampling_single_unindexed_concrete_plus_derived_entiti 0.039% 0.019% 0.061%
indexing with_query_results_indexed_multi-property_entities -0.016% -0.919% 0.763%
counts single_property_unindexed_entities 0.009% -0.451% 0.487%
Not Compared (no baseline yet)
Group Bench Reason
(none)

github-actions Bot added a commit that referenced this pull request May 27, 2026
@github-actions
Copy link
Copy Markdown

Benchmark Results

Hyperfine

Command Mean [ms] Min [ms] Max [ms] Relative
large_sir::baseline 3.3 ± 0.1 3.2 3.5 1.00 ± 0.03
large_sir::baseline_households 3.3 ± 0.1 3.2 3.6 1.00
large_sir::entities 7.3 ± 0.1 7.1 7.8 2.23 ± 0.06
large_sir::households 7.1 ± 0.1 6.9 7.4 2.17 ± 0.05

Criterion

Regressions (slower)
Group Bench Param Change CI Lower CI Upper
algorithm_benches algorithm_sampling_single_known_length 12.831% 7.244% 18.588%
large_dataset bench_filter_indexed_entity 12.296% 3.099% 22.483%
indexing with_query_results_indexed_multi-property_entities 4.565% 4.069% 5.020%
sample_entity sample_entity_whole_population 100000 2.428% 1.875% 2.957%
large_dataset bench_query_population_derived_property_entities 2.171% 1.141% 3.336%
Improvements (faster)
Group Bench Param Change CI Lower CI Upper
sample_entity sample_entity_single_property_unindexed 10000 -13.939% -15.842% -11.939%
sample_entity sample_entity_single_property_indexed 100000 -10.828% -11.662% -10.006%
sample_entity sample_entity_single_property_indexed 10000 -10.480% -11.213% -9.757%
sample_entity sample_entity_single_property_indexed 1000 -10.122% -11.205% -9.179%
sample_entity sample_entity_multi_property_indexed 100000 -9.410% -10.080% -8.690%
sample_entity sample_entity_single_property_unindexed 1000 -7.371% -9.464% -5.278%
sample_entity sample_entity_multi_property_indexed 10000 -5.953% -6.466% -5.555%
sample_entity sample_entity_multi_property_indexed 1000 -5.895% -6.204% -5.597%
sample_entity sample_entity_whole_population 1000 -3.045% -3.660% -2.474%
sample_entity sample_entity_whole_population 10000 -2.743% -3.039% -2.456%
indexing with_query_results_multiple_individually_indexed_properties_enti -2.694% -2.908% -2.490%
sampling sampling_multiple_unindexed_entities -2.645% -2.836% -2.484%
sampling sampling_single_unindexed_entities -2.554% -2.730% -2.366%
counts reindex_after_adding_more_entities -2.536% -3.015% -2.065%
counts index_after_adding_entities -2.424% -2.737% -2.163%
indexing query_people_count_single_indexed_property_entities -2.197% -2.652% -1.764%
indexing with_query_results_single_indexed_property_entities -2.075% -2.461% -1.603%
sampling count_and_sampling_single_unindexed_concrete_plus_derived_entiti -1.293% -1.504% -1.082%
Unchanged / inconclusive (CI crosses 0%)
Group Bench Param Change CI Lower CI Upper
large_dataset bench_filter_unindexed_entity 4.772% 0.659% 8.935%
large_dataset bench_query_population_indexed_property_entities -2.879% -5.064% -0.651%
counts single_property_indexed_entities 2.760% 0.642% 4.912%
counts multi_property_indexed_entities -1.899% -3.242% -0.664%
counts concrete_plus_derived_unindexed_entities 1.448% 0.750% 2.211%
sampling count_and_sampling_single_known_length_entities -1.005% -1.483% -0.494%
examples example-basic-infection -1.002% -2.058% -0.219%
sampling sampling_multiple_known_length_entities -0.870% -1.347% -0.264%
large_dataset bench_match_entity 0.836% -0.321% 2.043%
examples example-births-deaths -0.817% -4.450% 8.192%
algorithm_benches algorithm_sampling_single_l_reservoir 0.738% 0.012% 1.912%
sampling sampling_multiple_l_reservoir_entities 0.729% 0.410% 0.965%
indexing query_people_multiple_individually_indexed_properties_entities -0.647% -0.746% -0.542%
indexing query_people_count_multiple_individually_indexed_properties_enti -0.612% -0.705% -0.522%
algorithm_benches algorithm_sampling_single_rand_reservoir -0.571% -1.509% 0.029%
counts single_property_unindexed_entities -0.490% -1.366% 0.141%
indexing query_people_count_indexed_multi-property_entities 0.464% 0.118% 0.772%
sampling sampling_single_known_length_entities 0.458% -0.190% 1.075%
large_dataset bench_query_population_multi_indexed_entities -0.386% -0.572% -0.187%
counts multi_property_unindexed_entities -0.290% -0.758% 0.072%
large_dataset bench_query_population_property_entities -0.280% -0.601% -0.008%
large_dataset bench_query_population_multi_unindexed_entities -0.221% -0.709% 0.285%
sample_entity sample_entity_single_property_unindexed 100000 0.184% -0.146% 0.474%
indexing query_people_single_indexed_property_entities 0.158% 0.078% 0.228%
algorithm_benches algorithm_sampling_multiple_known_length -0.140% -0.377% 0.099%
indexing query_people_indexed_multi-property_entities -0.110% -0.488% 0.182%
sampling sampling_single_l_reservoir_entities 0.097% -0.442% 0.597%
sampling sampling_single_unindexed_concrete_plus_derived_entities -0.059% -0.161% 0.043%
algorithm_benches algorithm_sampling_multiple_l_reservoir 0.015% -0.392% 0.513%
Not Compared (no baseline yet)
Group Bench Reason
(none)

github-actions Bot added a commit that referenced this pull request May 27, 2026
@github-actions
Copy link
Copy Markdown

Benchmark Results

Hyperfine

Command Mean [ms] Min [ms] Max [ms] Relative
large_sir::baseline 3.4 ± 0.1 3.4 3.6 1.00
large_sir::baseline_households 3.5 ± 0.2 3.4 4.7 1.02 ± 0.06
large_sir::entities 7.7 ± 0.1 7.6 8.2 2.25 ± 0.05
large_sir::households 7.6 ± 0.1 7.4 7.8 2.20 ± 0.04

Criterion

Regressions (slower)
Group Bench Param Change CI Lower CI Upper
indexing query_people_count_single_indexed_property_entities 9.634% 7.909% 11.430%
indexing query_people_indexed_multi-property_entities 6.541% 6.175% 6.966%
indexing query_people_multiple_individually_indexed_properties_entities 4.009% 3.795% 4.228%
sample_entity sample_entity_single_property_indexed 10000 3.905% 2.810% 5.066%
sample_entity sample_entity_multi_property_indexed 1000 3.518% 2.397% 4.727%
sampling sampling_multiple_unindexed_entities 2.385% 1.720% 2.968%
counts index_after_adding_entities 1.766% 1.233% 2.148%
counts reindex_after_adding_more_entities 1.735% 1.076% 2.226%
indexing with_query_results_multiple_individually_indexed_properties_enti 1.647% 1.151% 2.138%
Improvements (faster)
Group Bench Param Change CI Lower CI Upper
algorithm_benches algorithm_sampling_single_known_length -12.200% -16.850% -7.500%
sample_entity sample_entity_multi_property_indexed 100000 -6.503% -8.798% -4.267%
indexing query_people_count_multiple_individually_indexed_properties_enti -4.476% -4.640% -4.298%
large_dataset bench_query_population_multi_indexed_entities -4.104% -4.355% -3.876%
sample_entity sample_entity_single_property_indexed 1000 -3.840% -5.184% -2.547%
examples example-basic-infection -3.465% -4.320% -2.659%
sampling count_and_sampling_single_unindexed_concrete_plus_derived_entiti -3.008% -3.234% -2.788%
sampling count_and_sampling_single_known_length_entities -2.582% -3.348% -1.945%
indexing with_query_results_single_indexed_property_entities -1.952% -2.290% -1.653%
sampling sampling_single_unindexed_concrete_plus_derived_entities -1.445% -1.658% -1.248%
Unchanged / inconclusive (CI crosses 0%)
Group Bench Param Change CI Lower CI Upper
large_dataset bench_filter_indexed_entity 6.224% -1.218% 14.071%
large_dataset bench_filter_unindexed_entity 2.332% 0.005% 5.112%
sample_entity sample_entity_whole_population 10000 1.936% 0.942% 2.966%
sample_entity sample_entity_single_property_indexed 100000 1.814% 0.600% 3.153%
sample_entity sample_entity_multi_property_indexed 10000 1.495% 0.012% 2.986%
sampling sampling_single_unindexed_entities -1.457% -2.010% -0.916%
sampling sampling_single_l_reservoir_entities -1.221% -1.852% -0.566%
sampling sampling_single_known_length_entities -1.162% -1.943% -0.409%
sampling sampling_multiple_known_length_entities -1.065% -1.911% -0.267%
examples example-births-deaths 1.050% 0.443% 1.643%
counts concrete_plus_derived_unindexed_entities -0.918% -3.523% 0.733%
algorithm_benches algorithm_sampling_multiple_known_length -0.915% -1.385% -0.412%
sample_entity sample_entity_single_property_unindexed 100000 0.877% 0.140% 1.699%
sample_entity sample_entity_whole_population 100000 0.830% -0.025% 1.638%
algorithm_benches algorithm_sampling_single_rand_reservoir -0.761% -1.406% -0.160%
sample_entity sample_entity_single_property_unindexed 10000 0.684% 0.306% 1.160%
sampling sampling_multiple_l_reservoir_entities 0.615% 0.004% 1.265%
large_dataset bench_query_population_indexed_property_entities 0.523% 0.093% 1.055%
large_dataset bench_query_population_multi_unindexed_entities -0.505% -0.737% -0.271%
counts multi_property_unindexed_entities -0.408% -0.833% 0.124%
indexing with_query_results_indexed_multi-property_entities 0.355% 0.086% 0.578%
sample_entity sample_entity_single_property_unindexed 1000 -0.348% -0.624% 0.052%
large_dataset bench_query_population_derived_property_entities 0.278% -0.454% 1.062%
algorithm_benches algorithm_sampling_single_l_reservoir 0.245% -0.168% 0.670%
large_dataset bench_match_entity 0.214% -0.223% 0.899%
indexing query_people_count_indexed_multi-property_entities 0.150% -0.212% 0.574%
large_dataset bench_query_population_property_entities 0.122% -0.237% 0.756%
sample_entity sample_entity_whole_population 1000 -0.098% -0.912% 0.662%
indexing query_people_single_indexed_property_entities 0.097% -0.115% 0.377%
counts multi_property_indexed_entities 0.068% -0.385% 0.484%
counts single_property_unindexed_entities -0.038% -0.372% 0.265%
algorithm_benches algorithm_sampling_multiple_l_reservoir -0.016% -0.462% 0.412%
counts single_property_indexed_entities 0.015% -0.266% 0.335%
Not Compared (no baseline yet)
Group Bench Reason
(none)

github-actions Bot added a commit that referenced this pull request May 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add test coverage

3 participants