Skip to content

bench: publish ProveKit V1 benchmark results #483

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
dcbuild3r wants to merge 26 commits into
base: v1
Choose a base branch
from
Open

bench: publish ProveKit V1 benchmark results #483

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
63f0a3a
bench: scaffold reproducible v1 benchmark suite
dcbuild3r Jul 23, 2026
b832197
bench: add passport and multi-workload v1 lanes
dcbuild3r Jul 23, 2026
a180905
bench: uncap Android Rayon proving
dcbuild3r Jul 23, 2026
265a223
bench: upgrade mobench and add wasm matrix
dcbuild3r Jul 23, 2026
e39af5a
bench: reuse checked-in WebAuthn input without Bun
dcbuild3r Jul 23, 2026
1304453
bench: fetch pinned WebAuthn vendor sources
dcbuild3r Jul 23, 2026
7de99e9
bench: publish cross-device campaign
dcbuild3r Jul 31, 2026
092621d
bench: publish ProveKit V1 semantic parity results
dcbuild3r Jul 31, 2026
b2295b8
bench: add cold and warm Passport P1 campaign
dcbuild3r Aug 8, 2026
39768de
bench: batch cold iPhone process samples
dcbuild3r Aug 8, 2026
f602d51
bench: publish input-to-proof campaign as canonical dataset
dcbuild3r Aug 11, 2026
05a617f
benchmarks: add multithreaded wasm input-to-proof campaign
dcbuild3r Aug 12, 2026
9ef839a
benchmarks: clean v1 campaign around canonical input-to-proof data
dcbuild3r Aug 14, 2026
a91168e
benchmarks: leave analysis directory for publication notebook
dcbuild3r Aug 14, 2026
bad71df
Move passport P1 canonical record under Noir
dcbuild3r Aug 14, 2026
8d17bb4
Group Rapidsnark mobile crates
dcbuild3r Aug 14, 2026
a697cf4
Organize benchmark support files
dcbuild3r Aug 14, 2026
46ab267
Consolidate native data helpers
dcbuild3r Aug 14, 2026
38a903a
Polish V1 benchmark documentation
dcbuild3r Aug 14, 2026
4c22fca
benchmarks: replace native OPRF Circom rows with TACEO 0.2.1
dcbuild3r Aug 14, 2026
5220fd0
benchmarks: allow single-ABI TACEO E15 evidence
dcbuild3r Aug 14, 2026
215641e
benchmarks: refresh TACEO OPRF canonical rows
dcbuild3r Aug 14, 2026
b8c7dcc
benchmarks: rerun TACEO OPRF on E15
dcbuild3r Aug 14, 2026
a507544
bench: pin v1 mobile benchmarks to Mobench 0.2.0
dcbuild3r Aug 28, 2026
a91a918
bench: remove unrelated examples from v1 benchmark diff
dcbuild3r Aug 28, 2026
420e99b
Revert "bench: pin v1 mobile benchmarks to Mobench 0.2.0"
dcbuild3r Aug 28, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
28 changes: 15 additions & 13 deletions .github/workflows/mobile-bench-pr-command.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -72,11 +72,11 @@ jobs:
*) echo "::warning::Invalid device_profile '${device_profile}', defaulting to 'triad'"; device_profile="triad" ;;
esac

if ! [[ "${iterations:-2}" =~ ^[0-9]+$ ]]; then
echo "::warning::Invalid iterations '${iterations}', defaulting to '2'"
iterations="2"
if ! [[ "${iterations:-5}" =~ ^[0-9]+$ ]]; then
echo "::warning::Invalid iterations '${iterations}', defaulting to '5'"
iterations="5"
else
iterations="${iterations:-2}"
iterations="${iterations:-5}"
fi

if ! [[ "${warmup:-1}" =~ ^[0-9]+$ ]]; then
Expand All @@ -86,10 +86,12 @@ jobs:
warmup="${warmup:-1}"
fi

echo "platform=${platform}" >> "$GITHUB_OUTPUT"
echo "device_profile=${device_profile}" >> "$GITHUB_OUTPUT"
echo "iterations=${iterations}" >> "$GITHUB_OUTPUT"
echo "warmup=${warmup}" >> "$GITHUB_OUTPUT"
{
echo "platform=${platform}"
echo "device_profile=${device_profile}"
echo "iterations=${iterations}"
echo "warmup=${warmup}"
} >> "$GITHUB_OUTPUT"

- name: Resolve PR refs
if: steps.trust.outputs.trusted == 'true'
Expand Down Expand Up @@ -142,23 +144,23 @@ jobs:
checks: write
contents: read
pull-requests: write
uses: worldcoin/mobile-bench-rs/.github/workflows/reusable-bench.yml@8a2dfbb2ba941aa6a6582bf49dae482cc87779df
uses: worldcoin/mobile-bench-rs/.github/workflows/reusable-bench.yml@ec5848752760cf2edd4d7f8c7c1e329bd668cf95
secrets:
BROWSERSTACK_USERNAME: ${{ secrets.BROWSERSTACK_USERNAME }}
BROWSERSTACK_ACCESS_KEY: ${{ secrets.BROWSERSTACK_ACCESS_KEY }}
with:
crate_path: ./bench-mobile
functions: '["bench_mobile::bench_passport_complete_age_check_prove","bench_mobile::bench_passport_fragmented_age_check_prove","bench_mobile::bench_oprf_prove"]'
functions_ios: '["bench_mobile::bench_passport_complete_age_check_prove","bench_mobile::bench_passport_fragmented_age_check_prove","bench_mobile::bench_oprf_prove"]'
functions_android: '["bench_mobile::bench_passport_fragmented_age_check_prove","bench_mobile::bench_oprf_prove","bench_mobile::bench_passport_complete_age_check_prove"]'
functions: '["bench_mobile::bench_passport_complete_age_check_prepare","bench_mobile::bench_passport_complete_age_check_prove","bench_mobile::bench_passport_complete_age_check_verify","bench_mobile::bench_passport_complete_age_check_e2e","bench_mobile::bench_passport_fragmented_age_check_prepare","bench_mobile::bench_passport_fragmented_age_check_prove","bench_mobile::bench_webauthn_assertion_prepare","bench_mobile::bench_webauthn_assertion_prove","bench_mobile::bench_webauthn_assertion_verify","bench_mobile::bench_webauthn_assertion_e2e","bench_mobile::bench_oprf_prepare","bench_mobile::bench_oprf_prove","bench_mobile::bench_oprf_verify","bench_mobile::bench_oprf_e2e"]'
functions_ios: '["bench_mobile::bench_passport_complete_age_check_prepare","bench_mobile::bench_passport_complete_age_check_prove","bench_mobile::bench_passport_complete_age_check_verify","bench_mobile::bench_passport_complete_age_check_e2e","bench_mobile::bench_passport_fragmented_age_check_prepare","bench_mobile::bench_passport_fragmented_age_check_prove","bench_mobile::bench_webauthn_assertion_prepare","bench_mobile::bench_webauthn_assertion_prove","bench_mobile::bench_webauthn_assertion_verify","bench_mobile::bench_webauthn_assertion_e2e","bench_mobile::bench_oprf_prepare","bench_mobile::bench_oprf_prove","bench_mobile::bench_oprf_verify","bench_mobile::bench_oprf_e2e"]'
functions_android: '["bench_mobile::bench_passport_complete_age_check_prepare","bench_mobile::bench_passport_complete_age_check_prove","bench_mobile::bench_passport_complete_age_check_verify","bench_mobile::bench_passport_complete_age_check_e2e","bench_mobile::bench_passport_fragmented_age_check_prepare","bench_mobile::bench_passport_fragmented_age_check_prove","bench_mobile::bench_webauthn_assertion_prepare","bench_mobile::bench_webauthn_assertion_prove","bench_mobile::bench_webauthn_assertion_verify","bench_mobile::bench_webauthn_assertion_e2e","bench_mobile::bench_oprf_prepare","bench_mobile::bench_oprf_prove","bench_mobile::bench_oprf_verify","bench_mobile::bench_oprf_e2e"]'
platform: ${{ needs.resolve.outputs.platform }}
prepare_script: bench-mobile/scripts/generate-fixtures.sh
device_profile: custom
ios_devices: ${{ needs.resolve-device-matrices.outputs.ios_devices }}
android_devices: ${{ needs.resolve-device-matrices.outputs.android_devices }}
iterations: ${{ needs.resolve.outputs.iterations }}
warmup: ${{ needs.resolve.outputs.warmup }}
mobench_version: "0.1.47"
mobench_version: "0.1.48"
max_completion_timeout_secs: 7200
rust_toolchain: nightly-2026-03-04
ffi_backend: native-c-abi
Expand Down
Loading
Loading