Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: allow opting in to displaying benchmark comments #7399

Merged
merged 1 commit into from
Feb 14, 2025

Conversation

TomAFrench
Copy link
Member

@TomAFrench TomAFrench commented Feb 14, 2025

Description

Problem*

Resolves

Summary*

See #7388 (comment)

This PR allows printing of the benchmarks into the PR comments if the bench-show label is set.

Additional Context

Documentation*

Check one:

  • No documentation needed.
  • Documentation included in this PR.
  • [For Experimental Features] Documentation to be submitted in a separate PR.

PR Checklist*

  • I have tested the changes locally.
  • I have formatted the changes with Prettier and/or cargo fmt on default settings.

Sorry, something went wrong.

@TomAFrench TomAFrench added the bench-show Display benchmark results on PR label Feb 14, 2025
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Execution Time

Benchmark suite Current: d479f66 Previous: 30c4b2d Ratio
private-kernel-inner 0.069 s 0.068 s 1.01
private-kernel-reset 0.298 s 0.299 s 1.00
private-kernel-tail 0.017 s 0.017 s 1
rollup-base-private 0.462 s 0.462 s 1
rollup-base-public 0.185 s 0.186 s 0.99
rollup-block-merge 0.04 s 0.039 s 1.03
rollup-block-root 32.5 s 32.7 s 0.99
rollup-merge 0.006 s 0.006 s 1
rollup-root 0.039 s 0.04 s 0.97

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Compilation Time

Benchmark suite Current: d479f66 Previous: 30c4b2d Ratio
sha256_regression 0.975 s 1.16 s 0.84
regression_4709 0.771 s 0.797 s 0.97
ram_blowup_regression 20.7 s 20.9 s 0.99
global_var_regression_entry_points 0.629 s 0.643 s 0.98
private-kernel-inner 1.994 s 1.908 s 1.05
private-kernel-reset 6.428 s 6.252 s 1.03
private-kernel-tail 0.945 s 0.958 s 0.99
rollup-base-private 8.922 s 8.822 s 1.01
rollup-base-public 5.14 s 5.23 s 0.98
rollup-block-merge 1.488 s 1.478 s 1.01
rollup-block-root-empty 0.981 s 0.948 s 1.03
rollup-block-root-single-tx 67.7 s 68.7 s 0.99
rollup-block-root 68.6 s 65.7 s 1.04
rollup-merge 0.922 s 0.89 s 1.04
rollup-root 1.454 s 1.636 s 0.89

This comment was automatically generated by workflow using github-action-benchmark.

@TomAFrench TomAFrench requested a review from asterite February 14, 2025 19:25
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Execution Memory

Benchmark suite Current: d479f66 Previous: 30c4b2d Ratio
private-kernel-inner 211.79 MB 211.78 MB 1.00
private-kernel-reset 248.24 MB 248.24 MB 1
private-kernel-tail 183.41 MB 183.41 MB 1
rollup-base-private 468.76 MB 468.76 MB 1
rollup-base-public 407.5 MB 407.5 MB 1
rollup-block-merge 353.81 MB 353.81 MB 1
rollup-block-root 1040 MB 1040 MB 1
rollup-merge 346.4 MB 346.4 MB 1
rollup-root 353.79 MB 353.79 MB 1

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Compilation Memory

Benchmark suite Current: d479f66 Previous: 30c4b2d Ratio
private-kernel-inner 270.58 MB 270.58 MB 1
private-kernel-reset 585.8 MB 585.8 MB 1
private-kernel-tail 197.88 MB 197.87 MB 1.00
rollup-base-private 987.99 MB 987.99 MB 1
rollup-base-public 853.53 MB 853.57 MB 1.00
rollup-block-merge 409.68 MB 409.67 MB 1.00
rollup-block-root-empty 363.57 MB 363.57 MB 1
rollup-block-root-single-tx 5130 MB 5130 MB 1
rollup-block-root 5130 MB 5130 MB 1
rollup-merge 361.99 MB 361.99 MB 1
rollup-root 409.65 MB 409.65 MB 1

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Test Suite Duration

Benchmark suite Current: d479f66 Previous: 30c4b2d Ratio
AztecProtocol_aztec-packages_noir-projects_aztec-nr 41 s 40 s 1.02
AztecProtocol_aztec-packages_noir-projects_noir-contracts 66 s 64 s 1.03
AztecProtocol_aztec-packages_noir-projects_noir-protocol-circuits_crates_blob 50 s 48 s 1.04
AztecProtocol_aztec-packages_noir-projects_noir-protocol-circuits_crates_private-kernel-lib 153 s 153 s 1
AztecProtocol_aztec-packages_noir-projects_noir-protocol-circuits_crates_reset-kernel-lib 9 s 10 s 0.90
AztecProtocol_aztec-packages_noir-projects_noir-protocol-circuits_crates_rollup-lib 172 s 170 s 1.01
AztecProtocol_aztec-packages_noir-projects_noir-protocol-circuits_crates_types 48 s 50 s 0.96
noir-lang_noir-bignum_ 360 s 356 s 1.01
noir-lang_noir_bigcurve_ 262 s 265 s 0.99
noir-lang_noir_json_parser_ 12 s 12 s 1

This comment was automatically generated by workflow using github-action-benchmark.

@TomAFrench TomAFrench enabled auto-merge February 14, 2025 19:31
@TomAFrench TomAFrench added this pull request to the merge queue Feb 14, 2025
Merged via the queue into master with commit 5b509c5 Feb 14, 2025
105 checks passed
@TomAFrench TomAFrench deleted the tf/allow-showing-bench-results-on-prs branch February 14, 2025 19:43
TomAFrench added a commit that referenced this pull request Feb 14, 2025
…rom-brillig

* master:
  chore: allow opting in to displaying benchmark comments (#7399)
  chore: box `ExprValue` in `Value` enum (#7388)
  chore: pull out refactored methods from u128 branch (#7385)
  feat: require safety comments instead of safety doc comments (#7295)
  fix(ssa): Do not deduplicate division by a zero constant (#7393)
  chore: document traits required to be in scope (#7387)
  fix: field zero division in brillig (#7386)
  chore: box `ParserError`s in `InterpreterError` (#7373)
  chore: remove unnecessary dereferencing within brillig vm (#7375)
  fix: give "correct" error when trying to use AsTraitPath (#7360)
  chore: avoid u128s in brillig memory (#7363)
  chore: update docs about integer overflows (#7370)
  fix!: Only decrement the counter of an array if its address has not changed (#7297)
  fix: let LSP read `noirfmt.toml` for formatting files (#7355)
  chore: deprecate keccak256 (#7361)
  feat: `FunctionDefinition::as_typed_expr` (#7358)
  feat(performance): Check sub operations against induction variables (#7356)
  chore: avoid doing all brillig integer arithmetic on u128s (#7357)
TomAFrench added a commit that referenced this pull request Feb 14, 2025
* master:
  chore: allow opting in to displaying benchmark comments (#7399)
  chore: box `ExprValue` in `Value` enum (#7388)
  chore: pull out refactored methods from u128 branch (#7385)
  feat: require safety comments instead of safety doc comments (#7295)
  fix(ssa): Do not deduplicate division by a zero constant (#7393)
  chore: document traits required to be in scope (#7387)
  fix: field zero division in brillig (#7386)
  chore: box `ParserError`s in `InterpreterError` (#7373)
  chore: remove unnecessary dereferencing within brillig vm (#7375)
AztecBot pushed a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 15, 2025
chore: box `Closure` in `comptime::Value` enum (noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments (noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum (noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch (noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments (noir-lang/noir#7295)
AztecBot pushed a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 16, 2025
chore: box `Closure` in `comptime::Value` enum (noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments (noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum (noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch (noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments (noir-lang/noir#7295)
AztecBot pushed a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 16, 2025
chore: box `Closure` in `comptime::Value` enum (noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments (noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum (noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch (noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments (noir-lang/noir#7295)
AztecBot pushed a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 17, 2025
chore: box `Closure` in `comptime::Value` enum (noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments (noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum (noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch (noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments (noir-lang/noir#7295)
AztecBot pushed a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 17, 2025
chore: box `Closure` in `comptime::Value` enum (noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments (noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum (noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch (noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments (noir-lang/noir#7295)
TomAFrench added a commit to AztecProtocol/aztec-packages that referenced this pull request Feb 17, 2025

Verified

This commit was created on github.com and signed with GitHub’s verified signature.
Automated pull of development from the
[noir](https://github.com/noir-lang/noir) programming language, a
dependency of Aztec.
BEGIN_COMMIT_OVERRIDE
fix: format global attributes
(noir-lang/noir#7401)
chore: box `Closure` in `comptime::Value` enum
(noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments
(noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum
(noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch
(noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments
(noir-lang/noir#7295)
END_COMMIT_OVERRIDE

---------

Co-authored-by: Tom French <tom@tomfren.ch>
AztecBot added a commit to AztecProtocol/aztec-nr that referenced this pull request Feb 18, 2025
Automated pull of development from the
[noir](https://github.com/noir-lang/noir) programming language, a
dependency of Aztec.
BEGIN_COMMIT_OVERRIDE
fix: format global attributes
(noir-lang/noir#7401)
chore: box `Closure` in `comptime::Value` enum
(noir-lang/noir#7400)
chore: allow opting in to displaying benchmark comments
(noir-lang/noir#7399)
chore: box `ExprValue` in `Value` enum
(noir-lang/noir#7388)
chore: pull out refactored methods from u128 branch
(noir-lang/noir#7385)
feat: require safety comments instead of safety doc comments
(noir-lang/noir#7295)
END_COMMIT_OVERRIDE

---------

Co-authored-by: Tom French <tom@tomfren.ch>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bench-show Display benchmark results on PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants