Skip to content

Help reviewers with validating tests #7128

Open

Description

@marco-c

To help reviewers validate tests associated with patches, the agent could do things like:

  • check the tests fail (or don't make sense) before the patch;
  • mutate the code, check the tests fail;
  • given the bug description, generate potential breakages of an implementation (without showing the diff, so it's black-box), ask to verify if the tests cover them.

Activity

  1. suhaibmujahid commented on Oct 13, 2026

    @suhaibmujahid
    Member

    We could create a dedicated hackbot agent for this purpose.

  2. marco-c commented on Oct 13, 2026

    @marco-c
    CollaboratorAuthor

    I was thinking it would be part of the review agent, as an additional step of the review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Fields

    Priority

    None yet

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions