Skip to content

Intent: Grok Build + Grok 4.6 - #46

Open
Syed-Umair wants to merge 1 commit into
devrev:mainfrom
Syed-Umair:intent/grok-build-grok-4.6
Open

Syed-Umair wants to merge 1 commit into
devrev:mainfrom
Syed-Umair:intent/grok-build-grok-4.6

Conversation

@Syed-Umair

@Syed-Umair Syed-Umair commented Sep 4, 2026 •

Copy link
Copy Markdown

Intent: put this Grok Build + Grok 4.6 on the leaderboard

Your name / handle: Syed-Umair

Harness

Model

  • LLM you want evaluated: Grok 4.6 (grok-4.6)
  • Access: xAI API (XAI_API_KEY)

Why this combination

Grok Build already has a published Grok 4.5 result (74.3%, 140 trials). Grok 4.6 is the current default Grok Build model and has no Enterprise-Bench data point yet. This Intent requests the within-harness successor run.

What you'd like help with

  • Setting up the harness to run against Enterprise-Bench
  • Model / gateway access
  • Interpreting or submitting results
  • Nothing — I just want it on the roadmap

Checklist

  • I added a single entry under intents/ (no benchmark run required to open this PR)
  • I'm open to the maintainers reaching out to help with setup

Notes

This is an Intent submission only. It requests a reproducible benchmark run; it does not claim completed results.

Request a reproducible Enterprise-Bench run of Harbor's grok-build
agent with model grok-4.6. This is an Intent submission only; it
does not claim completed results.
@nimit2801

Copy link
Copy Markdown
Collaborator

Thanks for submitting this Enterprise-Bench intent. This is an intent-only change for Grok Build + Grok 4.6, not an approval.

We will verify:

  • the intent metadata and requested harness/model pairing
  • Harbor compatibility and required xAI API access
  • reviewer assignment and roadmap priority

@nimit2801

Copy link
Copy Markdown
Collaborator

✅ Valid Intent PR. Correctly adds a single intents/ entry naming a harness + model with a clear rationale, no benchmark run required. This is a valid contribution to the challenge — thanks! A maintainer will follow up on setup.

@nimit2801

Copy link
Copy Markdown
Collaborator

Hi @Syed-Umair, are you still interested in completing an Enterprise-Bench leaderboard submission? Please comment here with your harness + model, rough timeline, and any blockers.

We can help arrange OpenAI or other provider credits for your run. Join the DevRev Community Slack to discuss access and setup:
https://join.slack.com/t/devrevcommunity/shared_invite/zt-48e43dryc-pozw0jab6Qsir_ChGPXwWg

Please reply by Wednesday, September 30, 2026, at 4:55 AM IST (September 29 at 23:25 UTC). You do not need to complete the run by then, just confirm your interest. Without a response on this PR, we will close it as inactive. You are welcome to return with a fresh submission when you are ready.

@nimit2801

Copy link
Copy Markdown
Collaborator

Quick check-in: are you continuing this contribution?

@Syed-Umair, please comment here with your harness + model, rough timeline, and any blockers.

We can help arrange OpenAI or other provider credits for your run. Join the DevRev Community Slack to discuss access and setup:
https://join.slack.com/t/devrevcommunity/shared_invite/zt-48e43dryc-pozw0jab6Qsir_ChGPXwWg

Please reply by Wednesday, September 30, 2026, at 4:55 AM IST (September 29 at 23:25 UTC). You do not need to complete the run by then, just confirm your interest. Without a response on this PR, we will close it as inactive. You are welcome to return with a fresh submission when you are ready.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants