Skip to content

How to generate Critic Scores that can mimic a reward model #55

Open
Open
How to generate Critic Scores that can mimic a reward model#55

Description

@AhmedKhaled945
AhmedKhaled945
opened on Sep 20, 2023

Hello, hope all is well,

Wanted to ask how to generate critic scores for a solution of a code problem, is there a way instead of just classifying them using the critic model?

Activity

  1. AhmedKhaled945
    changed the title [-]Cannot generate Critic Scores[/-] [+]How to generate Critic Scores that can mimic a reward model[/+] on Sep 20, 2023

  2. YTJY commented on Dec 10, 2024

    @YTJY
    YTJY
    on Dec 10, 2024

    Hello, I don't know if you solved this problem, I'm also experiencing this problem now, can you give me some advice

  3. YTJY commented on Dec 10, 2024

    @YTJY
    YTJY
    on Dec 10, 2024

    When I used the critic model to score the generated code, I found that the effect was very poor, I don't know if I made a mistake, I wonder if you have ever encountered this situation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions