All pull requests

Pull requests

• fix(r_squared): implement the documented zero_division parameter

  #830·Sailaja-ASB opened Oct 13, 2026·

  ·
  1

• Fix evaluate-cli create failing on the default empty dataset_name

  #829·Virtuoso461 opened Oct 12, 2026·

  ·
  1

• Catch HfHubHTTPError in push_to_hub

  #828·li12345678990 opened Oct 12, 2026·

  ·
  1

• Use rouge-score-rs for ROUGE when it is installed

  #827·kholdrex opened Oct 11, 2026·

  ·

• Fix per-run arguments in EvaluationSuite

  #826·ktz03 opened Oct 10, 2026·

  ·
  1

• Fix exact_match false positives after normalization

  #823·MahendraMula opened Sep 23, 2026·

  ·
  1

• Add CLIPScore metric with RefCLIPScore and human correlation validation

  #818·vidi-deshp12 opened Sep 21, 2026·

  ·
  1

• Bump the actions group across 1 directory with 6 updates

  dependenciesgithub_actions
  #816·dependabot[bot] opened Sep 17, 2026Bot·

  ·

• docs: remove duplicate 'a' in poseval README

  #812·mrchatam opened Sep 13, 2026·1 task done·

  ·

• docs: fix 'allows to see' grammar in label_distribution README

  #811·mrchatam opened Sep 13, 2026·

  ·

• Fix simultaneous label remapping in mean_iou

  #810·feng1201 opened Sep 6, 2026·

  ·

• Recognize existing directories with dots when saving results

  #809·codewithfourtix opened Sep 5, 2026·

  ·

• Allow saving evaluation results when Git is not installed

  #808·codewithfourtix opened Sep 5, 2026·

  ·

• feat(perplexity): forward kwargs to from_pretrained

  #807·ShamikOfficial opened Sep 2, 2026·1 task done·

  ·
  1

• fix(bertscore): cap tokenizer max_length for transformers>=5

  #806·ShamikOfficial opened Sep 2, 2026·1 task done·

  ·
  1

• fix(mse): support sklearn versions without root_mean_squared_error

  #805·ShamikOfficial opened Sep 2, 2026·1 task done·

  ·
  1

• fix(r_squared): implement the documented zero_division parameter

  #804·hassaanch23 opened Aug 29, 2026·

  ·
  1

• fix(cuad): stop collapsing an undefined AUPR to a score of 0

  #802·promptsmith1990 opened Aug 24, 2026·

  ·
  1

• fix(perplexity): use all_special_tokens for GPT-2 tokenizer compatibility

  #789·akaashsa opened Aug 16, 2026·

  ·
  1

• Fix typo and document normalize values in confusion_matrix README

  #788·RudrenduPaul opened Aug 9, 2026·

  ·
  1

• Fix typo: IoUO -> IoU in types_of_evaluations.mdx

  #787·RudrenduPaul opened Aug 9, 2026·

  ·
  1

• Use per-dimension mean (axis=0) in mahalanobis metric

  #786·uttam12331 opened Aug 6, 2026·

  ·

• Add Expected Calibration Error (ECE) metric using netcal

  #785·itsfernn opened Jul 31, 2026·

  ·
  1

• Add financial_llm_faithfulness metric for regulated financial AI evaluation

  #783·priyanka25aug opened Jul 25, 2026·1 of 5 tasks·

  ·

• Add Retrieval-Conditioned Confidence Metric (RCCS) for RAG evaluation

  #782·AIMindCrafter opened Jul 13, 2026·

  ·