This repository was archived by the owner on Apr 11, 2023. It is now read-only.
Repository navigation
This repository was archived by the owner on Apr 11, 2023. It is now read-only.
NDCG computation #233
Description
Hi there! In the function corresponding to NDCG calculation I noticed that ignore_rank_of_non_annotated_urls flag is present.
CodeSearchNet/src/relevanceeval.py
Line 76 in 76a006f
The question is: are your results in the paper calculated with ignore_rank_of_non_annotated_urls=True?
Activity
Alex-HaochenLi commentedon Sep 10, 2022
Both are reported.
In Table 4, NDCG-Within for True, NDCG-All for False.