Jev가 BM25 뒤에 CLERC의 구절 30개를 다시 줄 세웁니다
검색- 결과
- CLERC 질의 40개에서 top-1은 5%에서 18%, top-10은 38%에서 62%
각 질의와 구절 쌍에서, BM25 후보가 인용 선례인지의 Noul을 하나 묻습니다.
질문
Primitive
Noul
Evaluate how true something is
- Name
- is_cited_source
- 지시
- The query excerpt comes from a US federal court opinion and was written immediately around a citation to a precedent; the citation itself has been removed. Could the candidate passage be from that cited precedent: does it establish the specific legal proposition the query excerpt invokes at its citation point?
- 기준
- true
The candidate passage states or establishes the specific rule, standard, holding, or fact pattern that the query excerpt attributes to its removed citation.
- false
The candidate passage is merely on a similar topic or doctrine; it does not supply the specific proposition the query excerpt relies on.
- true