Jev 在 BM25 之後重排 30 個 CLERC 段落
檢索- 結果
- 40 個 CLERC 查詢上 top-1 從 5% 到 18%，top-10 從 38% 到 62%
對每個查詢與段落配對問 Jev 一題 Noul：這個 BM25 候選是否為被引用的先例。
問題
Primitive
Noul
Evaluate how true something is
- Name
- is_cited_source
- 指示
- The query excerpt comes from a US federal court opinion and was written immediately around a citation to a precedent; the citation itself has been removed. Could the candidate passage be from that cited precedent: does it establish the specific legal proposition the query excerpt invokes at its citation point?
- 準則
- true
The candidate passage states or establishes the specific rule, standard, holding, or fact pattern that the query excerpt attributes to its removed citation.
- false
The candidate passage is merely on a similar topic or doctrine; it does not supply the specific proposition the query excerpt relies on.
- true