Jev が BM25 のあと CLERC の 30 箇所を並べ直す
検索- 結果
- 40 の CLERC クエリで top-1 は 5% から 18%、top-10 は 38% から 62%
各クエリと箇所の対で、BM25 候補が引用先例かの Noul を一つ聞く。
質問
プリミティブ
Noul
Evaluate how true something is
- Name
- is_cited_source
- 指示
- The query excerpt comes from a US federal court opinion and was written immediately around a citation to a precedent; the citation itself has been removed. Could the candidate passage be from that cited precedent: does it establish the specific legal proposition the query excerpt invokes at its citation point?
- 基準
- true
The candidate passage states or establishes the specific rule, standard, holding, or fact pattern that the query excerpt attributes to its removed citation.
- false
The candidate passage is merely on a similar topic or doctrine; it does not supply the specific proposition the query excerpt relies on.
- true