Jev reordena 30 pasajes de CLERC después de BM25
Recuperación- Resultado
- Top-1 de 5% a 18%, top-10 de 38% a 62% en 40 consultas CLERC
Pregunta a Jev un Noul por cada par consulta-pasaje sobre si un candidato BM25 es el precedente citado.
Preguntas
Primitive
Noul
Evaluate how true something is
- Name
- is_cited_source
- Instrucciones
- The query excerpt comes from a US federal court opinion and was written immediately around a citation to a precedent; the citation itself has been removed. Could the candidate passage be from that cited precedent: does it establish the specific legal proposition the query excerpt invokes at its citation point?
- Criterios
- true
The candidate passage states or establishes the specific rule, standard, holding, or fact pattern that the query excerpt attributes to its removed citation.
- false
The candidate passage is merely on a similar topic or doctrine; it does not supply the specific proposition the query excerpt relies on.
- true