Jev Nouls watch Josh Rosen's Foreman factory for stuck, drift, and done
Classification- Result
- Jev only assesses; a Python policy then continues, verifies, retries, finishes, or escalates
Ask Jev nine Nouls in one call on whether the factory job is complete, tested, on track, and ready to finish.
Questions
Primitive
Noul
Evaluate how true something is
- Name
- implementation_complete
- Instructions
- Is the implementation work required by the original job complete?
Primitive
Noul
Evaluate how true something is
- Name
- tests_sufficient
- Instructions
- Does the work have sufficient relevant test coverage and passing verification?
Primitive
Noul
Evaluate how true something is
- Name
- requirements_satisfied
- Instructions
- Does the current repository satisfy the original free-form job as a whole?
Primitive
Noul
Evaluate how true something is
- Name
- needs_verification
- Instructions
- Does the current state warrant an independent verification pass before finishing?
Primitive
Noul
Evaluate how true something is
- Name
- meaningful_progress
- Instructions
- Is the active or most recent worker making meaningful progress toward the job?
Primitive
Noul
Evaluate how true something is
- Name
- worker_stuck
- Instructions
- Does the active or most recent worker appear stuck, looping, or unable to advance?
Primitive
Noul
Evaluate how true something is
- Name
- work_off_track
- Instructions
- Is the current work drifting from the original job or making unrelated changes?
Primitive
Noul
Evaluate how true something is
- Name
- ready_to_finish
- Instructions
- Given all evidence, is the factory job ready to be declared complete?
Primitive
Noul
Evaluate how true something is
- Name
- needs_human
- Instructions
- Does this situation require human judgment, credentials, clarification, or permission?