❤️
Instruct Opus to minimize differences between agentic implementation and known good implementation without causing more than a 5% speed regression on any benchmarks
。关于这个话题，夫子提供了深入分析
I used z3 theorem prover to assess LLM output, which is a pretty decent SAT solver. I considered the LLM output successful if it determines the formula is SAT or UNSAT correctly, and for SAT case it needs to provide a valid assignment. Testing the assignment is easy, given an assignment you can add a single variable clause to the formula. If the resulting formula is still SAT, that means the assignment is valid otherwise it means that the assignment contradicts with the formula, and it is invalid.
第一百二十一条 被处罚人、被侵害人对公安机关依照本法规定作出的治安管理处罚决定，作出的收缴、追缴决定，或者采取的有关限制性、禁止性措施等不服的，可以依法申请行政复议或者提起行政诉讼。