Description du poste
TL;DR: A fixed procedure can force the language model to consider the opposing view, but it doesn't guarantee that it will calculate. In a test where a 3-step calculation was spread across 3 sources a general-purpose agent didn't do the calculation at all. I think the issue isn't with the multiplication per se, it's with working out which numbers you're meant to multiply. Therefore, I suggest removing this choice from the model: the code should try all multiplication and division sequences whose units end in a decision unit, compare the results to the thresholds, and have "no discovery" as the default.
Epistemic status: The full design hasn't been built yet. What exists is just a small prototype of the enumeration step, which I tested on a single test case, and the code is attached. However, it is based on evidence that structured methodologies improve judgment accuracy. In geopolitical forecasting competitions, a training session in structured thinking lasting less than an hour increased the accuracy of predictions by 6% to 11% compared to the control group (Chang et al., 2016). I launched a Manifund campaign to finance this work myself.
ContextSijal is an AI reasoning engine for institutional decisions. The outcome of the Sijal exercise, conducted around controversial decisions, is a sealed decision document, structured in accordance with the Toulmin model and ICD 203, that summarizes the exercise's different phases and results. In Sijal each judge rules individually and one of the participants must defend tenaciously the opposite position. Through structured discussion Sijal emulates institutional reasoning.
Sijal actually works, and when the voting was restarted on more than 30 controversial questions, some of which were posed in Arabic and English, the same rulings came out.
However, the document records what everyone said, but it doesn't extract the one crucial point that the session proved but no one else mentioned. This article is about that step.
The Case o