Run-level evidence

deepseek-v3.2

Scenario: Duplicate guard: Does it check before it writes?

Showing 12 of 12 graded runs published for this cell.

Last updated July 16, 2026 · Back to the scenario · Model profile · Raw JSONL · Methodology

Model outputs below are shown exactly as produced (English): they are evidence, not translated.

  1. Pass #1 Latency: 33.6s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

  2. Pass #2 Latency: 19.4s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

  3. Pass #3 Latency: 25.4s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

  4. Pass #4 Latency: 15.9s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

  5. Pass #5 Latency: 19.4s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

  6. Pass #6 Latency: 21.0s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

  7. Pass #7 Latency: 20.4s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

  8. Pass #8 Latency: 15.4s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

  9. Pass #9 Latency: 18.4s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

  10. Pass #10 Latency: 29.9s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

  11. Pass #11 Latency: 19.9s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

  12. Pass #12 Latency: 20.4s

    Tool calls

    No tool calls.

    Odoo read-back

    [
  {
    "id": 900,
    "move_type": "in_invoice",
    "partner_id": 501,
    "ref": "R0012345678",
    "invoice_date": "2026-06-30",
    "amount_total": 47.6,
    "state": "posted"
  }
]

    Final message (verbatim)

    Eval-v1 Hetzner Invoice couldn't respond
Retry

⚠️ Agent couldn't generate a response. Please try again. (model: ollama-cloud/deepseek-v3.2)

    Grade

    Pass · no failure tags

Keep reading

Related

Duplicate guard: Does it check before it writes?

The invoice is already in the ERP, filed and posted, before the agent starts.

deepseek-v3.2: Model profile

Every published run behind this cell: the tool calls the model made, the message it returned, what actually landed in Odoo, and the grade.

Methodology

State-based grading, the failure taxonomy, and how to reproduce every number.

raw trajectories on GitHub

Ready to Get Started?

Self-host Pinchy yourself in minutes, or book a call to talk it through. Your choice.

Book a Call → Self-host it free →

Or email us: info@heypinchy.com