programmati.ca Open Studio

Gallery / How it works

LLM CI Failure Review Ledger

Keep a manual review log for LLM-assisted CI: record a failure, compare expected and observed output, and track your investigation through to resolution.

Try the appOpen in Studio
LLM CI Failure Review Ledger with illustrative sample records
Actual AppSPEC output with illustrative sample records. The app starts with your own local data.

Try this workflow

  1. Add a failure with its category and reviewer.
  2. Open the card to record expected output, observed output and review notes. Change its status as your investigation progresses.
  3. Use All items to review the log. This app records your findings; it does not run CI or diagnose failures automatically.

Records stay in this browser. Reset demo data clears this saved records for this app.

The AppSPEC

<?xml version="1.0" encoding="UTF-8"?>
<APP ID="llm-ci-failure-revie-76a6fbb9" NAME="LLM CI Failure Review Ledger" THEME="modern-minimal" WIDTH="1240px"><DATA MODE="local" /><STATE ID="board" NAV="Workspace" ICON="kanban"><ROW JUSTIFY="between"><COL GAP="2px"><TEXT STYLE="h1" TEXT="CI Failure Case board" /><TEXT STYLE="muted" TEXT="Manually verify and document specific failure modes of LLM CI integration to distinguish tooling errors from model hallucinations." /></COL><TOTAL SRC="c3651d2ca_prompt_casebook" WHERE="status=done" OP="count" LABEL="Done:" /></ROW><FORM SAVE="c3651d2ca_prompt_casebook" SET="status=todo" COLS="3" SUBMIT-LABEL="Add CI Failure Case"><FIELD NAME="title" LABEL="CI Failure Case" PLACEHOLDER="Describe the item" REQUIRED="true" /><FIELD NAME="category" LABEL="Failure Type" OPTIONS="Tooling Error,Model Hallucination,Valid Code Issue,Ambiguous" /><FIELD NAME="owner" LABEL="Reviewer" PLACEHOLDER="Optional" /></FORM><BOARD SRC="c3651d2ca_prompt_casebook" COLUMNS="todo:To do,doing:In progress,done:Done" SUBTITLE="{owner}" BADGE="category" OPEN="edit" /></STATE><STATE ID="edit" WIDTH="640px"><TEXT STYLE="h1" TEXT="Edit CI Failure Case" /><FORM UPDATE="c3651d2ca_prompt_casebook" TO="board" COLS="2" SUBMIT-LABEL="Save changes"><FIELD NAME="title" LABEL="CI Failure Case" REQUIRED="true" /><FIELD NAME="status" LABEL="Status" OPTIONS="todo:To do,doing:In progress,done:Done" /><FIELD NAME="category" LABEL="Failure Type" OPTIONS="Tooling Error,Model Hallucination,Valid Code Issue,Ambiguous" /><FIELD NAME="owner" LABEL="Reviewer" /><FIELD NAME="expected" LABEL="Expected output" TYPE="textarea" /><FIELD NAME="observed" LABEL="Observed output" TYPE="textarea" /><FIELD NAME="notes" LABEL="Review notes" TYPE="textarea" /></FORM><BUTTON STYLE="danger" ICON="trash-2" LABEL="Delete" ACTION="remove" /></STATE><STATE ID="list" NAV="All items" ICON="list"><TEXT STYLE="h1" TEXT="All CI Failure Cases" /><TABLE SRC="c3651d2ca_prompt_casebook" SORT="status" OPEN="edit" EMPTY="No items yet."><COL FIELD="title" LABEL="CI Failure Case" /><COL FIELD="status" LABEL="Status" TYPE="badge" /><COL FIELD="category" LABEL="Failure Type" /><COL FIELD="owner" LABEL="Reviewer" /></TABLE></STATE><WIRE LABEL="remove" DELETE="c3651d2ca_prompt_casebook" TO="board" /></APP>