AI Dad
All records

Genspark · yt transcript

Grade 2 · stopped at Detects

It answers "success" for videos that do not exist. The body does say there is no transcript, but the status field and the exit code both report success.

Fed it two video IDs that do not exist, to see whether it reports the failure

  1. Runs
  2. Records
  3. Detects
  4. Precise
  5. Proven

0 / 2bad inputs where the status signalled failure

both runs reported success

What failed Both runs returned status=ok, message=success, exit code 0. Where the transcript should be, there is a 23-character line: "No transcript available". Anything that trusts the status and passes that string along will treat it as a transcript — which is exactly what happened to one video in our 100-video run, caught only by reading the output.

How we measured One nonexistent ID (zzzzzzzzzzz) and one malformed ID (not-a-real-id-xxxxx), checking the exit code, status, message, and body separately.

Not measured This test says nothing about whether transcripts of real videos are accurate (the Precise and Proven rungs).

2026-09-09 · gsk CLI, as of 2026-09-09

Rung by rung

  1. Runs

    Passed

    It runs. Install it, run it, something comes out.

  2. Records

    Passed

    It leaves a trace you can check later.

  3. Detects

    Stopped here

    It says when something is wrong instead of passing silently.

  4. Precise

    Not measured

    Same input, same answer. It does not drift.

  5. Proven

    Not measured

    Verified on the real thing — output seen with our own eyes.

How to read this

This result came from the task named above, on the date named above, against the version named above. A different task gives a different result. "Not measured" means we have not checked it — not that the tool cannot do it.