This is a test with a fictional subtitle snippet, run in TiinyOS using Qwen3.6-35B-A3B with reasoning on. It is not a test of video or transcription.
The line was short: “Is he keeping it?” I wrote a five-cue text subtitle snippet around it, with a red folder passed between characters, and tried two fresh TiinyOS chats. Both had the same character list and the same question about “he” and “it.” One chat received only that line. The other received the surrounding cues.
With only the question line, Tiiny left both references unresolved. The character list included pronouns, but that did not say who had the folder at that point in the conversation. Guessing a name from the list would have sounded plausible and answered the wrong question.
In the second chat, the earlier lines said Ada left a red folder with Noor, then Noor handed it to Ravi. Tiiny identified “he” as Ravi and “it” as the red folder, pointing back to the handoff in cue C3. That was the answer supported by this little script.
For my next subtitle lookup, I would include the handoff before the question. Cue C4 supplied the pronouns; cue C3 supplied the people and the folder that made the answer possible. This one pair of answers does not measure how often the model gets pronouns right.


No comments yet.