{
  "title": "ChatGPT and one IELTS Speaking Part 2 answer: 20 scoring runs",
  "provenance": "Original constructed PrepEx editorial test answer; not a learner's response, an official or recalled question, or an examiner-rated performance. This record shows how consistent ChatGPT's estimates were, not how accurate they were.",
  "recorded_on": "2026-10-14",
  "recorded_between_utc": "11:27-11:47",
  "setup": {
    "service": "ChatGPT web app",
    "model": "Default model; the interface did not name it",
    "mode": "A new Temporary Chat for each run, set to Unpersonalized (ignores memory, plugins and custom instructions); Think left off",
    "order": "Spoken and cleaned versions alternated, starting with the spoken version",
    "prompt_template": "I'm preparing for the IELTS Speaking test. Here is a transcript of my recorded answer to a Part 2 task card.\n\nTask card: Describe a time you helped someone you did not know. You should say: who the person was, where you were, what you did, and explain how you felt afterwards.\n\nMy answer:\n{answer}\n\nPlease give me a band score for each criterion (fluency and coherence, lexical resource, grammatical range and accuracy, pronunciation) and my overall band score."
  },
  "cue_card": "Describe a time you helped someone you did not know. You should say: who the person was, where you were, what you did, and explain how you felt afterwards.",
  "answers": {
    "spoken": {
      "words": 243,
      "text": "Um, okay, so I'm going to talk about a time when I helped a woman I didn't know. It was, uh, last winter at the train station in my city. I was waiting for my train to university and I saw a old lady who looked very confused, and she had two big bags. So I, um, I went to her and asked if she need some help. She told me she want to go to her daughter's house, but her phone was dead, so she cannot check the address, and she also didn't know which platform she should go. Uh, so first I helped her with the address. She remembered the name of the street, so I searched it on my phone and, you know, I found the right train for her. Then I carried one of her bags and we walked together to the platform, and I waited with her until the train come. Actually I was a little bit late for my class that day, but I didn't mind. How I felt afterwards... um, I felt really happy and useful, because in my opinion helping other people is very important, especially old people who are not familiar with technology. She said thank you many times and she gave me a, uh, a chocolate. So it was a small thing, but it made my day, and since then I always try to help people when I see they are in trouble.",
      "description": "Transcript as spoken, with filled pauses (um, uh), 'you know' and two restarts"
    },
    "cleaned": {
      "words": 233,
      "text": "Okay, so I'm going to talk about a time when I helped a woman I didn't know. It was last winter at the train station in my city. I was waiting for my train to university and I saw a old lady who looked very confused, and she had two big bags. So I went to her and asked if she need some help. She told me she want to go to her daughter's house, but her phone was dead, so she cannot check the address, and she also didn't know which platform she should go. So first I helped her with the address. She remembered the name of the street, so I searched it on my phone and I found the right train for her. Then I carried one of her bags and we walked together to the platform, and I waited with her until the train come. Actually I was a little bit late for my class that day, but I didn't mind. How I felt afterwards, I felt really happy and useful, because in my opinion helping other people is very important, especially old people who are not familiar with technology. She said thank you many times and she gave me a chocolate. So it was a small thing, but it made my day, and since then I always try to help people when I see they are in trouble.",
      "description": "The same words with only the filled pauses, 'you know' and restarts removed, as many speech-to-text tools produce; grammar errors kept"
    }
  },
  "runs": [
    {
      "run": 1,
      "answer": "spoken",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be reliably assessed from a written transcript)",
      "overall": "6.0-6.5 (provisional, assuming pronunciation around 6)",
      "notes": "Opening line: Band 6.0-6.5; said scores are estimates, not official"
    },
    {
      "run": 2,
      "answer": "cleaned",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be assessed from a written transcript)",
      "overall": "6.0 (provisional)",
      "notes": "Opening line: Band 6.0 with potential to reach 6.5"
    },
    {
      "run": 3,
      "answer": "spoken",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5-6.0",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be assessed reliably from a written transcript)",
      "overall": "6.0-6.5 (provisional, assuming pronunciation generally clear)",
      "notes": "Opening line: Band 6.0-6.5, 6.5 reasonable if pronunciation clear"
    },
    {
      "run": 4,
      "answer": "cleaned",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.5",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "6.0",
      "pronunciation_note": "6.0 (provisional estimate only)",
      "overall": "6.0",
      "notes": "Opening line: Band 6.0-6.5; gave a pronunciation band from text, labelled provisional; said pronunciation and delivery cannot be assessed from text"
    },
    {
      "run": 5,
      "answer": "spoken",
      "fluency_and_coherence": "6.0",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "6.0",
      "pronunciation_note": "6.0* (illustrative estimate; said it cannot be assessed accurately from a transcript)",
      "overall": "6.0 (provisional)",
      "notes": "Opening line: around Band 6.0 overall"
    },
    {
      "run": 6,
      "answer": "cleaned",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be reliably assessed from a written transcript)",
      "overall": "6.0-6.5 (provisional)",
      "notes": "Opening line: Band 6.0-6.5"
    },
    {
      "run": 7,
      "answer": "spoken",
      "fluency_and_coherence": "6.0",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "Not assessable (a transcript cannot show pronunciation)",
      "overall": "6.0-6.5 (likely 6.0, provisional)",
      "notes": "Opening line: Band 6.0-6.5, likely 6.0 if delivery matches the hesitations"
    },
    {
      "run": 8,
      "answer": "cleaned",
      "fluency_and_coherence": "7.0",
      "lexical_resource": "6.5",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "Not assessed (cannot be reliably assessed from a written transcript)",
      "overall": "6.0-6.5 (provisional, assuming reasonably clear pronunciation)",
      "notes": "Opening line: Band 6.0-6.5"
    },
    {
      "run": 9,
      "answer": "spoken",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be accurately assessed without audio)",
      "overall": "6.0 (provisional)",
      "notes": "Opening line: Band 6.0-6.5, overall estimated 6.0"
    },
    {
      "run": 10,
      "answer": "cleaned",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be assessed accurately from text alone)",
      "overall": "6.0 (assuming pronunciation around 6.0)",
      "notes": "Opening line: 6.0-6.5"
    },
    {
      "run": 11,
      "answer": "spoken",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be reliably assessed without audio)",
      "overall": "6.0 (provisional)",
      "notes": "Opening line: Band 6.0-6.5, overall estimated 6.0"
    },
    {
      "run": 12,
      "answer": "cleaned",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (audio required for a reliable assessment)",
      "overall": "6.0 (assuming pronunciation around 6)",
      "notes": "Opening line: around Band 6.0-6.5"
    },
    {
      "run": 13,
      "answer": "spoken",
      "fluency_and_coherence": "6.0",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.0",
      "pronunciation": "6.0",
      "pronunciation_note": "6.0* (provisional only; audio needed; not directly assessable from a transcript)",
      "overall": "6.0 (potential 6.5)",
      "notes": "Opening line: around Band 6.0 overall"
    },
    {
      "run": 14,
      "answer": "cleaned",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "Not assessable",
      "overall": "6.0 (assuming pronunciation around 6.0)",
      "notes": "Opening line: Band 6.0, potential 6.5"
    },
    {
      "run": 15,
      "answer": "spoken",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be assessed accurately from a transcript)",
      "overall": "6.0-6.5 in the table (assuming pronunciation 6-7); opening line said Band 6.5",
      "notes": "Headline and table disagreed within one reply"
    },
    {
      "run": 16,
      "answer": "cleaned",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "6.0",
      "pronunciation_note": "6.0* (illustrative estimate; said it cannot be assessed accurately from a transcript)",
      "overall": "6.0 (provisional)",
      "notes": "Opening line: Band 6.0-6.5, likely 6.0"
    },
    {
      "run": 17,
      "answer": "spoken",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.5",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be judged accurately from a transcript)",
      "overall": "6.0-6.5 in the table; opening line said around Band 6.5",
      "notes": "Headline and table disagreed within one reply"
    },
    {
      "run": 18,
      "answer": "cleaned",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be reliably assessed from the written transcript)",
      "overall": "6.0 (provisional)",
      "notes": "Opening line: Band 6.0-6.5"
    },
    {
      "run": 19,
      "answer": "spoken",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be scored accurately without hearing the recording)",
      "overall": "6.0 (provisional, assuming pronunciation around 6)",
      "notes": "Opening line: Band 6.0-6.5"
    },
    {
      "run": 20,
      "answer": "cleaned",
      "fluency_and_coherence": "6.5",
      "lexical_resource": "6.0",
      "grammatical_range_and_accuracy": "5.5",
      "pronunciation": "declined",
      "pronunciation_note": "N/A (cannot be reliably assessed from a written transcript)",
      "overall": "6.0 (provisional)",
      "notes": "Opening line: 6.0-6.5"
    }
  ],
  "summary": {
    "spoken": {
      "fluency_and_coherence": {
        "6.5": 7,
        "6.0": 3
      },
      "lexical_resource": {
        "6.0": 9,
        "6.5": 1
      },
      "grammatical_range_and_accuracy": {
        "5.5": 8,
        "5.5-6.0": 1,
        "5.0": 1
      },
      "pronunciation": {
        "declined": 8,
        "6.0": 2
      },
      "overall": {
        "6.0-6.5": 5,
        "6.0": 5
      }
    },
    "cleaned": {
      "fluency_and_coherence": {
        "6.5": 9,
        "7.0": 1
      },
      "lexical_resource": {
        "6.0": 8,
        "6.5": 2
      },
      "grammatical_range_and_accuracy": {
        "5.5": 10
      },
      "pronunciation": {
        "declined": 8,
        "6.0": 2
      },
      "overall": {
        "6.0": 8,
        "6.0-6.5": 2
      }
    }
  },
  "interpretation": "Every reply described its bands as estimates and put the overall at 6.0 or 6.0-6.5 in its table (two opening sentences said 6.5). Criterion bands moved: fluency 6.0-7.0 and grammar 5.0 to '5.5-6.0' for the same words, in six different fluency/vocabulary/grammar combinations. ChatGPT declined to score pronunciation in 16 runs and gave 6.0 in 4. The cleaned version never received a fluency band below 6.5; the spoken version received 6.0 in 3 of 10 runs. One answer, one model and one day: an illustration, not a benchmark."
}