• Th4tGuyII@fedia.io
    link
    fedilink
    arrow-up
    11
    ·
    28 days ago

    I can think of a couple of rules that could prevent a lot of the more blatant cheating:

    • All computer generated coursework must have some form of change tracking enabled, thus the assessor can see the way the essay was written.

    • All computer generated coursework must come with an accompanying oral assessment where the student has to discuss their work and research methodology.

    The former would make it difficult to copy directly from ChatGPT, as the lack of any editing would leave an obvious fingerprint

    … And passing the latter would require a level of understanding that would be difficult to replicate if you hadn’t done the research yourself.

  • magnue@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    ·
    28 days ago

    As someone who is terrible at project work but great at tests, maybe now is finally my time to get a degree. Because tests seem the only thing you can’t cheat on now.

  • RxBrad@infosec.pub
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    1
    ·
    26 days ago

    An interesting gotcha that I don’t see universities actually addressing on any of this…

    English-as-a-Second-Language students are generally being given a pass to use AI freely. The thought is that proper grammar and writing aren’t what’s being graded for many papers.

    The problem is that they can just let AI write the paper and say “I only used AI for grammar”.

    • abbadon420@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      20
      ·
      28 days ago

      What are you on about? This is about how universities have a hard time managing AI use and misuse by students. Have they sown those AI tools?

      The essence of an academic paper is that a student shows that they have learned all the goals that were set for that course or courses. If a student lets tgere paper be generated by AI, they can not prove that they have learned those goals. That is why universitues have (or should have) strict AI guidelines, so that students know which kinds of use are allowed and which are not.

      This is a hard nut to crack. Of course you will see overfitting and underfitting until someone somewhere fimds a universal approach. I personally think AI-detection tools are shit, but you cannot fault universities for trying it. My university handles AI fraud manually, with a committe. That is very labor intensive. We only have a couple hundred students, but if you have thousands, it quickly becomes impossible.

      • iltoroargento@startrek.website
        link
        fedilink
        English
        arrow-up
        10
        ·
        28 days ago

        I thought that they were trying to get at the hypocrisy of using ai tools to detect ai writing, which has a dismal success rate and ends up with a crazy amount of false positives.

        I see that the growth of computer/digital testing directly led to student abuse of ai. Once students were no longer called on to write a blue book or even just generate responses to short answer questions, we failed our students. I understand that term papers and larger writing assignments have their place, but there really is nothing like being able to sit down and show your knowledge in an on the spot essay (at least for a lot of humanities courses where I see ai being abused).

        A systemic issue in this space comes from universities and licensing entities giving testing companies carte blanche to race to the bottom in terms of effective testing tools. For licensing, apprenticeship/mentorship and observation are always better indicators of on the job performance, but that doesn’t have the ease and profit margins of big bullshit testing, so companies would never go for it unless states mandated such pathways. With regard to a lot of current digital university testing, a lot of that was Frankensteined from existing licensing exam tools/strategies and similarly does not effectively assess student/candidate aptitude.

        Even if this was not the intent of the commentor, my argument is that carelessness and disingenuous/gatekeeping testing practices from universities and licensing institutions certainly bred a significant level of disengagement in students which leads to them phoning it in with ai slop. If we wanted rigorous work from our students, we should have kept the same standards for ourselves, collectively.

        • db2@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          27 days ago

          You pretty much got it. I’m a little surprised more didn’t tbh.