Yes, “track changes” and “document history” features, commonly found in word processors and collaborative document editing platforms (like Google Docs or Microsoft Word), can be used to examine the evolution of a document over time. When investigating the possible use of generative AI by students, these features might offer some insights, but there are caveats.
- Evidence of Drastic Shifts: If a student suddenly inserts a large chunk of highly polished or overly sophisticated text that seems inconsistent with their previous writing, it might suggest the use of an external tool, possibly including generative AI.
- Inconsistencies in Style or Tone: Generative AI outputs might not always align with the student’s typical style or tone. If there are sections in the document history that show a stark difference in style or complexity, it might be a clue.
- Timestamps: Rapid additions of comprehensive and intricate content in a very short time frame might be suspicious. If a student typically takes hours to craft a few paragraphs but suddenly adds several pages within minutes, it could indicate external assistance.
- Direct Comparisons: By comparing different versions of a document from its history, educators can see how ideas developed and changed. This can give insights into whether the student was genuinely working through an idea or if they simply inserted pre-generated content.
However, there are several caveats and challenges:
- Not Conclusive Evidence: Even if there are signs that suggest generative AI use, it’s not definitive proof. The student might have received legitimate help, done further research, or simply had a burst of inspiration.
- Privacy Concerns: Monitoring and analyzing a student’s document history might raise ethical and privacy concerns. Before resorting to such measures, it’s essential to ensure that students’ privacy rights are respected and not violated.
- Work Done Outside the Platform: Students might draft their work in another platform or on paper and then transcribe it to the primary platform. In such cases, the document history wouldn’t reflect the genuine evolution of the content.
- Sophisticated Users: Savvy students might be aware of these monitoring methods and deliberately avoid them by crafting their document elsewhere and then copying it into the main platform, leaving no trace of generative AI usage in the document history.
In summary, while “track changes” and “document history” can offer some hints about the potential use of generative AI, they are not foolproof methods. A comprehensive approach, which includes promoting academic integrity, educating students about the pitfalls of over-reliance on AI, and fostering open communication, is likely more effective.
