Research Project: Generative AI Evaluation
Context: Bachelor of Arts
Unit: ATS2648 Contemporary Japan - semester 1, 2023
Assessment Task Summary
This task is an optional alternative to the conventional research essay assessment task. It involves first engineering a generative AI prompt and then using the AI's responses as a springboard, both to develop an academically informed evaluation and to improve AI literacy. Your prompt will be engineered on a topic related to contemporary Japanese society based on the unit content and your own research using academic sources. A list of suggested topics will be provided early in the semester. All submissions will need to include all interactions with the AI - any cycle of prompts and the AI's responses. Each submission will include your own original writing as outlined below, and be supported by academic research.
You will submit your evaluation in two parts:
Part 1. Outline:
Submit a document that includes the prompt/s you have engineered, the AI's output and your initial thoughts (of around 200 words written by you) on how you plan to develop your response to the AI's output. You will also need a proposed reference list. This list must include six or more academic sources with two (or more, where appropriate) from this unit's specified readings.
Marking criteria for part 1:
Provides a well-engineered prompt, a generative AI response and around 200 words of original writing
Original writing component demonstrates a strong effort to evaluate aspects of the response in the context of the unit
Original writing component is clearly informed by early engagement with academic sources
Includes a selection of authoritative academic sources, including two from this unit
Part 2. Final submission:
Submit an edited version of an output you have produced with the AI by continuing to engineer your prompts in response to the feedback you receive on your Outline submission. This final submission must constitute a response that is suitable for an academic context to the topic/question you have chosen. Think of it as an academic essay produced by you and the AI. The final submission should be around 1000-1500 words (not strictly enforced) and must include full and properly formatted citations.
Marking criteria for part 2:
Demonstrates a sophisticated effort to engineer the AI outputs towards answering the chosen essay question to an academic standard
Edited component answers the question persuasively using original arguments supported by persuasive evidence
Demonstrates advanced critical engagement with a considerable range of authoritative sources, including at least two from this unit
Has a tightly structured argument that proceeds coherently and is introduced and concluded effectively
Concisely and lucidly expressed in academic language; polished presentation with very few or no errors
All references in place; standard referencing style used without exception
