samueltobler / smartgrading

GenAI-based Smart Grading - A Software and Method for Educational and Behavioral Data Evaluation

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Overview and Citation

The herein-presented functions and software are described in the below-mentioned publication. Please cite accordingly:

Tobler, S. (2024) Smart Grading: A Generative AI-Based Tool for Knowledge-Grounded Answer Evaluation in Educational Assessments. MethodsX, 12. https://doi.org/10.1016/j.mex.2023.102531

Software and Code

⌨️ Functions

  • eval_single: This function allows running the evaluation function for an individual answer.
  • eval_combined: This function allows the evaluation function to run in a loop over all participants.

👾 Software

  • SmartGrading_Application: This script allows running the above-described functions in a web application environment. The RShiny application can be directly launched from R Studio. Alternatively, you can run the application via https://stobler.shinyapps.io/smartgrading

📊 Code

  • Krippendorff.R: Includes the code for analyzing inter-rater reliabilities, for example, between SmartGrading and own results.

About

GenAI-based Smart Grading - A Software and Method for Educational and Behavioral Data Evaluation

License:MIT License


Languages

Language:R 96.5%Language:CSS 3.5%