Evaluating the impact of curriculum learning on the training process for an intelligent agent in a video game
A thesis submitted in partial fulfillment of requirements for M.Sc in Systems and Computing Engineering degree
Dept. of Systems and Industrial Engineering. Faculty of Engineering. National University of Colombia. Bogotá, Colombia.
We want to measure the impact of the curriculum learning technique on a reinforcement training setup, several experiments were designed with different training curriculums adapted for the video game chosen as a case study. Then all were executed on a selected game simulation platform, using two reinforcement learning algorithms, and using the mean cumulative reward as a performance measure. Results suggest that curriculum learning has a significant impact on the training process, increasing training times in some cases, and decreasing them up to 40% percent in some other cases.
Se desea medir el impacto de la técnica de aprendizaje por currículos sobre el tiempo de entrenamiento de un agente inteligente que está aprendiendo a jugar un video juego usando aprendizaje por refuerzo, para esto se diseñaron varios experimentos con diferentes currículos adaptados para el video juego seleccionado como caso de estudio, y se ejecutaron en una plataforma de simulación de juegos seleccionada, usando dos algoritmos de aprendizaje por refuerzo, y midiendo su desempeño usando la recompensa media acumulada. Los resultados sugieren que usar aprendizaje por currículos tiene un impacto significativo sobre el proceso de entrenamiento, en algunos casos alargando los tiempos de entrenamiento, y en otros casos disminuyéndolos en hasta en un 40% por ciento.
Curriculum Learning, Reinforcement Learning, Training Curriculum, Mean Cumulative Reward, Proximal Policy Optimization, Video Games, Game AI, Unity Machine Learning Agents, Unity ML-Agents Toolkit, Unity Engine.
- Paper: http://journal.iberamia.org/index.php/intartif/article/view/532/146
- Journal: http://www.journal.iberamia.org/index.php/intartif/article/view/532
- Unal: https://repositorio.unal.edu.co/handle/unal/78592
- UniRioja: https://dialnet.unirioja.es/servlet/articulo?codigo=8234147
- Thesis: https://bit.ly/rsaenzi-master-thesis
- Google Scholar: https://scholar.google.com/scholar?cites=17917617000928451390&as_sdt=2005&sciodt=0,5&hl=en
- Semantic Scholar: https://www.semanticscholar.org/paper/Evaluating-the-impact-of-curriculum-learning-on-the-Camargo-S%C3%A1enz/b689f565e9a63d831b332504c356b77dc25e23a0
- Research Gate: https://www.researchgate.net/publication/354981744_Evaluating_the_impact_of_curriculum_learning_on_the_training_process_for_an_intelligent_agent_in_a_video_game
- Agencia UNAL:
- Virtual Pro: https://www.virtualpro.co/noticias/ia-aprende-mas-rapido-un-videojuego-con-niveles-graduales-de-dificultad
- UNSeculab: https://sites.google.com/unal.edu.co/un-securelab/publications-products
- Dblp: https://dblp.org/db/journals/aepia/aepia24.html#CamargoS21
- OAmg: https://oa.mg/work/10.4114/intartif.vol24iss68pp1-20
- Fatcat: https://fatcat.wiki/release/sjfcptixn5cedkytvfdfwavl3i
- Adjam: https://library.ajman.ac.ae/eds/detail?db=asn&an=154089422
Ph.D. Jorge Eliecer Camargo Mendoza
- Website: https://sites.google.com/site/camargoj/
- Google Scholar: https://scholar.google.com.co/citations?user=7jS2MTUAAAAJ&hl=en
- CvLac: http://scienti.colciencias.gov.co:8081/cvlac/visualizador/generarCurriculoCv.do?cod_rh=0000486388
Rigoberto Sáenz Imbacuán
- LinkedIn: https://linkedin.com/in/rsaenzi/
- Curriculum Vitae: https://bit.ly/rsaenziCV
- Google Scholar: https://scholar.google.com/citations?user=Zz4zIF4AAAAJ&hl=en
- CvLac: https://scienti.minciencias.gov.co/cvlac/visualizador/generarCurriculoCv.do?cod_rh=0001440347