A Reinforcement Learning Approach to Robust Scheduling of Semiconductor Manufacturing Facilities

[Gwang Jong Ko]

📋 논문의 정보를 알려주세요.

• A Reinforcement Learning Approach to Robust Scheduling of Semiconductor Manufacturing Facilities
• In-Beom Park, Jaeseok Huh, Joongkyun Kim, Jonghun Park
• 2019-07

📃 Abstract(본문)

As semiconductor manufacturers, recently, have focused on producing multichip products (MCPs), scheduling semiconductor manufacturing operations become complicated due to the constraints related to reentrant production flows, sequence-dependent setups, and alternative machines. At the same time, the scheduling problems need to be solved frequently to effectively manage the variabilities in production requirements, available machines, and initial setup status. To minimize the makespan for an MCP scheduling problem, we propose a setup change scheduling method using reinforcement learning (RL) in which each agent determines setup decisions in a decentralized manner and learns a centralized policy by sharing a neural network among the agents to deal with the changes in the number of machines. Furthermore, novel definitions of state, action, and reward are proposed to address the variabilities in production requirements and initial setup status. Numerical experiments demonstrate that the proposed approach outperforms the rule-based, metaheuristic, and other RL methods in terms of the makespan while incurring shorter computation time than the metaheuristics considered.

🔎 어떤 논문인지 소개해주세요.

• 반도체 공정과 같은 복잡한 다중칩 공정에서 강화학습이 어떻게 적용되면 좋을지 배울 수 있는 논문입니다.
• 실제 환경과 강화학습의 요소들을 어떻게 맵핑하였고, 그 간극을 매우기 위해 어떤 스킬들을 활용하였는지를 중점으로 볼 예정입니다.

🔑 핵심 키워드를 적어주세요.

• Multichip product(MCP), Neural networks(NNs), Reinforcement learning(RL), Semiconductor manufacturing

📎 URL

• https://ieeexplore.ieee.org/abstract/document/8946870