Explainable AI
❏ An Approach to Building a Fuzzy Controller that imitates the Internal Behavior of a Pre-trained Deep Reinforcement Learning Model
Overview
Due to its black-box nature, the internal behavior of a deep reinforcement learning model is challenging to be interpreted by humans. Therefore, we apply fuzzy modeling for the input-output relationships of a deep reinforcement learning model and express these relationships with fuzzy linguistic variables to make linguistic control rules. In this study, we use CartPole as an experiment subject; explain control rules of the model learned by a Deep Q-Network with fuzzy linguistic variables; and try to control the CartPole using those control rules. We use two approaches to construct control rules. One is to construct control rules from input data and the other is to construct control rules from output data. As a result, through experiments, we have confirmed the trade-off between control performance and the number of rules.
Slides
enta-01
enta-02
enta-03
enta-04
enta-05
enta-06
enta-07
enta-08
enta-09
enta-10
enta-11
enta-12
enta-13
enta-14
enta-15
enta-16
enta-17
enta-18
enta-19
enta-20
enta-21
enta-22
enta-23
enta-24
previous arrow
next arrow
Ayano Enta
圓田 彩乃,小林 一郎「学習済み深層強化学習モデルの内部挙動を模したファジィ制御器構築への取り組み」人工知能学会全国大会(第36回),国立京都国際会館,京都,2022年6月.(in Japanese)