Autistic children are a group that is often overlooked. They have introverted characteristics, but they are actually suffering from widespread developmental disorders. These children have communication barriers when interacting with others, and their characteristics are as follows:
Poor social communication and barriers to interaction
Limited cognitive ability, passive cognition
Narrow interest, rigid repetition, lack of change and imagination
Inherent habits and behaviors, difficulty to adapt to the new environment
These symptoms can often be improved after training, but they cannot be completely cured. We should pay more attention to the needs of these groups and provide them with more care. At present, the commonly used teaching method is ABA application behavior analysis, which aims at the following two aspects of skills training:
To stick with the universal design principle, we chose a cognitive improvement perspective that is also applicable to ordinary children's education, as follows:
Randomly draw from three basic figures (circle, square, triangle)
The user takes pictures of real objects that they think are similar to the received task and sends them back to the chatbot
After receiving the reply, the bot starts to judge and provides a feedback according to whether the picture matched the figure or not
The user chooses to end the game/play another round
游戏玩法
出于对通用性设计的考虑,我们选择了同样适用于普通儿童教育的认知学提高角度进行以下设计:
从三种基本图形(圆,正方,正三角)中随机抽取,机器人动图展示并以抽奖形式定格其中一种图形
用户根据收到的图形拍取其认为相似的真实物体发送给机器人
收到回复后机器人开始进行判断,根据图片匹配度提供回复
用户选择结束游戏/再来一局
儿童根据所收获的星星可以兑换更多图形模板进行后续的匹配度游戏,也可以在社区与其他小朋友进行PK。
English
中文
Technical Documentation
Solution (Left-to-Right)
The chatroom, where all the messaging happens back and forth between different users
Puppet service, an online service masking as an iPad device so it can login to the same Wechat account as your phone. After that, it has access to all of your chatrooms and private messages and can connect with the next layer, sending and receiving messages
Main Wechaty program that allows the program to access all the messages and attachments sent to the chatrooms and grabbed by the Puppet service. The main chat logic of the app will be built into the Wechaty part such as specific wake words, if-this-then-thats, all the rules for interaction basically
A standalone Python CV recognition service, using the Flask framework that the Wechaty program could call via a simple http API to transfer data back and forth
docker run -d --name starchild -p XXXX:1337 starchild
Generating Docker Image
Use the dockerfile under CVModule directory to generate a Docker image. When you run it, the service will be automatically started and listens to the port 1337. If you add a -p XXXX:1337 flag in your docker run command, you can specify which port on the host machine will be mapped into the 1337 port within docker.