Here is the source code for a HTML5 project that implements a machine learning algorithm in the Flappy Bird video game using neural networks and a genetic algorithm. The program teaches a little bird how to flap optimally in order to fly safely through barriers as long as possible.
The complete tutorial with much more details and demo you can find here:
http://www.askforgametask.com/tutorial/machine-learning-algorithm-flappy-bird
Here you can also watch a short video with a simple presentation of the algorithm:
https://www.youtube.com/watch?v=aeWmdojEJf0
All code is written in HTML5 using Phaser framework and Synaptic Neural Network library for neural network implementation.
To play the game, each unit (bird) has its own neural network consisted of the next 3 layers:
an input layer with 2 neurons presenting what a bird sees:
1) horizontal distance between the bird and the closest gap
2) height difference between the bird and the closest gap
a hidden layer with 6 neurons
an output layer with 1 neuron used to provide an action as follows:
if output > 0.5 then flap else do nothing
There is used Synaptic Neural Network library to implement entire artificial neural network instead of making a new one from the scratch.
The main concept of machine learning implemented in this program is based on the neuro-evolution form. It uses evolutionary algorithms such as a genetic algorithm to train artificial neural networks. Here are the main steps:
create a new population of 10 units (birds) with a random neural network
let all units play the game simultaneously by using their own neural networks
for each unit calculate its fitness function to measure its quality as:
fitness = total travelled distance - distance to the closest gap
when all units are killed, evaluate the current population to the next one using genetic algorithm operators (selection, crossover and mutation) as follows:
1. sort the units of the current population in decreasing order by their fitness ranking
2. select the top 4 units and mark them as the winners of the current population
3. the 4 winners are directly passed on to the next population
4. to fill the rest of the next population, create 6 offsprings as follows:
- 1 offspring is made by a crossover of two best winners
- 3 offsprings are made by a crossover of two random winners
- 2 offsprings are direct copy of two random winners
5. to add some variations, apply random mutations on each offspring.
go back to the step 2
Since the program is written in HTML5 using Phaser framework and Synaptic Neural Network library you need these files:
The entire game logic is implemented in gameplay.js file. It consists of the following classes:
App.Main
, the main routine with the following essential functions:
TreeGroup Class
, extended Phaser Group class to represent a moving barrier. This group contains a top and a bottom Tree sprite.
Tree Class
, extended Phaser Sprite class to represent a Tree sprite.
Bird Class
, extended Phaser Sprite class to represent a Bird sprite.
Text Class
, extended Phaser BitmapText class used for drawing text.
The genetic algorithm is implemented in genetic.js file which consists of the following class:
GeneticAlgorithm Class
, the main class to handle all genetic algorithm operations. It needs two parameters: max_units to set a total number of units in population and top_units to set a number of top units (winners) used for evolving population. Here are its essential functions:
主要收录整理的一些学习资源 首要资源链接-知乎: https://zhuanlan.zhihu.com/p/35212427?group_id=964152225728258048 UC Berkeley 课程: http://rll.berkeley.edu/deeprlcourse/ FUll Source LInks: http://www.jeremydjacksonphd.co
学习意味着通过学习或经验获得知识或技能。 基于此,我们可以定义机器学习(ML)如下 - 它可以被定义为计算机科学领域,更具体地说是人工智能的应用,其为计算机系统提供了学习数据和从经验改进而无需明确编程的能力。 基本上,机器学习的主要焦点是允许计算机自动学习而无需人为干预。 现在问题是如何开始和完成这种学习? 它可以从数据的观察开始。 数据可以是一些示例,指令或一些直接经验。 然后在此输入的基础上,
Machine Learning This project provides a web-interface,as well as a programmatic-apifor various machine learning algorithms. Supported algorithms: Support Vector Machine (SVM) Support Vector Regressio
深度学习 我们可以在Personal Computer上完成庞大的任务 深度学习是一种适应于各类问题的万能药 神经网络 神经网络出现于80年代,但当时计算机运行慢,数据集很小,神经网络不适用 现在神经网络回来了,因为能够进行GPU计算,可用使用的数据集也变大 分类 分类的一些讨论可以在这个项目里看到 Machine Learning不仅是Classification!但分类是机器学习的核心。 学会
Machine Learning Projects This repository contains mini projects in machine learning with jupyter notebook files.Go to the projects folder and see the readme for detailed instructions about the projec
Machine Learning for OpenCV This is the Jupyter notebook version of the following book: Michael Beyeler Machine Learning for OpenCV Intelligent Image Processing with Python 14 July 2017 Packt Publishi
Machine Learning and Data Science Applications in Industry Sov.ai Research Lab (Sponsorship) Animated Investment Management Research at Sov.ai — Sponsoring open source AI, Machine learning, and Data S