Machine learning is to find functions automatically.For example, speech recognition, image recognition, playing go, dialogue system…
Regression
Prediction.
Binary Classification
Output is yes or no.
Multiclass Classification
Let the machine do multiple choice questions.The machine selects the correct one in the options.
Generation
Produce structured complex things.Like images,sentences created like a human.How to tell the machine what kind of function to look for?
Supervised Learning
Labeled data.Need to give the machine some labeled data for training.
Function Loss
Judge whether the function is good or bad. The basic idea is as follows: First, the image is given to the function for output, and the output result is compared with the label. The proportion of the correct answer is related to the quality of the function.The smaller the LOSS, the closer to the function we need to find. Next, the machine will automatically select the function with the lowest LOSS value.
Reinforcement Learning
The result will allow the machine to evaluate previous decisions.And alpha go both use supervised learning and reinforcement learning.
Unsupervised Learning
Unlabeled data.What can machine learn from unlabeled data.
Function Search Range
Linear,Network Architecture,like RNN and CNN.
Function Search Method
Gradient descent.PyTorch.
Other Application
Explainable AI
Tell us why this result is output.
Adversarial Attack
Deliberately modify the input data to confuse the machine, resulting in an error in its selection function.
Network Compression
Compress the data input and put it on the phone.
Anomaly Detection
Enter something completely different,Can you let the machine know that ‘i don’t know’?
Transfer Learning
Training data AND testing data.learn by analogy.BUT when testing data totally different with the training data, what tragety will machine choose.
Meta Learning
Let machine can learn by itself! learning algorithmn.Can you make the machine smarter?create learning algorithmn.
Life-long Learning
Machine life-long learning.Continuous learning.