At Statsbot, we’re constantly reviewing the deep learning achievements to improve our models and product. Around Christmas time, our team decided to take stock of the recent achievements in deep learning over the past year. Lip readingLip reading is another deep learning achievement and victory over humans. GANsOne of the hottest topics in Deep Learning is Generative Adversarial Networks. Reinforcement learningReinforcement learning, or learning with reinforcement is also one of the most interesting and actively developing approaches in machine learning.
Currently, algorithms are being taught to play more complex games like Doom.Much of the attention is paid to learning acceleration because experience of the agent in interaction with the environment requires many hours of training on modern GPUs.In his blog, Deepmind reported that the introduction of additional losses, such as the prediction of a frame change so that the agent better understands the consequences of the actions, significantly speeds up learning.
To make the process effective, it was necessary to adapt the learning strategy with a huge batch: gradient averaging, warm-up phase, special learning rate, etc.