In the News
The technology could revolutionize policing, medicine, even agriculture—but its applications can easily be weaponized.
Introducing the full evaluation of AlphaZero on how it learns each game to become the strongest player in history for each, despite starting its training from random play, with no in-built domain knowledge but the basic rules of the game.
Unsupervised MT, pre-trained language models, common sense inference datasets, meta-learning, robust unsupervised learning, understanding representations, clever auxiliary tasks, inductive bias and more
“We’ve discovered that the gradient noise scale, a simple statistical metric, predicts the parallelizability of neural network training on a wide range of tasks. Since complex tasks tend to have noisier gradients, increasingly large batch sizes are likely to become useful in the future, removing one potential limit to further growth of AI systems. More broadly, these results show that neural network training need not be considered a mysterious art, but can be rigorized and systematized.”
Current state of collaboration around building and deploying models, tension points that potentially arise, as well as practical advice on how to address these tension points.
For situations where scenes don’t contain one main object or a simple scene, object detection can be used to improve the performance of computer vision algorithms. Comes with examples from the retail industry.
Software tools & code
Learn how to collect and analyze social media data using topic models, text networks, and word2vec with this open source version of the Text as Data class from Duke’s Data Science program.
Open-sourced by Facebook: a new fully convolutional approach to automatic speech recognition and wav2letter++, the fastest state-of-the-art end-to-end speech recognition system available.
This newsletter is a collection of AI news and resources curated by @dlissmyr. If you find it worthwhile, please forward to your friends and colleagues, or share on your favorite network!
Suggestions or comments are more than welcome, just reply to this email.