Blog

  • NeurIPS 2018, Updates on the AI road map

    Blog post preview image

    I present an updated roadmap to AGI with four critical challenges: Continual Learning, Meta-Learning, Environments, and Scalability. I motivate the respective areas and discuss how research from NeurIPS 2018 has advanced them and where we need to go next. [Continue reading]

  • A Map of Reinforcement Learning

    Blog post preview image

    Reinforcement Learning promises to solve the problem of designing intelligent agents in a formal but simple framework. This blog post aims at tackling the massive quantity of approaches and challenges in Reinforcement Learning, providing an overview of the different challenges researchers are working on and the methods they devised to solve these problems. [Continue reading]

  • How to make your ML research more impactful

    Blog post preview image

    We machine learning researchers all have a very limited amount of time to spend on reading research and there is only so few projects we can take on at a time. Thus, it is paramount to understand what areas of research excite you and hold promise for the future. I present my analysis of the factors of impactful ML research and how to increase your impact. [Continue reading]

  • Theories of Intelligence (2/2): Active Inference

    Blog post preview image

    We look at Active Inference, a theoretical formulation of perception and action from neuroscience that can explain many phenomena in the brain. It aims to explain the behavior of cells, organs, animals, humans, and entire species. This article is geared towards machine learning researchers familiar with probabilistic modeling and reinforcement learning. [Continue reading]

  • Theories of Intelligence (1/2): Universal AI

    Blog post preview image

    I give insight into a theoretic top-down approach of universal artificial intelligence. This may allow directing our future research by theoretical guidance, avoiding to handcraft properties of a system that may be learned by an intelligent agent. Furthermore, we will learn about theoretical limits of (non-)computable intelligence and introduce a universal measure of intelligence. [Continue reading]

  • Simple hyperparameter and architecture search in tensorflow with ray tune

    Blog post preview image

    In this blog post we want to look at the distributed computation framework ray and its little brother ray tune that allow distributed and easy to implement hyperparameter search. It not only supports population-based training, but also other hyperparameter search algorithms. Ray and ray tune support any autograd package, including tensorflow and PyTorch. [Continue reading]

  • Hyperparameter search with population based training in tensorflow

    Blog post preview image

    Deep learning researchers often spend a large amount of time tuning their architecture and hyper-parameters. A simple method to reduce this human effort is to perform a grid search, essentially random search, but requires exponential compute in the number of parameters. We will investigate a cheap and powerful alternative called population based training. [Continue reading]

  • Modular Networks: Learning to decompose neural computation

    Blog post preview image

    Currently, our largest neural networks have only billions of parameters, while the brain has trillions of synapses. To this date, we are not able to scale up artificial neural networks to trillions of parameters by performing the usual dense matrix multiplication. We introduce Modular Networks, a way to make neural networks modular, similar to what has been observed in the brain. In our approach, we execute only some of these modules, conditioned on the input to the network. Furthermore, we look at future possibilities of leveraging sparse computation. [Continue reading]

  • Why work on artificial intelligence?

    Blog post preview image

    This morning, you woke up and got out of bed. A human-made object that enables you to have an enjoyable and effective rest. You checked your smartphone, to communicate with the entire world instantly. You received all important news and notifications without any effort. Every day you use thousands of objects and processes that are human inventions, to make our lives more enjoyable and effective. Inventions, that enable us to truly focus on what's important. They free us from the requirement to dedicate our entire day to survival. Instead, we can focus on social, creative or inventive issues. Behind all this is only a single factor, human intelligence. [Continue reading]

subscribe via RSS