Deep Reinforcement Learning with Double Q-learning

, ,  -

Publications: arXiv Add/Edit

Abstract: Add/Edit

The popular Q-learning algorithm is known to overestimate action values under certain conditions. It was not previously known whether, in practice, such overestimations are common, whether they harm performance, and whether they can generally be prevented. In this paper, we answer all these questions affirmatively. In particular, we first show that the recent DQN algorithm, which combines Q-learning with a deep neural network, suffers from substantial overestimations in some games in the Atari 2600 domain. We then show that the idea behind the Double Q-learning algorithm, which was introduced in a tabular setting, can be generalized to work with large-scale function approximation. We propose a specific adaptation to the DQN algorithm and show that the resulting algorithm not only reduces the observed overestimations, as hypothesized, but that this also leads to much better performance on several games.

Keywords: Add/Edit


Code Links

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

RL agent for OpenAI Gym's Lunar Lander

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

A collection of Python modules to solve OpenAI Gym environments with Reinforcement Learning.

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Keras implementation of DQN on ViZDoom environment

0

Languages: Jupyter Notebook Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Teaching materials for the seminar on Application of Computational Intelligence Methods

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

📖 Paper: Deep Reinforcement Learning with Double Q-learning 🕹️

0

Languages: Jupyter Notebook Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Deep Reinforcement Learning agent learning and playing a customized Unity game environment

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Replicating DQN papers by DeepMind for Breakout game

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0

Languages: Jupyter Notebook Add/Edit

Libraries: Add/Edit

Description: Add/Edit

This repository contains the source code and documentation for the course project of the Deep Reinforcement Learning class at Northwestern University. The goal of the project was setting up an Open AI Gym and train different Deep Reinforcement Learning algorithms on the same environment to find out strengths and weaknesses for each algorithm. This will help us to get a better understanding of these algorithms and when it makes sense to use a particular algorithm or modification.

0

Languages: Jupyter Notebook Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Deep Reinforcement Learning for Keras.

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Double Q learning with Priortized Experience Replay

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Deep Reinforcement Learning framework based on TensorFlow and OpenAI Gym

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Trading Gym is an open source project for the development of reinforcement learning algorithms in the context of trading.

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

This repository contains the implementation of a DDQN agent to solve the CartPole-v0 problem. I use openai gym to simulate the environment.

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Solving the OpenAI gym environment CartPole-v1 with the DDQN algorithm

0
github.com: /pathway/alphaxos

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Deep Reinforcement Learning with Self-Play

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Deep Reinforcement Learning

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Framework for deep reinforcement learning.

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Tensorflow + OpenAI Gym implementation of Deep Q-Network (DQN), Double DQN (DDQN), Dueling Network and Deep Deterministic Policy Gradient (DDPG)

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Atari - Deep Reinforcement Learning algorithms in TensorFlow

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Repository for the Knot MDP

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Chainer implementation of Double Deep Q-Network (Double DQN)

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0

Languages: Jupyter Notebook Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Catalog of reinforcement learning algorithms.

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Deep Q-Learning Network in pytorch

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

For testing out reinforcement learning things

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0

Languages: Jupyter Notebook Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton's Book and David Silver's course.

0

Languages: Jupyter Notebook Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0

Languages: Jupyter Notebook Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Keras implementation of DQN for the MsPacman-v0 OpenAI Gym environment.

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0

Languages: TeX Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Overview of a Deep Reinforcement Learning method using Q-learning that recently brought the state-of-the-art results in the Atari Emulator Environment

0

Languages: Jupyter Notebook Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Solution of a first project of the deep reinforcement learning nanodegree at Udacity.

0

Languages: Jupyter Notebook Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Navigation-Project: Project Nr 1 of the Deep-Reinforcement-Learning-Nanodegree of Udacity

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

An experiment on using deep learning to play games

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Highly modularized implementation of popular deep RL algorithms by PyTorch

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Tensorflow Implementation for "Noisy network for exploration"

0

Languages: Jupyter Notebook Add/Edit

Libraries: Add/Edit

Description: Add/Edit

CS 294: Deep Reinforcement Learning, Spring 2017 Berkeley

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Deep Double Q-Learning implementation introduced by Hasselt et al in this paper: https://arxiv.org/abs/1509.06461. It's interfacing with openAI Gym. WIP.

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Reinforcement Learning

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Implementation of DQN for Super Mario Bros. 1-1

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

TensorFlow implementation of Deep Reinforcement Learning papers

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Simple Implementations of Important Research Papers

0

Languages: Lua Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Deep reinforcement learning package for torch7

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Implementation of a Dueling Double Deep Q-value Network with tensorflow

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

TensorFlow implementation of Deep RL (Reinforcement Learning) papers based on deep Q-learning (DQN)

0
github.com: /jadag/DDQN_mario

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

0
Github: tokb23/dqn

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

DQN implementation in Keras + TensorFlow + OpenAI Gym

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

DQN

0

Languages: Lua Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Persistent advantage learning dueling double DQN for the Arcade Learning Environment

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

基于Tensorflow、OpenAI搭建的强化学习框架,训练机器自动操盘

0

Languages: Python Add/Edit

Libraries: Add/Edit

Description: Add/Edit

Rainbow: Combining Improvements in Deep Reinforcement Learning

0