Machine Learning Guide
This series aims to teach you the high level fundamentals of machine learning from A to Z. I'll teach you the basic intuition, algorithms, and math. We'll discuss languages and frameworks, deep learning, and more. Audio may be an inferior medium to task; but with all our exercise, commute, and chores hours of the day, not having an audio supplementary education would be a missed opportunity. And where your other resources will provide you the machine learning trees, I’ll provide the forest. Additionally, consider me your syllabus. At the end of every episode I’ll provide the best-of-the-best resources curated from around the web for you to learn each episode’s details.

Software How-To   Podcasts   Technology  

Latest Episode
You can check more episode on Publisher's website

29. Reinforcement Learning Intro

Introduction to reinforcement learning concepts

## Resources
- Hands-On Machine Learning with Scikit-Learn and TensorFlow ( `book:medium` (last chapter)
- Sutton & Barto 2nd Ed PDF ( `book:hard`
- AI a Modern Approach. Website (, Book ( `book:hard`
- Berkeley cs294: Deep Reinforcement Learning ( `course:hard`
- RL Course by David Silver ( `course|audio:hard`
- Convert video to audio:
** mp4 => mp3: `for f in *.mp4; do ffmpeg -i "$f" "${f%.mp4}.mp3" && rm "$f"; done`
** youtube => mp3: setup youtube-dl ( and run `youtube-dl -x`

## Episode
- RL definition: goal, rewards, actions
** Games (Atari, Chess, Go - Lee Sedol & Alpha Go)
** AI: learning, vision / speech, action / motion, planning
** Reasoning / knowledge vs model-based Deep RL?
** Reasoning / knowledge rep (+memory?) => Differential computers (
** vs supervised. Vision = supervised. Games = action. Trading can go both ways!
** Time: Credit assignment, delayed rewards, investment
- Model-based v free
** Policy (what you do; gut reaction)
- Value-based (Q-learning) vs Policy Gradient
** PG is direct: ML -> action
** Value-based indirect: Bellman stuff -> state/action values (Q-values) -> policy
- Openai Gym, cartpole
- Frameworks
** openai/baselines (
** reinforceio/tensorforce (
** NervanaSystems/coach (
** rll/rllab (

2018-02-05 16:50:51 UTC

About This Site  Privacy Policy


the Apple logo, iPhone, iPod touch, and iTunes are trademarks of Apple Inc., registered in the U.S. and other countries.