Aprendizaje por Refuerzo Profundo 2.0
Actualizado en 2026

Mastering Deep Reinforcement Learning

A Complete Guide to Deep Q-Learning, Policy Gradient, Actor-Critic and DDPG with PyTorch.

  • You want to learn Deep Reinforcement Learning, but most resources explain the theory without showing you how to implement the algorithms from scratch.
  • You've heard of DQN, Actor-Critic, DDPG or TD3, but you don't understand how they relate to each other or why they work.
  • You're intimidated by setting up complex AI environments and just want to start training real models without losing hours installing dependencies.
Si te sientes identificado con estos problemas, este curso es ideal para ti.

Deep Reinforcement Learning with PyTorch: Master TD3, Deep Q-Learning, Policy Gradient and Actor-Critic from Scratch

Deep Reinforcement Learning is one of the most advanced branches of Artificial Intelligence and the foundation of systems capable of learning to make complex decisions autonomously. In this course you'll learn from the fundamentals to the implementation of Twin Delayed Deep Deterministic Policy Gradient (TD3), one of the most powerful algorithms for continuous control environments, using Python, PyTorch and Google Colab.

We'll start by building a solid foundation in the essential concepts of Reinforcement Learning. You'll understand how Q-Learning, Deep Q-Learning (DQN), Policy Gradient and Actor-Critic work, discovering when to use each technique and how they evolve to give rise to state-of-the-art algorithms like TD3. All of it explained with a visual, intuitive and practice-oriented approach.

Once you've mastered the fundamentals, we'll dive deeper into the theory behind Twin Delayed DDPG (TD3). You'll analyze step by step how the actor and critic interact, why the dual critic improves training stability, and how the algorithm's different strategies enable more robust and efficient learning in complex control problems.

Finally, you'll implement TD3 from scratch with PyTorch, developing each component through hands-on exercises and guided programming sessions. You'll train intelligent agents in advanced simulations, like humanoids and quadruped robots capable of learning to walk and run autonomously. Plus, you'll work entirely in Google Colab, with no need to install software or set up environments, so you can focus solely on learning and building high-level Artificial Intelligence models.

A course from the Path of

Difficulty

Hours

Total Students

Average Rating

Requirements

  • Intermediate knowledge of Python and object-oriented programming.
  • Linear algebra fundamentals, probability, statistics, and calculus.
  • Prior knowledge of Machine Learning and Deep Learning (or having completed equivalent courses).
  • A computer with an Internet connection and the motivation to develop intelligent agents with PyTorch.

Who is it for?

  • Python developers interested in Artificial Intelligence.
  • Machine Learning and Deep Learning Engineers.
  • Researchers and students who want to master Deep Reinforcement Learning.
  • Professionals who want to learn how to implement algorithms like DQN, Actor-Critic, and TD3 from scratch.

What you'll learn

01

Mastering Q-Learning

Understand the fundamentals of reinforcement learning and how an agent learns to make decisions through rewards.

02

Implementing Deep Q-Learning (DQN)

Learn to combine neural networks with Q-Learning to solve more complex problems.

03

Apply Policy Gradient

Discover how to train agents by directly optimizing their action policies in different environments.

04

Understanding the Actor-Critic Architecture

Learn how the actor and critic work together to achieve more stable and efficient learning.

05

Working with DDPG

Explore the Deep Deterministic Policy Gradient algorithm to solve continuous control problems.

06

Mastering Twin Delayed DDPG (TD3)

Learn one of the most advanced algorithms in Deep Reinforcement Learning and understand why it improves DDPG performance.

07

Implement algorithms from scratch

Develop each component of the models step by step using Python, PyTorch and practical exercises.

08

Training intelligent agents

Build agents capable of learning complex tasks, like controlling humanoids and quadruped robots in simulations.

09

Apply cutting-edge AI

Acquire the skills you need to understand, implement, and adapt modern Deep Reinforcement Learning algorithms in real-world projects.

Course syllabus

Ligency

Your Instructor

Ligency

Ligency Team is an international team of experts in programming, artificial intelligence, data science and technology, founded by Kirill Eremenko and Hadelin de Pontevés, creators of some of the world's most popular courses in these disciplines. With millions of students and a multidisciplinary team of over 20 professionals, our mission is to offer practical, high-quality training that helps people at any level develop relevant technological skills. Since 2018, our courses have been available in Spanish thanks to the collaboration with Juan Gabriel Gomila and Frogames Formación, bringing the best educational content to the Spanish-speaking community.

Expertos en IA y Tecnología Formación Internacional +4M Estudiantes
Juan Gabriel Gomila

Your Instructor

Juan Gabriel Gomila

Mathematician, Certified Unity Instructor, and Online Instructor who has trained over 600,000 students worldwide across different platforms such as Udemy and Platzi. CEO of Frogames Formación and driving force behind this platform, bringing all his knowledge in Mathematics, Machine Learning, Videogames, AI and Blockchain among others.

Unity Certified Matemático +500k Estudiantes
Opiniones de estudiantes

What our students say

Curso completo

Choose how you want to access

Course One-Time Payment

Buy the course once and access it for life

Course image
999,99
Comprar el curso
  • A single payment.
  • Instant lifetime access to the course.
  • Access to the course community.

Path

Access all courses in the Path of

19,99 /mes
Acceder a la ruta
  • Monthly payment of 19.99€.
  • Instant access to the courses on the Path.
  • Access whenever and wherever you want.
  • Cancel anytime.
Comprar este curso
Acceso de por vida · Actualizaciones incluidas
o consíguelo con la Ruta de Aprendizaje
Ruta de
Desde 19,99 €/mes · Cancela cuando quieras
Ver la suscripción
o Suscripción Rana de Bronce (39 €/mes)