Maxim Lapan Books
Maxim Lapan is a software engineer and machine learning practitioner with extensive experience in reinforcement learning and deep learning. He has worked on AI systems and authored several technical books focused on practical applications of machine learning.
Known for: Deep Reinforcement Learning Hands‑On: Apply Modern RL Methods, with Deep Q‑Networks, Value Iteration, Policy Gradients, TRPO, AlphaGo Zero and More
Books by Maxim Lapan
Deep Reinforcement Learning Hands‑On: Apply Modern RL Methods, with Deep Q‑Networks, Value Iteration, Policy Gradients, TRPO, AlphaGo Zero and More
This book provides a practical introduction to deep reinforcement learning (RL) using Python and PyTorch. It covers key algorithms such as Deep Q‑Networks (DQN), policy gradients, actor‑critic methods, and advanced topics like Proximal Policy Optimization (PPO) and AlphaGo Zero. The author guides readers through building RL agents step by step, emphasizing hands‑on implementation and understanding of the underlying principles.
Read SummaryKey Insights from Maxim Lapan
From Foundations to Function Approximation
Reinforcement learning begins with the interaction between an agent and its environment. In the early chapters, I focus on making this setup intuitive before we touch mathematics. We start with the idea of state, action, and reward—the triad that forms the center of every RL system. The agent percei...
From Deep Reinforcement Learning Hands‑On: Apply Modern RL Methods, with Deep Q‑Networks, Value Iteration, Policy Gradients, TRPO, AlphaGo Zero and More
Deep Q-Networks and the Art of Stability
Deep Q-Networks (DQN) mark the true beginning of deep RL practice. In this section, I guide readers through implementing DQN, carefully noting its challenges. We introduce experience replay—the technique of breaking correlation among subsequent experiences by randomly sampling mini-batches from memo...
From Deep Reinforcement Learning Hands‑On: Apply Modern RL Methods, with Deep Q‑Networks, Value Iteration, Policy Gradients, TRPO, AlphaGo Zero and More
About Maxim Lapan
Maxim Lapan is a software engineer and machine learning practitioner with extensive experience in reinforcement learning and deep learning. He has worked on AI systems and authored several technical books focused on practical applications of machine learning.
Frequently Asked Questions
Maxim Lapan is a software engineer and machine learning practitioner with extensive experience in reinforcement learning and deep learning. He has worked on AI systems and authored several technical books focused on practical applications of machine learning.
Read Maxim Lapan's books in 15 minutes
Get AI-powered summaries with key insights from 1 book by Maxim Lapan.