The portraits identify usable habits and a boundary for borrowing them. They describe sampled pages, not every chapter.
Theory textbook
Foundations of Machine Learning
Mehryar Mohri, Afshin Rostamizadeh, Ameet Talwalkar
Edition / version: Second edition (MIT Press, 2018). Source page
Begins a formal topic with questions, defines a learning model, gives theorem–proof–example sequences, and interprets sample-complexity bounds. Chapter notes and exercises connect the result to literature and extensions. Its deliberately succinct proofs are useful as a structural model; the agent notes should explain more of the intermediate reasoning.
Preface p. 14 · PAC setup p. 26 · Result and example p. 33
Concept-and-figure textbook
Pattern Recognition and Machine Learning
Christopher M. Bishop
Edition / version: 2006 Springer volume; no numbered edition is stated in this PDF. Source page
Introduces a running example before broadening to probability and decision theory. Figures and captions establish what variables mean before equations become demanding. A dedicated notation section makes conventions explicit. Bishop states that conveying concepts takes priority over maximal mathematical rigor; combine his pacing and visuals with fuller proofs from the theory texts.
Notation p. 11 · Curve fit p. 24 · Probability example p. 32
Unifying reference
Probabilistic Machine Learning: An Introduction
Kevin P. Murphy
Edition / version: MIT Press, 2022. This online PDF is dated 18 April 2025; no numbered edition is stated. Source page
Uses a probabilistic lens across topics, restates an equation in words, then tests it on a concrete numerical case. Later derivations connect formal properties to practical diagnostics. Examples, figures, code-generated plots, cross-references, and a notation appendix make a large reference navigable. For agent notes, the most valuable habit is the prose interpretation after each formal result.
Framing p. 31 · Bayes example p. 76 · Derivation p. 342
Advanced reference
Probabilistic Machine Learning: Advanced Topics
Kevin P. Murphy
Edition / version: MIT Press, 2023. This online PDF is dated 10 December 2025; no numbered edition is stated. Source page
Defines advanced objects systematically, often with a small example before a more general model. Causal graphs and optimization figures accompany derivations; selected sections close with practical advice. Use this as a depth and cross-reference model for topics such as partial observability or causal evaluation, while keeping local definitions in each chapter.
Probability setup p. 39 · Causal example p. 247 · Practical advice p. 1241
Statistical methods textbook
The Elements of Statistical Learning
Trevor Hastie, Robert Tibshirani, Jerome Friedman
Edition / version: Second edition (2009), corrected 12th printing of 13 January 2017. Source page
Defines a prediction problem through scientific examples, then compares methods by the assumptions they impose and the errors they incur. Data examples and exercises make the contrast concrete. Its technical prose can be dense. Borrow the comparative method and empirical figures, but unpack the bridges between assumptions and conclusions for this audience.
Applications p. 20 · Method contrast p. 30 · Exercises p. 58
Applied textbook
An Introduction to Statistical Learning with Applications in Python
Gareth James, Daniela Witten, Trevor Hastie, Robert Tibshirani, Jonathan Taylor
Edition / version: Python edition; first printing dated 5 July 2023. Source page
Starts with recognizable data sets and visible patterns, explains concepts before equations, then gives labs with executable Python and displayed output. Exercises distinguish conceptual understanding from application. Its accessible cadence is valuable for agent-development labs; the mathematical depth of the agent notes should remain above its introductory level.
Data-first opening p. 12 · Figure interpretation p. 27 · Lab p. 125
First-principles theory
Learning Theory from First Principles
Francis Bach
Edition / version: Author PDF dated 26 May 2025; no numbered edition is stated. Source page
Starts by asking why the theory matters, provides chapter summaries and prerequisites, and carries assumptions through detailed derivations. It discusses what asymptotic results cannot tell us about finite problems. Adopt its explicit assumption ledger and limiting-case discussion. Add worked agent traces when a proof would otherwise float free of the system being modeled.
Motivation p. 11 · Chapter map p. 19 · Limitation p. 123
Algorithms-and-practice textbook
Machine Learning
Tom M. Mitchell
Edition / version: McGraw-Hill, 1997; no numbered edition is stated. Source page
Frames machine learning through problems, algorithms, assumptions, and the balance of theory with practice. Definitions and traces are developed on concrete tasks, while exercises vary the task or order of examples. Borrow the progressive algorithm trace. Do not import dated examples or treat historical implementation details as current practice.
Preface p. 3 · Formalization p. 35 · Trace exercise p. 60
Historical-conceptual monograph
Patterns, Predictions, and Actions
Moritz Hardt, Benjamin Recht
Edition / version: 2022 print book; online preprint compiled 8 June 2026. No numbered online edition is stated. Source page
Uses a historical episode to establish why a prediction problem matters, then develops formal criteria and follows their consequences for decisions. Later empirical examples are set beside unresolved theoretical explanations. Borrow the connection from mechanism to social or operational consequence. Use historical framing sparingly when it would delay an agent chapter's main argument.
Historical opening p. 11 · Formal criterion p. 33 · Evidence boundary p. 116
Formal learning textbook
Understanding Machine Learning: From Theory to Algorithms
Shai Shalev-Shwartz, Shai Ben-David
Edition / version: Cambridge, 2014 author PDF; no numbered edition is stated. Its pagination differs from print. Source page
Moves from a concrete classification problem to a formal model, precise quantifiers, theorem statements, and proofs. The reader can see exactly which assumptions a guarantee needs. When the strongest proof needs more machinery, the text identifies the looser result it actually proves. This is the clearest model for formal agent claims, provided every symbol receives local explanation.
Motivating task p. 33 · Definition p. 43 · Proof boundary p. 392
Theory lecture notes
Deep Learning Theory Lecture Notes
Matus Telgarsky
Edition / version: Version 2021-10-27 v0.0-e7150f2d (alpha); lecture notes, not a numbered textbook edition. Source page
Names its chosen theoretical perspective, its weaknesses, and topics it omits. Short propositions and remarks show a route to simplified proofs. The sampled version also contains draft markers and unfinished sections. Use the honesty about scope and the proof simplification; do not imitate the shorthand or unfinished editorial state.
Scope and weaknesses p. 3 · Proposition p. 15 · Draft marker p. 63
Short technical paper · not a textbook
Formal Algorithms for Transformers
Mary Phuong, Marcus Hutter
Edition / version: arXiv version 1, dated 19 July 2022; a paper, not a textbook edition. Source page
Responds to vague architectural descriptions with formal pseudocode. Algorithms state inputs, outputs, parameters, and dimensions; a notation appendix collects symbols. This is a strong model for a tool or harness contract. As a 16-page paper, it moves too quickly to supply the narrative and exercises needed in graduate lecture notes.
Purpose p. 1 · Pseudocode p. 5 · Notation p. 16