Independent CMU 11-768 agent-systems study · Editorial researchReturn to reading guide
Comparative style study · 12 PDFs + 2 writing guides

Writing rigorous agent-systems chapters

A source-grounded style guide drawn from ten textbooks or monographs, one set of theory lecture notes, one short algorithm paper, and two technical-writing guides. It distinguishes chapter architecture from the sentence and paragraph craft that makes technical reasoning readable.

Prepared 12 September 2026 · Page references below use the PDF viewer's page count, not the number printed on the page.

How the references were skimmed

The original comparison used 12 supplied PDFs. I inspected each file's front matter or introduction, its contents or section map, representative technical pages, and, where present, examples, exercises, labs, notation guides, or chapter notes. I also inspected rendered pages from six books to check how figures, equations, headings, and running text share the page. For the prose analysis, I returned to at least two passages in every PDF and examined how sentences introduce terms, carry an inference, interpret mathematics, and qualify claims. I subsequently read the two linked technical-writing guides in full. The PDF comparison remains a sample, not a cover-to-cover assessment of the books' technical claims.

Evidence unit

Each observation below names a PDF-viewer page. The links target free online copies supplied by authors, publishers, or their institutions.

Inference unit

“Use in the agent notes” is my editorial inference from the sampled style. It is not a claim that the source authors prescribe an agent curriculum.

Selection rule

Borrow teaching methods, not distinctive prose or page design. Prefer a synthesis suited to advanced graduates who have used agents but have not built them.

Editorial conclusion

No single reference has the right mix by itself. The most useful combination is the problem-to-model progression of Shalev-Shwartz and Ben-David, Bishop's and Murphy's interpreted examples, Bach's explicit assumptions and limitations, Mohri's proof structure, and the operational specificity of Mitchell, ISLP, and Phuong–Hutter. The prose should be more expansive than the most compressed theory references.

Nine transferable elements of teaching structure

  1. Start with a consequential problem, then formalize it

    Several books begin with an intelligible task before introducing notation. The papaya classification problem becomes a formal learning model; a diagnostic test becomes a Bayesian calculation. Agent chapters can begin with a concrete failure or decision—such as a tool timeout after a possible purchase—and then derive the state, observation, authority, and verification machinery needed to reason about it.

  2. Build each chapter around a recurring conceptual spine

    A unifying lens lets a reader connect later results to earlier ones. Murphy uses probabilistic modeling; Bach organizes learning theory around estimation, approximation, and optimization; Hardt and Recht move from prediction to action. The agent notes should repeatedly return to a run's state, policy, observations, resources, authority, and outcome. New mechanisms should change a specified part of that model rather than appear as unrelated product features.

  3. Define objects, notation, and assumptions before using them

    A notation guide helps, but the first local use still needs an explanation. State what each variable ranges over, what an operator means, and which assumptions make a claim true. For agent systems, distinguish an actual environment state from an observation, a model proposal from an executed action, and a successful tool response from a verified outcome. An algorithm should state its inputs, outputs, parameters, and permitted effects.

  4. Derive results in visible steps, then interpret the result

    The theory-oriented books name a proposition or guarantee, state conditions, derive it, and explain what the bound means. Murphy's optimization treatment also turns a mathematical monotonicity result into a debugging check. Agent mathematics should do the same: show where a reliability product, a context-cost term, or a permission invariant comes from, then state what the equation predicts and what it does not establish.

  5. Use a running example and figures that carry an argument

    Bishop develops several concepts through polynomial curve fitting, and Murphy works Bayes' rule through a diagnostic-test example. ESL compares least squares with nearest neighbors before moving to more complex methods. A useful agent figure should similarly make a state transition, trust boundary, dependency, or cost trade-off visible. Its caption should explain what the reader is meant to infer; it should not merely restate labels.

  6. Make algorithms operational without losing the model

    Mitchell pairs theoretical questions with traces of algorithms. ISLP follows concepts with labs that show code and output. The transformer paper specifies pseudocode with inputs, outputs, parameters, and dimensions. For agent development, include short executable examples of a tool call, context builder, retry state machine, or verifier. Explain how each line implements the preceding model, and keep a consequential operation behind an explicit permission check.

  7. Compare mechanisms by assumptions, evidence, and failure mode

    A method comparison is stronger when it explains why a method succeeds or fails in a particular setting. ESL contrasts the structural assumptions of least squares and nearest neighbors; Hardt and Recht distinguish empirical observations from explanations; Murphy's advanced volume ends one causal-estimation section with practical advice. For agents, compare a prompt rule, a tool gate, a sandbox, and a verifier by what each can enforce. Report task success, cost, delay, and risk as separate outcomes.

  8. State the boundary of a guarantee and where knowledge is missing

    Formal statements gain teaching value when their idealizations are visible. Bach discusses when asymptotic analysis may mislead at finite sample sizes. Shalev-Shwartz and Ben-David identify the conditions and proof gap for a tighter bound. Telgarsky explicitly marks the weaknesses and omitted topics of his chosen perspective. Agent chapters should distinguish a model property, an engineering check, an observed benchmark result, and an unverified product claim.

  9. Use exercises and prose pacing to consolidate the argument

    Exercises can ask for a derivation, an assumption check, a counterexample, and a practical design decision rather than only arithmetic. ISLP separates conceptual questions from applied work; Mohri connects exercises to chapter notes; Mitchell asks readers to trace an algorithm on altered data. In the main prose, give one claim room to breathe. State a result, explain the mechanism, and then discuss its limitation in separate sentences when those are distinct ideas.

What the prose itself does

The nine elements above mostly concern the design of a lesson. A second pass through the same twelve PDFs exposed smaller, repeatable moves in their prose. The authors do not share one voice: a proof-oriented text can be terse, an applied text more conversational, and a short algorithm paper unusually compact. The following are editorial inferences from sampled passages, with page-level evidence. They are techniques to adapt, not sentences or mannerisms to copy.

  1. Let a paragraph make one intellectual move

    A technical paragraph can state a result, explain the mechanism that produces it, and finish with its consequence or boundary. It need not compress those three jobs into one sentence. Mohri and colleagues move from a bound to its dependence on sample size; Hardt and Recht move from measured accuracy to a narrower conclusion about regularization; Bach follows an asymptotic result with the question of when it applies. For the agent notes, split a claim about a harness from the reason it holds and from the case it leaves unresolved.

  2. State the question before introducing its machinery

    A sentence should establish what must be predicted, compared, or proved before the notation becomes dense. The learning questions at the start of Mohri's PAC discussion make the definitions purposeful. ESL asks how a linear model is fitted before giving the optimization rule. Bishop moves from uncertainty in a curve-fitting task to probability theory. In an agent chapter, the reader should know why a belief state or permission predicate is needed before encountering its formula.

  3. Give each symbol a grammatical role

    Definitions read better when they say what an object does in the problem, not merely the set to which it belongs. Murphy describes a posterior as an updated belief after explaining its normalization. ESL identifies the prediction before discussing whether it is scalar or vector valued. Phuong and Hutter describe the purpose of a positional representation and the consequence of omitting it. In the notes, introduce a proposed action as the model's choice, trusted evidence as the gate's input, and an observation as the environment's report before compressing them into symbols.

  4. Keep the referent stable across sentences

    Mitchell repeatedly names the hypothesis, hypothesis space, and training example while their relationship is being built. Shalev-Shwartz and Ben-David retain the same terms as they move from a finite class to PAC learnability. Murphy's causal example keeps the education, debt, and wealth variables distinct. Synonym variety is less useful than traceability here. Once the notes define a proposal, do not casually call the same object a command, action, decision, and execution in adjacent sentences; those words may denote different stages of the harness.

  5. Explain the hinge in a derivation

    Readers need prose where the reasoning changes direction: the assumption that licenses a bound, the inequality that makes an update monotone, or the obstacle that forces a new technique. Murphy explains why the inequalities in an optimization argument hold and turns the result into a code diagnostic. Bach names the difficulty created when the estimator appears on both sides of an inequality. ESL interprets matrix notation geometrically before solving for coefficients. Routine algebra can remain compact; the reason for the consequential step should be explicit.

  6. Translate an equation twice: into meaning and into a check

    Immediately after a formula, explain the direction of its dependence and what a reader could verify. Mohri interprets how a generalization bound varies with sample size and hypothesis-class size. Murphy uses a monotonic objective as a debugging criterion. ISLP interprets plotted residuals relative to the fitted function. For a context-cost formula, state which term grows with run length, give a numerical case, and say whether actual billing or quality follows from that calculation.

  7. Move from a case to a class of cases, then return

    Bishop uses a simple probability experiment to establish concepts that later apply to less transparent models. Mitchell turns a small hypothesis space into a discussion of search strategies for larger spaces. Murphy's advanced volume uses a numerical causal example to attach meaning to a general structural model. The prose should say which features of the example are essential. For instance, an order cancellation can teach atomic precondition checks; the same pattern applies to any conditional write whose target may change between read and commit.

  8. Make transitions carry a reason

    A transition should show why the next paragraph follows from the last. Mitchell uses the size of the hypothesis space to motivate search. Bishop uses measurement uncertainty to motivate probability. Hardt and Recht introduce a constrained prediction problem before stating the rule that solves it. These are logical bridges, not announcements that a new topic is beginning. A chapter on tool use can move from “the model emits structured arguments” to “valid structure does not establish permission,” which supplies the reason for an execution gate.

  9. Put the qualifier beside the claim it limits

    Bach states why an asymptotic result may fail to describe a practical sample size. Shalev-Shwartz and Ben-David identify which bound they prove and which tighter proof lies outside the book. Hardt and Recht separate an empirical result from a complete explanation; Murphy's advanced volume says why an estimator with attractive theory may underperform another in practice. An agent note should specify whether a statement is a theorem, a tested behavior of the companion code, an observation in a paper, or an unverified possibility at the point where the statement appears.

  10. Describe an algorithm by its contract and behavior

    The prose surrounding Phuong and Hutter's algorithms names what goes in, what comes out, and how masking changes the result. Mitchell describes how training examples change a learner's hypothesis before following the algorithmic trace. ISLP explains the role of a function argument while teaching a lab. In a graduate agent chapter, explain what a snippet receives, what state it may change, what it returns, and what failure it can expose. Repeating Python syntax line by line would obscure the contract.

  11. Choose a restrained voice and an unhurried cadence

    The accessible explanations in ISLP and Bishop leave room between a concrete observation and a general statement. Mohri's proofs and Telgarsky's notes show how much can be compressed, but their faster pace is a poor default for readers building an agent harness for the first time. The transferable editorial choice is to vary sentence length, keep one consequential claim per sentence, and use short sentences to land a result. This cadence is a synthesis for these notes, rather than a rule asserted by any one author. Avoid self-referential promises about what the chapter will do when the next object or question can provide the transition.

Original line-edit example: separate the mechanisms

Compressed: “A status read makes cancellation safe when the request has a revision and an idempotency key.”

Developed: “A status read supplies evidence that the order was unshipped when it was queried. The cancellation service checks the current revision before changing the order. An idempotency key addresses a different failure: a response may be lost after the change commits. Neither mechanism grants the agent permission to cancel. That permission comes from the user's authorization.”

This section analyzes prose mechanisms rather than imitating the source authors' language. Page references identify sampled passages; each recommendation for the agent notes is an editorial inference.

What the technical-writing guides add

The twelve PDFs establish the chapter's pedagogical depth and logical progression. Two writing guides sharpen the prose at sentence, paragraph, and evidence level. Their advice was read as guidance for scientific writing, then adapted to a graduate textbook whose subject includes probabilistic agents and executable systems.

Technical-writing guide

Tips and Guidance for Students and ECRs Writing Papers and Reports

Gernot Heiser · accessed 12 September 2026

Heiser's central editorial test is whether the reader has already been given the knowledge needed to understand the next sentence. He also asks for a clear point at sentence, paragraph, and section scale. His advice on concision, active voice, measurements, figures, acronyms, and references provides concrete checks on a draft.

Read the complete guide

Technical-writing guide

Guide to technical writing

Derek Abbott · accessed 12 September 2026

Abbott emphasizes a restrained scientific voice, exact vocabulary, consistent grammar, and figures and equations that function as parts of an argument. His distinctions between proof and empirical support, concrete and vague claims, and stable and historical tense are especially useful when agent-system claims span mathematics, experiments, and product documentation.

Read the complete guide

Rules adopted for these chapters

  1. Maintain the reader's knowledge state. Define a technical term or symbol before it does substantive work. State its domain, assumptions, and units when relevant. If two definitions depend on each other, give a short informal orientation before the formal pair. Restore context after a long gap, while keeping names stable.
  2. Give each paragraph a discernible purpose. A paragraph may state a claim, derive its mechanism, and explain its consequence. Separate those moves into sentences when each contains a distinct idea. Let the causal or logical need for the next paragraph supply the transition.
  3. Make agency and evidence explicit. Active voice identifies who proposes, authorizes, executes, or verifies an action. Passive voice remains useful when the actor has no bearing on the claim. Replace “better” or “significant” with a property, baseline, magnitude, and uncertainty where available. Reserve “prove” for a formal deduction; identify empirical observations as observations.
  4. Make mathematical prose grammatical. Define each symbol before an equation, punctuate displayed equations as parts of sentences, and explain the result in words. A figure caption should identify whether its content is theoretical, simulated, or measured, state the relevant conditions, and tell the reader what the comparison establishes.
  5. Use exact time and reference language. Present tense suits definitions and stable results; date historical or changing facts. Expand acronyms at first use. Replace “recently” and “later” with a date or a specific section when the reference matters. Keep spelling and punctuation consistent throughout the project.

Conflicts resolved for graduate agent-systems prose

TensionHouse rule
Brevity versus explanationRemove words that do no work. Keep the definition, crucial inference, interpretation, and limitation. The reader's request for a little more explanation takes precedence over a short-word-count ideal.
Paper structure versus textbook voiceUse informative titles and coherent sections. Do not impose a paper's abstract or section-length rules on a chapter. Avoid “this section will” narration when the subject itself supplies the transition.
Absolute word bans versus precise meaningAbbott discourages words such as “could,” “would,” “should,” and “belief.” Retain a modal when it conveys a defined possibility, counterfactual, or recommendation. Define a belief state as a probability distribution over possible states; do not use a personal belief as empirical evidence.
Typographic rules versus useful notationPrefer an English lead-in and avoid nested parentheses when they improve reading. Keep conventional, locally defined symbols and descriptive code identifiers rather than forcing single-letter names. Mark newly defined terms consistently; the definition matters more than italics or boldface.
Different national conventionsUse consistent US English and the Oxford comma for this project. Do not combine incompatible punctuation prescriptions from the two guides.

The five house rules and conflict decisions above are editorial adaptations, not quotations or claims that both authors endorse every resolution. The two guides are additional references; the twelve PDF portraits below retain their original source-specific scope.

What is distinctive in each reference

The portraits identify usable habits and a boundary for borrowing them. They describe sampled pages, not every chapter.

Theory textbook

Foundations of Machine Learning

Mehryar Mohri, Afshin Rostamizadeh, Ameet Talwalkar

Edition / version: Second edition (MIT Press, 2018). Source page

Begins a formal topic with questions, defines a learning model, gives theorem–proof–example sequences, and interprets sample-complexity bounds. Chapter notes and exercises connect the result to literature and extensions. Its deliberately succinct proofs are useful as a structural model; the agent notes should explain more of the intermediate reasoning.

Preface p. 14 · PAC setup p. 26 · Result and example p. 33

Concept-and-figure textbook

Pattern Recognition and Machine Learning

Christopher M. Bishop

Edition / version: 2006 Springer volume; no numbered edition is stated in this PDF. Source page

Introduces a running example before broadening to probability and decision theory. Figures and captions establish what variables mean before equations become demanding. A dedicated notation section makes conventions explicit. Bishop states that conveying concepts takes priority over maximal mathematical rigor; combine his pacing and visuals with fuller proofs from the theory texts.

Notation p. 11 · Curve fit p. 24 · Probability example p. 32

Unifying reference

Probabilistic Machine Learning: An Introduction

Kevin P. Murphy

Edition / version: MIT Press, 2022. This online PDF is dated 18 April 2025; no numbered edition is stated. Source page

Uses a probabilistic lens across topics, restates an equation in words, then tests it on a concrete numerical case. Later derivations connect formal properties to practical diagnostics. Examples, figures, code-generated plots, cross-references, and a notation appendix make a large reference navigable. For agent notes, the most valuable habit is the prose interpretation after each formal result.

Framing p. 31 · Bayes example p. 76 · Derivation p. 342

Advanced reference

Probabilistic Machine Learning: Advanced Topics

Kevin P. Murphy

Edition / version: MIT Press, 2023. This online PDF is dated 10 December 2025; no numbered edition is stated. Source page

Defines advanced objects systematically, often with a small example before a more general model. Causal graphs and optimization figures accompany derivations; selected sections close with practical advice. Use this as a depth and cross-reference model for topics such as partial observability or causal evaluation, while keeping local definitions in each chapter.

Probability setup p. 39 · Causal example p. 247 · Practical advice p. 1241

Statistical methods textbook

The Elements of Statistical Learning

Trevor Hastie, Robert Tibshirani, Jerome Friedman

Edition / version: Second edition (2009), corrected 12th printing of 13 January 2017. Source page

Defines a prediction problem through scientific examples, then compares methods by the assumptions they impose and the errors they incur. Data examples and exercises make the contrast concrete. Its technical prose can be dense. Borrow the comparative method and empirical figures, but unpack the bridges between assumptions and conclusions for this audience.

Applications p. 20 · Method contrast p. 30 · Exercises p. 58

Applied textbook

An Introduction to Statistical Learning with Applications in Python

Gareth James, Daniela Witten, Trevor Hastie, Robert Tibshirani, Jonathan Taylor

Edition / version: Python edition; first printing dated 5 July 2023. Source page

Starts with recognizable data sets and visible patterns, explains concepts before equations, then gives labs with executable Python and displayed output. Exercises distinguish conceptual understanding from application. Its accessible cadence is valuable for agent-development labs; the mathematical depth of the agent notes should remain above its introductory level.

Data-first opening p. 12 · Figure interpretation p. 27 · Lab p. 125

First-principles theory

Learning Theory from First Principles

Francis Bach

Edition / version: Author PDF dated 26 May 2025; no numbered edition is stated. Source page

Starts by asking why the theory matters, provides chapter summaries and prerequisites, and carries assumptions through detailed derivations. It discusses what asymptotic results cannot tell us about finite problems. Adopt its explicit assumption ledger and limiting-case discussion. Add worked agent traces when a proof would otherwise float free of the system being modeled.

Motivation p. 11 · Chapter map p. 19 · Limitation p. 123

Algorithms-and-practice textbook

Machine Learning

Tom M. Mitchell

Edition / version: McGraw-Hill, 1997; no numbered edition is stated. Source page

Frames machine learning through problems, algorithms, assumptions, and the balance of theory with practice. Definitions and traces are developed on concrete tasks, while exercises vary the task or order of examples. Borrow the progressive algorithm trace. Do not import dated examples or treat historical implementation details as current practice.

Preface p. 3 · Formalization p. 35 · Trace exercise p. 60

Historical-conceptual monograph

Patterns, Predictions, and Actions

Moritz Hardt, Benjamin Recht

Edition / version: 2022 print book; online preprint compiled 8 June 2026. No numbered online edition is stated. Source page

Uses a historical episode to establish why a prediction problem matters, then develops formal criteria and follows their consequences for decisions. Later empirical examples are set beside unresolved theoretical explanations. Borrow the connection from mechanism to social or operational consequence. Use historical framing sparingly when it would delay an agent chapter's main argument.

Historical opening p. 11 · Formal criterion p. 33 · Evidence boundary p. 116

Formal learning textbook

Understanding Machine Learning: From Theory to Algorithms

Shai Shalev-Shwartz, Shai Ben-David

Edition / version: Cambridge, 2014 author PDF; no numbered edition is stated. Its pagination differs from print. Source page

Moves from a concrete classification problem to a formal model, precise quantifiers, theorem statements, and proofs. The reader can see exactly which assumptions a guarantee needs. When the strongest proof needs more machinery, the text identifies the looser result it actually proves. This is the clearest model for formal agent claims, provided every symbol receives local explanation.

Motivating task p. 33 · Definition p. 43 · Proof boundary p. 392

Theory lecture notes

Deep Learning Theory Lecture Notes

Matus Telgarsky

Edition / version: Version 2021-10-27 v0.0-e7150f2d (alpha); lecture notes, not a numbered textbook edition. Source page

Names its chosen theoretical perspective, its weaknesses, and topics it omits. Short propositions and remarks show a route to simplified proofs. The sampled version also contains draft markers and unfinished sections. Use the honesty about scope and the proof simplification; do not imitate the shorthand or unfinished editorial state.

Scope and weaknesses p. 3 · Proposition p. 15 · Draft marker p. 63

Short technical paper · not a textbook

Formal Algorithms for Transformers

Mary Phuong, Marcus Hutter

Edition / version: arXiv version 1, dated 19 July 2022; a paper, not a textbook edition. Source page

Responds to vague architectural descriptions with formal pseudocode. Algorithms state inputs, outputs, parameters, and dimensions; a notation appendix collects symbols. This is a strong model for a tool or harness contract. As a 16-page paper, it moves too quickly to supply the narrative and exercises needed in graduate lecture notes.

Purpose p. 1 · Pseudocode p. 5 · Notation p. 16

A house style for the agent lecture notes

The following sequence preserves the transcript as the topic spine without making the prose a recount of the class. Video timestamps can remain in section headings; the chapter body should read as an independent textbook chapter.

  1. Open with a task and its consequence. Describe a specific agent decision or failure in a few paragraphs. Identify what the user wants and what an incorrect action would change.
  2. Define the objects of study. Introduce the environment state, observations, history, available actions, permission state, and outcome measure. Define each technical term and symbol before its first substantive use.
  3. State the assumptions and claim. Separate a formal guarantee from a heuristic design rule and from a product-specific observation. Say which source or experiment supports an empirical claim.
  4. Derive the mechanism. Give intermediate equations or transition steps. Explain what each term contributes. Include a limiting case, counterexample, or numerical check where it clarifies the result.
  5. Work the original task through the model. Show a short trace, code fragment, diagram, or table. Inspect both a successful path and a path involving uncertainty, stale information, or partial failure.
  6. Compare alternatives. State what changes when the tool surface, context policy, memory store, or verifier changes. Compare success, cost, delay, and risk separately rather than hiding them in one score.
  7. Close with limits and exercises. Identify what the model leaves out, which facts remain unsettled, and what evidence would test the proposed design. Include derivation, diagnosis, and design exercises.
Example of the preferred prose rhythm

Compressed: “Evaluation should report the vector (S, C, D, R), not collapse everything into a single leaderboard rank.”

Expanded: “Let S measure task success, C resource cost, D delay, and R risk. Report these four quantities separately. A system that improves success by doubling cost may be desirable in one application and unacceptable in another. A single rank hides the information needed to make that decision.”

Limits and cautions

TemptationEditorial decision
Copy the shortest proof styleKeep theorem structure and precision, but show intermediate steps and an interpretation. Mohri explicitly favors succinctness; your stated preference favors a little more room.
Copy an introductory voice wholesaleUse ISLP's examples and labs while retaining graduate-level models, quantifiers, and failure analysis.
Let code replace explanationUse Phuong–Hutter-style contracts and executable snippets after the model is introduced. Explain what the code guarantees and what it only attempts.
Use theory as an unqualified product claimMark assumptions and evidence. A theorem about an idealized policy, a benchmark result, and a provider's implementation documentation answer different questions.
Imitate distinctive wording or page designBorrow pedagogical structure, not source prose, diagrams, or typography. The report paraphrases the references and links to freely accessible online editions for inspection.

The links target freely shared online copies of the supplied editions. PDF-viewer page numbers were checked against the collected files. Google Drive opens ISLP and ESL in its PDF viewer and may not honor a page fragment. The Hebrew University author PDF is listed on the MIT reading list; its host returned a security page during automated verification. This report does not copy or redistribute any PDFs.