Overview: Where Nature Finds Balance

Static Problems & Quadrature | Numerical Methods Module 2 | COMP 536: Modeling the Universe

The Big Picture: Learning Equilibrium Through Mathematics

A Story That Changes Everything

In 1687, Isaac Newton posed what seemed like a simple question: where between Earth and Moon could an object remain stationary? His newly-minted theory of gravitation suggested such points must exist — places where gravitational attractions perfectly balance. But finding them required solving an equation that defied all attempts at algebraic solution.

For nearly a century, the greatest mathematical minds struggled with this “restricted three-body problem.” Then in 1772, Joseph-Louis Lagrange had a profound insight: instead of trying to solve the equations analytically (impossible!), he could find where forces balanced numerically. His systematic approach revealed five special points — the Lagrange points — where spacecraft could hover with minimal fuel.

But here’s the key: Lagrange didn’t just find these points; he developed the mathematical machinery to find any equilibrium in any system. His methods for finding roots of equations and integrating complex functions became the foundation of computational physics. Today, the James Webb Space Telescope sits at Earth’s L2 Lagrange point, its position calculated using the very methods Lagrange pioneered.

This is the heart of what you’re about to learn: finding where nature balances and measuring cosmic quantities—the two fundamental operations that underlie all of computational astrophysics.

Your Mission: Master the Mathematics of Balance and Measurement

You’re about to discover that the cosmos is filled with equilibrium points and measurable quantities:

• Where does fusion balance gravity in stars? Root finding reveals stellar cores
• How much energy does a galaxy radiate? Integration across the spectrum
• Where can spacecraft orbit with minimal fuel? Finding Lagrange points
• What’s the total mass of a dark matter halo? Integrating density profiles

But here’s the kicker: these aren’t separate problems — they’re all applications of two fundamental operations: finding zeros (root finding) and measuring areas (quadrature). Master these, and you can solve virtually any static problem in astrophysics.

Why This Matters Now More Than Ever

Modern astronomy runs on finding equilibria and computing integrals:

• JWST orbit maintenance requires solving for L2 position to nanometer precision
• Gravitational wave templates need millions of orbit integrations
• Dark energy surveys integrate luminosity functions over billions of galaxies
• Exoplanet transits require precise integration of light curves
• Neural network training is fundamentally root finding on gradient functions

You NEED these methods to do modern astrophysics. This module ensures you understand not just which scipy function to call, but why methods work, when they fail, and how to fix them.

Quick Navigation Guide

🎯 Choose Your Learning Path

🏃 Fast Track

Essential concepts only

• Bisection basics
• Newton’s method
• Trapezoidal rule
• Monte Carlo essentials

🚶 Standard Path

Full conceptual understanding

Everything in Fast Track, plus:

• Convergence analysis
• Simpson’s rule
• Error analysis
• Method selection
• All “Check Your Understanding” boxes

🧗 Complete Path

Deep dive with all details

Complete module including:

• All mathematical derivations
• Secant method
• Gaussian quadrature
• Richardson extrapolation
• Hybrid methods
• All worked examples

🎯 Navigation by Project Needs

TipQuick Jump to What You Need by Project

For Project 2 (N-body Dynamics): - Kepler’s equation - Finding orbital positions - Finding perihelion/aphelion - Root finding on radial velocity - Orbital period integration - Computing orbital periods - Energy conservation checks - Verifying numerical accuracy

For Project 3 (Monte Carlo Radiative Transfer): - Monte Carlo fundamentals - High-dimensional integration - Understanding dimensions - What “dimension” means - Error scaling - Why \(N^{-1/2}\) convergence - Optical depth boundaries - Finding where τ = 1

For Project 4 (MCMC): - Finding posterior modes - Maximum likelihood via Newton - Integration of posteriors - Normalizing distributions - Credible intervals - Finding probability boundaries - Proposal tuning - Optimizing acceptance rates

For Project 5 (Gaussian Processes): - Kernel integration - Computing covariances - Hyperparameter optimization - Finding maxima - Gaussian quadrature - Optimal sampling - Condition numbers - Matrix stability

For Final Project (Neural Networks): - Gradient descent - Root finding on \(\nabla\)L - Loss integration - Batch averaging - Learning rate selection - Convergence conditions - Backpropagation - Chain rule as Newton iteration

Note💭 Why This Module Exists: A Personal Note from Your Instructor

This module has a secret mission: teaching you that computational physics isn’t about memorizing algorithms — it’s about understanding the deep mathematical principles that make computation possible.

I’ve seen too many students use scipy.optimize.root_scalar or scipy.integrate.quad as black boxes, then panic when: - Their root finder diverges on a “simple” equation - Integration gives wildly different answers with different methods - Monte Carlo takes forever to converge

What makes this different: We build every method from first principles. When you see Newton’s method, you won’t just memorize \(x_{n+1} = x_n - f(x_n)/f'(x_n)\). You’ll understand it as following tangent lines, see exactly when it fails (and why!), and know how to fix it.

The revelation students have: - Wait, integration and root finding are inverse operations? Yes! - Monte Carlo beats everything in high dimensions? Exactly! - Newton’s method IS gradient descent? Now you’re thinking!

This module makes those connections explicit from the start.

Here’s what these methods actually are: the mathematical bridges between continuous physics and discrete computation. The same Newton’s method that finds Lagrange points also trains neural networks. The same Monte Carlo that integrates high-dimensional spaces also simulates photon transport.

By the end, you’ll understand not just the formulas but the deep principles: why bracketing guarantees success, why high-order isn’t always better, and how the curse of dimensionality changes everything. These aren’t separate topics — they’re all facets of one beautiful framework that spans from finding planetary orbits to training AI models.

Mathematical Foundations

Important📖 Core Notation and Concepts

Before diving in, let’s establish the mathematical language for static problems:

Root Finding Notation

Symbol	Meaning	Physical Example
\(f(x) = 0\)	Equation to solve	Hydrostatic equilibrium
\(x^*\) or \(r\)	Root/zero of function	Stellar radius
\([a,b]\)	Bracketing interval	Search region
\(\epsilon\)	Tolerance	Desired accuracy
\(e_n = x_n - r\)	Error at iteration n	Distance from true root

Integration Notation

Symbol	Meaning	Physical Example
\(\int_a^b f(x)dx\)	Definite integral	Total luminosity
\(w_i\)	Quadrature weights	Sample contributions
\(x_i\)	Quadrature points	Where to evaluate
\(h\)	Step size	Wavelength spacing
\(O(h^p)\)	Error order	Convergence rate

Key Relationships

Root Finding Convergence Rates: - Linear: \(e_{n+1} = Ce_n\) (bisection) - Superlinear: \(e_{n+1} = Ce_n^{1.618}\) (secant) - Quadratic: \(e_{n+1} = Ce_n^2\) (Newton)

Integration Error Scaling: - Trapezoidal: \(E \propto h^2\) - Simpson: \(E \propto h^4\) - Monte Carlo: \(E \propto N^{-1/2}\) (dimension-independent!)

Why This Matters: Every cosmic calculation reduces to these operations. When you compute a galaxy’s mass, you’re integrating density. When you find where a star’s fusion balances gravity, you’re finding roots. Master these principles once, apply them everywhere.

Module Contents

Part 1: Root Finding - Where Physics Reaches Equilibrium

Learn three fundamental approaches to finding zeros: bracketing (bisection), tangent following (Newton), and interpolation (secant). Discover why different methods excel in different situations and how to combine them for robustness. Apply these to Kepler’s equation, Lagrange points, and stellar structure.

Part 2: Quadrature - From Photon Counts to Dark Matter Halos

Master the art of numerical integration from simple rectangles to sophisticated Simpson’s rule. Understand when Monte Carlo dominates (high dimensions!) and why. Learn to choose methods based on smoothness, dimension, and computational budget.

Part 3: Synthesis - The Deep Connections

Discover how root finding and integration are mathematical inverses. See the universal patterns in convergence, understand condition numbers across all methods, and develop intuition for method selection. Build your personal computational toolkit.

---

Ready to begin? Let’s start with Part 1 and discover how to find where physics reaches equilibrium — from stellar cores to spacecraft orbits!