Unit 1: Interaction of Electromagnetic Radiation with Matter & Practical Foundations

Electromagnetic radiation constitutes propagating oscillating electric and magnetic fields governed by Maxwell's equations. In a vacuum, radiation propagates at speed \(c = 2.99792458 \times 10^8\text{ m/s}\). The relationship between frequency \(\nu\) (Hz), wavelength \(\lambda\) (m), and spectroscopic wavenumber \(\tilde{\nu}\) (\(\text{cm}^{-1}\)) is given by:

Energy quantization formalizes radiation as discrete energy packets (photons) carrying energy \(E = h\nu = \hbar\omega = hc\tilde{\nu}\), where Planck's constant \(h = 6.62607015 \times 10^{-34}\text{ J}\cdot\text{s}\) and \(\hbar = h / (2\pi) = 1.0545718 \times 10^{-34}\text{ J}\cdot\text{s}\).

Spectroscopic Regions of the Electromagnetic Spectrum

The electromagnetic spectrum spans diverse physical domains, each probing distinct quantum mechanical transitions within molecular systems:

Understanding these distinct energetic regimes establishes the foundation for assigning spectral lines to microscopic quantum Hamiltonians.

Advanced Quantum Theoretical Foundation: Second Quantization of the Radiation Field

To derive the spontaneous and stimulated transition rates from first principles without semi-classical approximations, the electromagnetic radiation field must be treated as a quantized dynamical system.

1. Quantized Vector Potential

In the Coulomb gauge (\(\nabla \cdot \mathbf{A} = 0\)), the vector potential operator \(\hat{\mathbf{A}}(\mathbf{r}, t)\) expanded over plane-wave spatial modes with wavevector \(\mathbf{k}\) and polarization unit vectors \(\boldsymbol{\epsilon}_{\mathbf{k},\lambda}\) (\(\lambda \in \{1, 2\}\)) is expressed in second-quantized form as: \[ \hat{\mathbf{A}}(\mathbf{r}) = \sum_{\mathbf{k}, \lambda} \sqrt{\frac{\hbar}{2 \epsilon_0 \omega_k V}} \left( \hat{a}_{\mathbf{k},\lambda} \boldsymbol{\epsilon}_{\mathbf{k},\lambda} e^{i \mathbf{k} \cdot \mathbf{r}} + \hat{a}_{\mathbf{k},\lambda}^\dagger \boldsymbol{\epsilon}_{\mathbf{k},\lambda}^* e^{-i \mathbf{k} \cdot \mathbf{r}} \right) \] where \(V\) is the quantization cavity volume, \(\omega_k = c|\mathbf{k}|\), and \(\hat{a}_{\mathbf{k},\lambda}\), \(\hat{a}_{\mathbf{k},\lambda}^\dagger\) are the bosonic annihilation and creation operators obeying canonical commutation relations: \[ [\hat{a}_{\mathbf{k},\lambda}, \hat{a}_{\mathbf{k}',\lambda'}^\dagger] = \delta_{\mathbf{k},\mathbf{k}'} \delta_{\lambda,\lambda'}, \quad [\hat{a}_{\mathbf{k},\lambda}, \hat{a}_{\mathbf{k}',\lambda'}] = 0 \]

2. Radiation Field Hamiltonian and Fock States

The free electromagnetic Hamiltonian corresponds to an infinite set of decoupled harmonic oscillators: \[ \hat{H}_{\text{rad}} = \sum_{\mathbf{k},\lambda} \hbar \omega_k \left( \hat{a}_{\mathbf{k},\lambda}^\dagger \hat{a}_{\mathbf{k},\lambda} + \frac{1}{2} \right) \] Its eigenstates are Fock number states \(|n_{\mathbf{k},\lambda}\rangle\), with eigenvalues: \[ E_{\text{rad}} = \sum_{\mathbf{k},\lambda} \hbar \omega_k \left( n_{\mathbf{k},\lambda} + \frac{1}{2} \right) \] Even in the vacuum state \(|0\rangle\) (\(n_{\mathbf{k},\lambda} = 0\)), the vacuum zero-point energy density \(\frac{1}{2}\hbar\omega_k\) induces vacuum fluctuations: \[ \langle 0 | \hat{\mathbf{E}}^2 | 0 \rangle = \sum_{\mathbf{k},\lambda} \frac{\hbar \omega_k}{2 \epsilon_0 V} \neq 0 \] These vacuum electromagnetic fluctuations are the physical driving force behind spontaneous emission.

3. Interaction Hamiltonian and Fermi's Golden Rule

For a molecular system with charged particles \(q_j\) and momenta \(\hat{\mathbf{p}}_j\), the total minimal-coupling Hamiltonian is: \[ \hat{H} = \sum_j \frac{1}{2m_j} [\hat{\mathbf{p}}_j - q_j \hat{\mathbf{A}}(\hat{\mathbf{r}}_j)]^2 + \hat{V}_{\text{Coulomb}} + \hat{H}_{\text{rad}} = \hat{H}_{\text{matter}} + \hat{H}_{\text{rad}} + \hat{H}_{\text{int}} \] To first order in \(\hat{\mathbf{A}}\): \[ \hat{H}_{\text{int}} = -\sum_j \frac{q_j}{m_j} \hat{\mathbf{A}}(\hat{\mathbf{r}}_j) \cdot \hat{\mathbf{p}}_j \] In the electric dipole approximation (\(e^{i \mathbf{k}\cdot\mathbf{r}} \approx 1\)), this interaction reduces via the Heisenberg equation of motion \(\hat{\mathbf{p}} = \frac{m}{i\hbar}[\hat{\mathbf{r}}, \hat{H}_0]\) to the electric dipole interaction: \[ \hat{H}_{\text{int}}^{\text{dipole}} = -\hat{\boldsymbol{\mu}} \cdot \hat{\mathbf{E}} \] Applying Fermi's Golden Rule for the transition from initial joint state \(|i\rangle = |\psi_e, n_{\mathbf{k},\lambda}\rangle\) to final state \(|f\rangle = |\psi_g, n_{\mathbf{k},\lambda} + 1\rangle\): \[ W_{i \rightarrow f} = \frac{2\pi}{\hbar} |\langle f | \hat{H}_{\text{int}} | i \rangle|^2 \rho(E_f) \] Since \(\langle n+1 | \hat{a}^\dagger | n \rangle = \sqrt{n+1}\), the squared transition matrix element factors into: \[ |\langle f | \hat{H}_{\text{int}} | i \rangle|^2 \propto |\langle \psi_g | \hat{\boldsymbol{\mu}} \cdot \boldsymbol{\epsilon} | \psi_e \rangle|^2 \times (n_{\mathbf{k},\lambda} + 1) \]

• The term proportional to \(n_{\mathbf{k},\lambda}\) describes stimulated emission (rate strictly dependent on ambient photon density).
• The term proportional to \(1\) describes spontaneous emission (persisting even when \(n_{\mathbf{k},\lambda} = 0\)).

Integrating over the continuous density of vacuum radiation states in three dimensions: \[ \rho(\omega) d\omega = \frac{V \omega^2}{\pi^2 c^3} d\omega \] directly produces Einstein's spontaneous emission rate: \[ A_{eg} = \frac{\omega_{eg}^3 |\boldsymbol{\mu}_{ge}|^2}{3 \pi \epsilon_0 \hbar c^3} \] which proves Einstein's \(A\) and \(B\) coefficient relationship purely from quantum electrodynamic principles.

In 1917, Albert Einstein formulated the thermodynamic and kinetic equilibrium between matter and radiation fields by defining three transition rate coefficients for a two-level quantum system with lower state \(|1\rangle\) (energy \(E_1\)) and upper state \(|2\rangle\) (energy \(E_2\)), where \(\nu_{12} = (E_2 - E_1)/h\):

1. Induced (Stimulated) Absorption: Transition rate from state 1 to 2 stimulated by spectral energy density \(\rho(\nu)\): \[ \left(\frac{dN_{1\to 2}}{dt}\right)_{\text{abs}} = B_{12} N_1 \rho(\nu) \]
2. Spontaneous Emission: Transition rate from state 2 to 1 occurring spontaneously without external radiation: \[ \left(\frac{dN_{2\to 1}}{dt}\right)_{\text{spont}} = A_{21} N_2 \]
3. Stimulated Emission: Transition rate from state 2 to 1 driven by the external field \(\rho(\nu)\): \[ \left(\frac{dN_{2\to 1}}{dt}\right)_{\text{stim}} = B_{21} N_2 \rho(\nu) \]

Derivation of Einstein Relations

At thermal equilibrium at temperature \(T\), the principle of detailed balance requires that the total rate of upward transitions matches the total rate of downward transitions:

Solving for the radiation energy density \(\rho(\nu)\) yields:

According to the Maxwell-Boltzmann distribution, the ratio of populations of states with degeneracies \(g_1\) and \(g_2\) is:

Substituting into the expression for \(\rho(\nu)\):

Comparing this directly with Planck's blackbody radiation law:

Equating coefficients requires two rigorous equalities:

The \(\nu^3\) dependence reveals why spontaneous emission is negligible in the microwave and radiofrequency regimes (\(A_{21} \ll B_{21}\rho\)), whereas in visible and UV spectroscopy, spontaneous emission dominates radiative relaxation.

The interaction Hamiltonian between an electromagnetic plane wave polarized along \(\hat{e}\) and molecular charges is formulated in the electric dipole approximation as \(\hat{H}'(t) = -\hat{\vec{\mu}} \cdot \vec{E}(t)\), where \(\hat{\vec{\mu}} = \sum_i q_i \vec{r}_i\) is the electric dipole operator.

Using time-dependent perturbation theory, Fermi's Golden Rule defines the transition probability per unit time \(W_{fi}\) between initial state \(|\psi_i\rangle\) and final state \(|\psi_f\rangle\):

Transition Dipole Moment Integral

The transition dipole moment vector \(\vec{\mu}_{fi}\) is defined explicitly as:

Spectral intensity is proportional to the square of the transition moment, \(I_{fi} \propto |\vec{\mu}_{fi}|^2\). A transition is defined as electric dipole allowed if and only if:

If \(\vec{\mu}_{fi} = 0\), the transition is forbidden in the electric dipole approximation, though it may occur weakly through higher-order interactions such as magnetic dipole or electric quadrupole moments.

Einstein B-Coefficient from Quantum Mechanics

Averaging over all isotropic molecular orientations in space, the quantum mechanical expression for the Einstein absorption coefficient is:

The dimensionless oscillator strength \(f_{12}\), characterizing the classical electron oscillator equivalent of the quantum transition, is defined as:

The Thomas-Reiche-Kuhn sum rule states that for an \(N\)-electron system, \(\sum_f f_{fi} = N\).

An ideal spectroscopic transition between two perfectly sharp quantum states would produce an infinitely sharp Dirac delta function line. In real physical systems, every spectral transition possesses finite width described by a line shape function \(g(\nu)\), normalized such that \(\int_0^\infty g(\nu)d\nu = 1\).

1. Natural (Lifetime) Broadening

According to the Heisenberg energy-time uncertainty principle, a state with finite lifetime \(\tau\) has an uncertainty in energy \(\Delta E\):

If state 2 has lifetime \(\tau_2\) and state 1 has lifetime \(\tau_1\), the total damping rate is \(\gamma = \frac{1}{\tau_1} + \frac{1}{\tau_2}\). The resulting spectral profile is a Lorentzian line shape:

The Full Width at Half Maximum (FWHM) of a Lorentzian line is \(\Delta \nu_{\text{FWHM}} = \Gamma = \frac{\gamma}{2\pi}\). For an excited electronic state with spontaneous radiative lifetime \(\tau \sim 10\text{ ns}\), \(\Delta \nu_{\text{nat}} \approx 16\text{ MHz}\) (\(5 \times 10^{-4}\text{ cm}^{-1}\)).

2. Collisional (Pressure) Broadening

In gases, collisions between molecules interrupt the phase of the emitted or absorbed radiation wave train. If the mean time between collisions is \(\tau_{\text{coll}}\), the effective lifetime decreases:

Kinetic theory gives the collision frequency \(z_{\text{coll}} = \sqrt{2} \pi d^2 \bar{v} n\), where \(d\) is the collision diameter, \(\bar{v} = \sqrt{\frac{8 k_B T}{\pi m}}\) is the average molecular speed, and \(n = P / (k_B T)\) is number density. Collisional broadening also yields a Lorentzian profile with FWHM proportional to pressure \(P\): \(\Delta \nu_{\text{coll}} \propto P\).

In gas-phase spectroscopy, molecules move randomly with a Maxwell-Boltzmann velocity distribution. A molecule moving with velocity component \(v_z\) along the line of sight of radiation of frequency \(\nu_0\) experiences a Doppler shift:

The one-dimensional Maxwell-Boltzmann velocity distribution is given by:

Gaussian Doppler Line Shape

Substituting \(v_z = c(\nu - \nu_0)/\nu_0\) into the velocity distribution yields the Gaussian Doppler line shape function:

The peak height occurs at \(\nu = \nu_0\). The Full Width at Half Maximum (FWHM) \(\Delta \nu_D\) is obtained where \(g_D(\nu) = \frac{1}{2} g_D(\nu_0)\):

Expressed in terms of molar mass \(M = N_A m\) and gas constant \(R = N_A k_B\):

The Voigt Profile

When both homogeneous (Lorentzian, FWHM \(\Gamma\)) and inhomogeneous (Gaussian, FWHM \(\Delta\nu_D\)) broadening mechanisms are significant, the observed spectral line is the convolution of both distributions, known as the Voigt profile:

The Voigt profile exhibits a Gaussian core near the line center with extended Lorentzian wings (tails) decaying as \((\nu - \nu_0)^{-2}\).

Because Doppler broadening frequently obscures fine and hyperfine structures in gas-phase spectroscopy, specialized non-linear laser techniques have been developed to eliminate Doppler broadening entirely.

1. Saturated Absorption & The Lamb Dip

Consider two counter-propagating laser beams (a strong 'pump' beam and a weak 'probe' beam) traversing a gas cell at frequency \(\nu\):

• If \(\nu \neq \nu_0\), the pump beam interacts only with molecules having velocity \(v_z = c(\nu - \nu_0)/\nu_0\), burning a 'hole' in the ground state velocity distribution. The probe beam travels in the opposite direction and interacts with molecules having velocity \(-v_z\), thus seeing an unperturbed population.
• If \(\nu = \nu_0\), both beams interact simultaneously with the same velocity group: molecules with \(v_z = 0\) (zero longitudinal velocity). The intense pump beam bleaches/saturates the absorption for these stationary molecules. Consequently, the probe beam experiences sharply reduced absorption, producing a transmission spike at \(\nu = \nu_0\) known as the Lamb dip.

The linewidth of the Lamb dip is governed solely by the homogeneous Lorentzian width \(\Gamma_{\text{hom}} \ll \Delta\nu_D\), enabling ultra-high resolution frequency standards.

2. Doppler-Free Two-Photon Spectroscopy

When an atomic or molecular transition occurs via the simultaneous absorption of two photons from counter-propagating laser beams with identical frequency \(\omega\):

The linear Doppler shifts identically cancel for all velocity classes \(v_z\)! Every molecule in the gas cell absorbs at exactly \(2\omega = (E_f - E_i)/\hbar\), producing a Doppler-free absorption resonance whose resolution is limited only by the natural radiative lifetime.

The fidelity and quantitative accuracy of any spectroscopic measurement depend fundamentally on the Signal-to-Noise ratio (\(S/N\)) and the instrumental resolving power \(R\).

Signal-to-Noise Ratio (S/N) & Averaging

In repeated experimental measurements consisting of \(N\) independent co-added spectral scans, the signal accumulates coherently while random (uncorrelated) noise accumulates in quadrature:

Thus, improving the \(S/N\) ratio by a factor of 10 requires averaging \(N = 100\) scans.

Noise Sources in Practical Spectroscopy

1. Johnson-Nyquist (Thermal) Noise: Voltage fluctuations in resistive detector circuits: \(\sigma_V = \sqrt{4 k_B T R \Delta f}\), where \(\Delta f\) is the measurement bandwidth.
2. Shot Noise: Quantum fluctuations in discrete photon arrival: \(\sigma_{\text{shot}} = \sqrt{2 e I \Delta f}\). Shot-noise-limited detection obeys Poisson statistics: \(S/N = \sqrt{N_{\text{photons}}}\).
3. Flicker (\(1/f\)) Noise: Low-frequency instrumental drift, eliminated using lock-in amplification and high-frequency phase modulation.

Chromatic Resolving Power

The resolving power \(R\) of a spectrometer characterizes its ability to distinguish two adjacent spectral lines separated by \(\Delta \lambda\):

For a diffraction grating of width \(W\) and groove density \(N_{\text{total}}\) operated in diffraction order \(m\), the theoretical resolving power is \(R = m N_{\text{total}}\). For a prism of base length \(b\), \(R = b \left|\frac{dn}{d\lambda}\right|\).

Advanced Research Monograph: Synchrotron Radiation and X-ray Free-Electron Lasers (XFEL)

While laboratory spectrometers utilize benchtop thermal filaments or hollow-cathode discharge lamps, modern frontier spectroscopy relies on accelerator-based relativistic light sources.

1. Synchrotron Radiation Generation

When relativistic electrons with Lorentz factor \(\gamma = \frac{E_e}{m_e c^2} \gg 1\) are accelerated transversely along circular storage rings by magnetic bending dipoles or periodic undulator magnetic arrays (magnetic period \(\lambda_u\)), the emitted dipole radiation is compressed relativistically into a narrow forward cone of opening angle: \[ \theta \approx \frac{1}{\gamma} \ll 1\text{ rad} \] The fundamental wavelength emitted on-axis by an undulator with deflection parameter \(K = \frac{e B_0 \lambda_u}{2\pi m_e c}\) is: \[ \lambda = \frac{\lambda_u}{2\gamma^2} \left( 1 + \frac{K^2}{2} \right) \] Because \(\gamma \sim 10^3 - 10^4\) (GeV electron energies), centimeter-scale magnetic periods translate into vacuum ultraviolet (VUV) and hard X-ray radiation of unprecedented brilliance: \[ \text{Brilliance} = \frac{\text{Photons / second}}{(\text{mrad})^2 \cdot (\text{mm}^2) \cdot (0.1\% \text{ bandwidth})} > 10^{20} \]

2. X-ray Free-Electron Lasers (XFEL) and SASE Lasing

In an X-ray Free-Electron Laser (such as the European XFEL or LCLS at SLAC), high-brightness electron bunches traverse hundreds of meters of undulators. Through the Self-Amplified Spontaneous Emission (SASE) mechanism, the interaction of the electrons with their own emitted radiation field induces longitudinal microbunching on the scale of the X-ray wavelength.

• This creates macroscopic coherent superposition where \(N\) electrons radiate in phase:

\[ I_{\text{SASE}} \propto N^2 \gg N \]

• Peak brilliance exceeds third-generation synchrotrons by nine orders of magnitude (\(10^{33}\)).
• Pulse durations shrink to femtosecond and attosecond regimes (\(10 - 100\text{ fs}\)), shorter than the timescale of nuclear vibrational motion (\(\sim 10 - 100\text{ fs}\)).

3. "Diffraction Before Destruction" and Ultrafast Chemical Dynamics

XFEL spectroscopy enables serial femtosecond crystallography (SFX) and ultrafast time-resolved X-ray absorption spectroscopy (TR-XAS):

• By delivering pulses containing \(\sim 10^{12}\) coherent X-ray photons in a 20-fs burst, a complete diffraction and absorption pattern is recorded before Coulomb explosion disrupts the atomic coordinates.
• This allows researchers to capture real-time transition states during chemical bond breaking, such as the photolysis of iron pentacarbonyl and the oxygen-evolving catalytic cycle of Photosystem II at room temperature.

Modern infrared and far-infrared spectrometers operate almost universally on the Fourier Transform (FT) principle using a Michelson interferometer rather than dispersive gratings. The Michelson interferometer divides an incident beam using a beamsplitter into two arms: one terminating on a fixed mirror and the other on a moving mirror translated at constant velocity \(v\).

Optical Retardation & The Interferogram

The optical path difference between the two beams is the retardation \(\delta = 2(x_{\text{moving}} - x_{\text{fixed}})\). When the beams recombine at the beamsplitter, constructive and destructive interference modulates the transmitted intensity. For monochromatic radiation of wavenumber \(\tilde{\nu}\), the detector records an oscillating signal:

For a polychromatic broadband source, the total interferogram \(I(\delta)\) is the integral over all spectral wavenumbers:

At zero optical path difference (\(\delta = 0\)), all frequencies interfere constructively, creating an intense central spike known as the Centerburst. At large retardation, the waves rapidly dephase, leaving weak oscillations that encode high-resolution spectral details.

The Fourier Inversion & Instrumental Line Shape

The frequency spectrum \(S(\tilde{\nu})\) is reconstructed via the cosine Fourier transform:

In practice, the mirror cannot travel to infinity; the interferogram is truncated at maximum retardation \(\pm \delta_{\max}\). Truncation is mathematically equivalent to multiplying the infinite interferogram by a rectangular boxcar function \(\Pi(\delta)\). In the frequency domain, this convolves the true spectrum with a sinc function instrumental line shape (ILS):

The sinc function possesses substantial secondary lobes ('side-lobes') with negative amplitudes of \(-21.7\%\), which create false ringing artifacts near intense absorption bands.

Apodization Functions & Phase Correction

To suppress side-lobes, the interferogram is multiplied by an apodization function \(A(\delta)\) (from the Greek apodos, 'removing the foot') that smoothly rolls off to zero at \(\delta_{\max}\):

• Triangular Apodization: \(A(\delta) = 1 - \frac{|\delta|}{\delta_{\max}}\), yielding an \(\text{sinc}^2\) profile with side-lobes reduced to \(< 5\%\), at the cost of a slight broadening of the FWHM.
• Happ-Genzel Apodization: \(A(\delta) = 0.54 + 0.46 \cos\left(\frac{\pi \delta}{\delta_{\max}}\right)\).
• Blackman-Harris 3-Term: Optimal side-lobe suppression below \(0.01\%\).

Phase errors caused by electronic amplifier delays and beamsplitter dispersion are numerically corrected using the Mertz or Forman phase-correction algorithms, yielding pristine absorption spectra.