Finite Impulse Response (FIR) Filter Design: Windowing and Parks-McClellan Optimal Remez

Unit 5, Lesson 1: Stochastic processes and stationarity

Unit theme: Statistical signal processing and adaptive filtering Level: Undergraduate engineering (idealized models) Learning objective: Weak stationarity means constant expected mean and autocovariance dependent on lag, not absolute time.

1. Concept and mathematical language

Weak stationarity means constant expected mean and autocovariance dependent on lag, not absolute time. The role of this principle in statistical signal processing and adaptive filtering is to connect the expression on paper with an observable prediction. Before manipulating symbols, define the independent variable, the range of allowed inputs, the output quantity, and the reference condition. In particular, identify whether the argument concerns a discrete-time signal. The same algebraic shape may describe completely different physical situations when time is measured in seconds in one case and by integer samples in another. A meaningful graph must identify its axes and units, the origin of the record, and whether the plotted values are exact or illustrative.

2. A quantitative example

Checkable numerical or symbolic example: For independent zero-mean noise with variance 4 V², the theoretical autocorrelation is 4 V² at lag zero and 0 elsewhere. Explain what the chosen values mean, list any units, and reproduce the result without replacing the governing mathematical relation with a memorized rule. A numerical example answers a narrowly framed question; it does not by itself certify an entire signal-processing chain. Describe the source or test signal, observation interval, reference time, and the output that would be compared with the calculated answer. If the expression uses a delta or step, say whether it represents an ideal mathematical distribution or a realizable finite-width experiment.

3. Derivation strategy and model boundaries

Start from the smallest version of the problem that keeps its essential structure. Represent a pulse with known support; annotate the independent coordinate and the nonzero support or spectral components. Derive the relevant expression step by step, naming the rule used to move from one line to the next. When integrating or summing, show the limits; when using a transform, write its kernel and normalization convention. If the quantity is complex, separate magnitude and phase before interpreting it as a real measurement. Avoid silently switching between angular frequency ω and cyclic frequency f.

A model boundary is a statement about where the prediction can fail. For this lesson, pay particular attention to the following: A finite sample with near-zero empirical correlation is not proof of whiteness or Gaussianity. A useful report says whether the discrepancy originates in a violated hypothesis, finite measurement resolution, numerical rounding, a different Fourier or transform convention, or an unmodeled physical effect. Fitting a parameter after observing a failure does not retrospectively validate the original prediction. State any fitted parameters separately from independently measured ones.

4. Engineering investigation

Task: Simulate seeded white noise and a drifting sequence; compare segment means. Begin by writing a one-paragraph specification of the input, expected output, and permitted error. Choose an observable output rather than a qualitative claim such as “the plot looks correct.” If the application is noisy reference-channel acquisition, explain what sensor or computation would provide the input and how the result could inform a decision. List relevant data units, an example operating range, and one adverse condition. Do not treat a synthetic input as a measurement of a real device.

Connect the investigation to seeded Monte Carlo error comparisons. Specify what a genuinely independent verification would require: a different derivation, a second calculation package, or a controlled instrument measurement with calibrated reference. When measurements are possible, identify bandwidth, resolution and uncertainty before interpreting a small residual as meaningful. When physical testing is unavailable, label all results “analytical” or “synthetic simulation.” A design choice should remain provisional until its assumptions have survived checks under conditions resembling the intended application.

5. Interpretation and common mistakes

Pitfall to diagnose: A finite sample with near-zero empirical correlation is not proof of whiteness or Gaussianity. If data are sampled, state the sample rate and anti-aliasing assumption. A second frequent mistake is confusing a transformation's algebraic existence with its physical realizability. An ideal bandlimited spectrum, an impulse with zero duration, infinite observation time and perfect reconstruction are mathematical conveniences. Each may be useful, but laboratory claims must include finite time, bandwidth, quantization and uncertainty when relevant. This distinction becomes essential when a simulation is used to select acquisition hardware or establish safety margins.

6. Guided exercises and assessment

1. Reconstruction: Starting from the definitions, derive the relation used in the quantitative example. State every assumption, not only the final substitution. Reproduce a dimensional or normalization check.

2. Boundary test: Recompute the lesson's core prediction for a zero input and a doubled input parameter where meaningful. Explain whether the expected change follows from linearity, dimensional reasoning, or a different property.

3. Counterexample: Design a case in which stochastic processes and stationarity would be incorrectly applied. Name the violated assumption and the observable symptom.

4. Independent result: Design a calculation or simulation that would check the mathematical expression without copying its exact implementation. Provide numerical values and expected units.

5. Application decision: For noisy reference-channel acquisition, propose a measurement or controlled experiment that would distinguish the simplified model from one plausible alternative. Include a measurable acceptance criterion.

Self-check and marking guidance

An adequate answer identifies signal type and variables; states the relevant model equation; shows intermediate steps; reports units and reference convention; handles one limit or counterexample; and distinguishes analytic prediction from experimental verification. Work that quotes a final value without hypotheses is incomplete. A passing simulation alone does not establish the physical correctness of its underlying model. Assess whether the calculation would still be valid under a different sample rate, initial state or signal class, whichever is relevant here.

Editorial note: These examples are for instruction. Their idealized component values and invented datasets are not design specifications for safety-critical, mains-connected, medical or certified systems.

Unit 5, Lesson 2: Autocorrelation and power spectral density

Unit theme: Statistical signal processing and adaptive filtering Level: Undergraduate engineering (idealized models) Learning objective: For suitable stationary processes, power spectral density and autocorrelation are Fourier-transform pairs (Wiener–Khinchin).

1. Concept and mathematical language

For suitable stationary processes, power spectral density and autocorrelation are Fourier-transform pairs (Wiener–Khinchin). The role of this principle in statistical signal processing and adaptive filtering is to connect the expression on paper with an observable prediction. Before manipulating symbols, define the independent variable, the range of allowed inputs, the output quantity, and the reference condition. In particular, identify whether the argument concerns a discrete-time signal. The same algebraic shape may describe completely different physical situations when time is measured in seconds in one case and by integer samples in another. A meaningful graph must identify its axes and units, the origin of the record, and whether the plotted values are exact or illustrative.

2. A quantitative example

Checkable numerical or symbolic example: If R[0]=2 V² is the sample variance for a zero-mean sequence, total two-sided normalized spectral power integrates to 2 V². Explain what the chosen values mean, list any units, and reproduce the result without replacing the governing mathematical relation with a memorized rule. A numerical example answers a narrowly framed question; it does not by itself certify an entire signal-processing chain. Describe the source or test signal, observation interval, reference time, and the output that would be compared with the calculated answer. If the expression uses a delta or step, say whether it represents an ideal mathematical distribution or a realizable finite-width experiment.

3. Derivation strategy and model boundaries

Start from the smallest version of the problem that keeps its essential structure. Represent a sinusoid with a calibrated phase origin; annotate the independent coordinate and the nonzero support or spectral components. Derive the relevant expression step by step, naming the rule used to move from one line to the next. When integrating or summing, show the limits; when using a transform, write its kernel and normalization convention. If the quantity is complex, separate magnitude and phase before interpreting it as a real measurement. Avoid silently switching between angular frequency ω and cyclic frequency f.

A model boundary is a statement about where the prediction can fail. For this lesson, pay particular attention to the following: PSD normalization and Hz/radian-frequency units must match before integrating to recover variance. A useful report says whether the discrepancy originates in a violated hypothesis, finite measurement resolution, numerical rounding, a different Fourier or transform convention, or an unmodeled physical effect. Fitting a parameter after observing a failure does not retrospectively validate the original prediction. State any fitted parameters separately from independently measured ones.

4. Engineering investigation

Task: Estimate variance directly and through a correctly normalized periodogram. Begin by writing a one-paragraph specification of the input, expected output, and permitted error. Choose an observable output rather than a qualitative claim such as “the plot looks correct.” If the application is noisy reference-channel acquisition, explain what sensor or computation would provide the input and how the result could inform a decision. List relevant data units, an example operating range, and one adverse condition. Do not treat a synthetic input as a measurement of a real device.

Connect the investigation to seeded Monte Carlo error comparisons. Specify what a genuinely independent verification would require: a different derivation, a second calculation package, or a controlled instrument measurement with calibrated reference. When measurements are possible, identify bandwidth, resolution and uncertainty before interpreting a small residual as meaningful. When physical testing is unavailable, label all results “analytical” or “synthetic simulation.” A design choice should remain provisional until its assumptions have survived checks under conditions resembling the intended application.

5. Interpretation and common mistakes

Pitfall to diagnose: PSD normalization and Hz/radian-frequency units must match before integrating to recover variance. If the argument treats a finite record as infinitely long, write down the window explicitly. A second frequent mistake is confusing a transformation's algebraic existence with its physical realizability. An ideal bandlimited spectrum, an impulse with zero duration, infinite observation time and perfect reconstruction are mathematical conveniences. Each may be useful, but laboratory claims must include finite time, bandwidth, quantization and uncertainty when relevant. This distinction becomes essential when a simulation is used to select acquisition hardware or establish safety margins.

6. Guided exercises and assessment

1. Reconstruction: Starting from the definitions, derive the relation used in the quantitative example. State every assumption, not only the final substitution. Calculate a boundary value without a calculator.

2. Boundary test: Recompute the lesson's core prediction for a zero input and a doubled input parameter where meaningful. Explain whether the expected change follows from linearity, dimensional reasoning, or a different property.

3. Counterexample: Design a case in which autocorrelation and power spectral density would be incorrectly applied. Name the violated assumption and the observable symptom.

4. Independent result: Design a calculation or simulation that would check the mathematical expression without copying its exact implementation. Provide numerical values and expected units.

5. Application decision: For noisy reference-channel acquisition, propose a measurement or controlled experiment that would distinguish the simplified model from one plausible alternative. Include a measurable acceptance criterion.

Self-check and marking guidance

An adequate answer identifies signal type and variables; states the relevant model equation; shows intermediate steps; reports units and reference convention; handles one limit or counterexample; and distinguishes analytic prediction from experimental verification. Work that quotes a final value without hypotheses is incomplete. A passing simulation alone does not establish the physical correctness of its underlying model. Assess whether the calculation would still be valid under a different sample rate, initial state or signal class, whichever is relevant here.

Editorial note: These examples are for instruction. Their idealized component values and invented datasets are not design specifications for safety-critical, mains-connected, medical or certified systems.

Unit 5, Lesson 3: Wiener filter and mean-square error

Unit theme: Statistical signal processing and adaptive filtering Level: Undergraduate engineering (idealized models) Learning objective: Wiener filtering selects linear weights minimizing expected squared estimation error given signal-noise second-order statistics.

1. Concept and mathematical language

Wiener filtering selects linear weights minimizing expected squared estimation error given signal-noise second-order statistics. The role of this principle in statistical signal processing and adaptive filtering is to connect the expression on paper with an observable prediction. Before manipulating symbols, define the independent variable, the range of allowed inputs, the output quantity, and the reference condition. In particular, identify whether the argument concerns a discrete-time signal. The same algebraic shape may describe completely different physical situations when time is measured in seconds in one case and by integer samples in another. A meaningful graph must identify its axes and units, the origin of the record, and whether the plotted values are exact or illustrative.

2. A quantitative example

Checkable numerical or symbolic example: For scalar independent signal/noise variances σs²=9 and σv²=1, optimal gain is 9/(9+1)=0.9. Explain what the chosen values mean, list any units, and reproduce the result without replacing the governing mathematical relation with a memorized rule. A numerical example answers a narrowly framed question; it does not by itself certify an entire signal-processing chain. Describe the source or test signal, observation interval, reference time, and the output that would be compared with the calculated answer. If the expression uses a delta or step, say whether it represents an ideal mathematical distribution or a realizable finite-width experiment.

3. Derivation strategy and model boundaries

Start from the smallest version of the problem that keeps its essential structure. Represent a step that starts at the declared reference instant; annotate the independent coordinate and the nonzero support or spectral components. Derive the relevant expression step by step, naming the rule used to move from one line to the next. When integrating or summing, show the limits; when using a transform, write its kernel and normalization convention. If the quantity is complex, separate magnitude and phase before interpreting it as a real measurement. Avoid silently switching between angular frequency ω and cyclic frequency f.

A model boundary is a statement about where the prediction can fail. For this lesson, pay particular attention to the following: This scalar gain assumes zero-mean independent components and known variances; it is not a universal denoiser. A useful report says whether the discrepancy originates in a violated hypothesis, finite measurement resolution, numerical rounding, a different Fourier or transform convention, or an unmodeled physical effect. Fitting a parameter after observing a failure does not retrospectively validate the original prediction. State any fitted parameters separately from independently measured ones.

4. Engineering investigation

Task: Compare estimation error for assumed noise variance 1 and an actual variance 4. Begin by writing a one-paragraph specification of the input, expected output, and permitted error. Choose an observable output rather than a qualitative claim such as “the plot looks correct.” If the application is noisy reference-channel acquisition, explain what sensor or computation would provide the input and how the result could inform a decision. List relevant data units, an example operating range, and one adverse condition. Do not treat a synthetic input as a measurement of a real device.

Connect the investigation to seeded Monte Carlo error comparisons. Specify what a genuinely independent verification would require: a different derivation, a second calculation package, or a controlled instrument measurement with calibrated reference. When measurements are possible, identify bandwidth, resolution and uncertainty before interpreting a small residual as meaningful. When physical testing is unavailable, label all results “analytical” or “synthetic simulation.” A design choice should remain provisional until its assumptions have survived checks under conditions resembling the intended application.

5. Interpretation and common mistakes

Pitfall to diagnose: This scalar gain assumes zero-mean independent components and known variances; it is not a universal denoiser. If an equation is linear, verify linearity on two different input functions instead of one. A second frequent mistake is confusing a transformation's algebraic existence with its physical realizability. An ideal bandlimited spectrum, an impulse with zero duration, infinite observation time and perfect reconstruction are mathematical conveniences. Each may be useful, but laboratory claims must include finite time, bandwidth, quantization and uncertainty when relevant. This distinction becomes essential when a simulation is used to select acquisition hardware or establish safety margins.

6. Guided exercises and assessment

1. Reconstruction: Starting from the definitions, derive the relation used in the quantitative example. State every assumption, not only the final substitution. Sketch the expected waveform or spectral trend.

2. Boundary test: Recompute the lesson's core prediction for a zero input and a doubled input parameter where meaningful. Explain whether the expected change follows from linearity, dimensional reasoning, or a different property.

3. Counterexample: Design a case in which wiener filter and mean-square error would be incorrectly applied. Name the violated assumption and the observable symptom.

4. Independent result: Design a calculation or simulation that would check the mathematical expression without copying its exact implementation. Provide numerical values and expected units.

5. Application decision: For noisy reference-channel acquisition, propose a measurement or controlled experiment that would distinguish the simplified model from one plausible alternative. Include a measurable acceptance criterion.

Self-check and marking guidance

An adequate answer identifies signal type and variables; states the relevant model equation; shows intermediate steps; reports units and reference convention; handles one limit or counterexample; and distinguishes analytic prediction from experimental verification. Work that quotes a final value without hypotheses is incomplete. A passing simulation alone does not establish the physical correctness of its underlying model. Assess whether the calculation would still be valid under a different sample rate, initial state or signal class, whichever is relevant here.

Editorial note: These examples are for instruction. Their idealized component values and invented datasets are not design specifications for safety-critical, mains-connected, medical or certified systems.

Unit 5, Lesson 4: LMS adaptation and convergence

Unit theme: Statistical signal processing and adaptive filtering Level: Undergraduate engineering (idealized models) Learning objective: Least-mean-squares updates weights w[n+1]=w[n]+μ e[n] x[n] under a stated error convention.

1. Concept and mathematical language

Least-mean-squares updates weights w[n+1]=w[n]+μ e[n] x[n] under a stated error convention. The role of this principle in statistical signal processing and adaptive filtering is to connect the expression on paper with an observable prediction. Before manipulating symbols, define the independent variable, the range of allowed inputs, the output quantity, and the reference condition. In particular, identify whether the argument concerns a discrete-time signal. The same algebraic shape may describe completely different physical situations when time is measured in seconds in one case and by integer samples in another. A meaningful graph must identify its axes and units, the origin of the record, and whether the plotted values are exact or illustrative.

2. A quantitative example

Checkable numerical or symbolic example: With w0=0, x=2, desired d=1 and μ=0.1, error e=1 gives w1=0.2. Explain what the chosen values mean, list any units, and reproduce the result without replacing the governing mathematical relation with a memorized rule. A numerical example answers a narrowly framed question; it does not by itself certify an entire signal-processing chain. Describe the source or test signal, observation interval, reference time, and the output that would be compared with the calculated answer. If the expression uses a delta or step, say whether it represents an ideal mathematical distribution or a realizable finite-width experiment.

3. Derivation strategy and model boundaries

Start from the smallest version of the problem that keeps its essential structure. Represent a bandlimited synthetic record; annotate the independent coordinate and the nonzero support or spectral components. Derive the relevant expression step by step, naming the rule used to move from one line to the next. When integrating or summing, show the limits; when using a transform, write its kernel and normalization convention. If the quantity is complex, separate magnitude and phase before interpreting it as a real measurement. Avoid silently switching between angular frequency ω and cyclic frequency f.

A model boundary is a statement about where the prediction can fail. For this lesson, pay particular attention to the following: Step size must be chosen with input power and eigenvalue spread; too-large μ can diverge. A useful report says whether the discrepancy originates in a violated hypothesis, finite measurement resolution, numerical rounding, a different Fourier or transform convention, or an unmodeled physical effect. Fitting a parameter after observing a failure does not retrospectively validate the original prediction. State any fitted parameters separately from independently measured ones.

4. Engineering investigation

Task: Simulate a one-tap LMS over repeated noisy observations using three step sizes. Begin by writing a one-paragraph specification of the input, expected output, and permitted error. Choose an observable output rather than a qualitative claim such as “the plot looks correct.” If the application is noisy reference-channel acquisition, explain what sensor or computation would provide the input and how the result could inform a decision. List relevant data units, an example operating range, and one adverse condition. Do not treat a synthetic input as a measurement of a real device.

Connect the investigation to seeded Monte Carlo error comparisons. Specify what a genuinely independent verification would require: a different derivation, a second calculation package, or a controlled instrument measurement with calibrated reference. When measurements are possible, identify bandwidth, resolution and uncertainty before interpreting a small residual as meaningful. When physical testing is unavailable, label all results “analytical” or “synthetic simulation.” A design choice should remain provisional until its assumptions have survived checks under conditions resembling the intended application.

5. Interpretation and common mistakes

Pitfall to diagnose: Step size must be chosen with input power and eigenvalue spread; too-large μ can diverge. If a spectrum is complex, report both phase convention and amplitude normalization. A second frequent mistake is confusing a transformation's algebraic existence with its physical realizability. An ideal bandlimited spectrum, an impulse with zero duration, infinite observation time and perfect reconstruction are mathematical conveniences. Each may be useful, but laboratory claims must include finite time, bandwidth, quantization and uncertainty when relevant. This distinction becomes essential when a simulation is used to select acquisition hardware or establish safety margins.

6. Guided exercises and assessment

1. Reconstruction: Starting from the definitions, derive the relation used in the quantitative example. State every assumption, not only the final substitution. Identify a counterexample to an unstated assumption.

2. Boundary test: Recompute the lesson's core prediction for a zero input and a doubled input parameter where meaningful. Explain whether the expected change follows from linearity, dimensional reasoning, or a different property.

3. Counterexample: Design a case in which lms adaptation and convergence would be incorrectly applied. Name the violated assumption and the observable symptom.

4. Independent result: Design a calculation or simulation that would check the mathematical expression without copying its exact implementation. Provide numerical values and expected units.

5. Application decision: For noisy reference-channel acquisition, propose a measurement or controlled experiment that would distinguish the simplified model from one plausible alternative. Include a measurable acceptance criterion.

Self-check and marking guidance

An adequate answer identifies signal type and variables; states the relevant model equation; shows intermediate steps; reports units and reference convention; handles one limit or counterexample; and distinguishes analytic prediction from experimental verification. Work that quotes a final value without hypotheses is incomplete. A passing simulation alone does not establish the physical correctness of its underlying model. Assess whether the calculation would still be valid under a different sample rate, initial state or signal class, whichever is relevant here.

Editorial note: These examples are for instruction. Their idealized component values and invented datasets are not design specifications for safety-critical, mains-connected, medical or certified systems.

Unit 5, Lesson 5: Adaptive noise cancellation and leakage

Unit theme: Statistical signal processing and adaptive filtering Level: Undergraduate engineering (idealized models) Learning objective: A reference channel should predict contaminating noise but must avoid containing the desired signal to prevent inadvertent cancellation.

1. Concept and mathematical language

A reference channel should predict contaminating noise but must avoid containing the desired signal to prevent inadvertent cancellation. The role of this principle in statistical signal processing and adaptive filtering is to connect the expression on paper with an observable prediction. Before manipulating symbols, define the independent variable, the range of allowed inputs, the output quantity, and the reference condition. In particular, identify whether the argument concerns a discrete-time signal. The same algebraic shape may describe completely different physical situations when time is measured in seconds in one case and by integer samples in another. A meaningful graph must identify its axes and units, the origin of the record, and whether the plotted values are exact or illustrative.

2. A quantitative example

Checkable numerical or symbolic example: For desired s and correlated contaminant v, subtraction of an exactly estimated v gives residual s, but estimation error adds to output noise. Explain what the chosen values mean, list any units, and reproduce the result without replacing the governing mathematical relation with a memorized rule. A numerical example answers a narrowly framed question; it does not by itself certify an entire signal-processing chain. Describe the source or test signal, observation interval, reference time, and the output that would be compared with the calculated answer. If the expression uses a delta or step, say whether it represents an ideal mathematical distribution or a realizable finite-width experiment.

3. Derivation strategy and model boundaries

Start from the smallest version of the problem that keeps its essential structure. Represent a two-component signal with separated scales; annotate the independent coordinate and the nonzero support or spectral components. Derive the relevant expression step by step, naming the rule used to move from one line to the next. When integrating or summing, show the limits; when using a transform, write its kernel and normalization convention. If the quantity is complex, separate magnitude and phase before interpreting it as a real measurement. Avoid silently switching between angular frequency ω and cyclic frequency f.

A model boundary is a statement about where the prediction can fail. For this lesson, pay particular attention to the following: Correlation between reference and desired signal can bias the adaptive solution and remove desired components. A useful report says whether the discrepancy originates in a violated hypothesis, finite measurement resolution, numerical rounding, a different Fourier or transform convention, or an unmodeled physical effect. Fitting a parameter after observing a failure does not retrospectively validate the original prediction. State any fitted parameters separately from independently measured ones.

4. Engineering investigation

Task: Build two-reference synthetic data with and without desired-signal leakage. Begin by writing a one-paragraph specification of the input, expected output, and permitted error. Choose an observable output rather than a qualitative claim such as “the plot looks correct.” If the application is noisy reference-channel acquisition, explain what sensor or computation would provide the input and how the result could inform a decision. List relevant data units, an example operating range, and one adverse condition. Do not treat a synthetic input as a measurement of a real device.

Connect the investigation to seeded Monte Carlo error comparisons. Specify what a genuinely independent verification would require: a different derivation, a second calculation package, or a controlled instrument measurement with calibrated reference. When measurements are possible, identify bandwidth, resolution and uncertainty before interpreting a small residual as meaningful. When physical testing is unavailable, label all results “analytical” or “synthetic simulation.” A design choice should remain provisional until its assumptions have survived checks under conditions resembling the intended application.

5. Interpretation and common mistakes

Pitfall to diagnose: Correlation between reference and desired signal can bias the adaptive solution and remove desired components. If a pole or time constant appears, check the expected long-time behavior. A second frequent mistake is confusing a transformation's algebraic existence with its physical realizability. An ideal bandlimited spectrum, an impulse with zero duration, infinite observation time and perfect reconstruction are mathematical conveniences. Each may be useful, but laboratory claims must include finite time, bandwidth, quantization and uncertainty when relevant. This distinction becomes essential when a simulation is used to select acquisition hardware or establish safety margins.

6. Guided exercises and assessment

1. Reconstruction: Starting from the definitions, derive the relation used in the quantitative example. State every assumption, not only the final substitution. State an acceptance tolerance before simulating.

2. Boundary test: Recompute the lesson's core prediction for a zero input and a doubled input parameter where meaningful. Explain whether the expected change follows from linearity, dimensional reasoning, or a different property.

3. Counterexample: Design a case in which adaptive noise cancellation and leakage would be incorrectly applied. Name the violated assumption and the observable symptom.

4. Independent result: Design a calculation or simulation that would check the mathematical expression without copying its exact implementation. Provide numerical values and expected units.

5. Application decision: For noisy reference-channel acquisition, propose a measurement or controlled experiment that would distinguish the simplified model from one plausible alternative. Include a measurable acceptance criterion.

Self-check and marking guidance

An adequate answer identifies signal type and variables; states the relevant model equation; shows intermediate steps; reports units and reference convention; handles one limit or counterexample; and distinguishes analytic prediction from experimental verification. Work that quotes a final value without hypotheses is incomplete. A passing simulation alone does not establish the physical correctness of its underlying model. Assess whether the calculation would still be valid under a different sample rate, initial state or signal class, whichever is relevant here.

Editorial note: These examples are for instruction. Their idealized component values and invented datasets are not design specifications for safety-critical, mains-connected, medical or certified systems.

Unit 5 capstone — Statistical and adaptive denoising benchmark

Engineering problem

Generate seeded signal and interference with an available correlated reference, compare scalar Wiener estimation and an LMS noise canceller, and document signal leakage risks. The capstone intentionally uses invented signals, not field measurements. The unit provides the mathematical concepts: Stochastic processes and stationarity, Autocorrelation and power spectral density, Wiener filter and mean-square error, LMS adaptation and convergence, Adaptive noise cancellation and leakage. Write a concise problem statement and choose consistent notation for time, sample index, physical units and the transform convention. Keep raw input parameters in a table separate from derived outputs.

Required submissions

1. A mathematical model listing all assumptions, independent variables and initial conditions or finite record lengths.
2. A hand-verifiable result with the steps from governing equation to value or functional expression.
3. One independent computation, using a different method from the hand calculation, with an explicit discrepancy tolerance.
4. A plot that labels units, sample rate, window and phase/frequency conventions when relevant.
5. Two stress tests: one boundary case and one deliberate model violation with the expected failure symptoms.
6. A short engineering report distinguishing verification of code from validation against physical data.

Evaluation rubric (100 points)

• Mathematical and physical specification: 20.
• Correct derivations and units: 25.
• Independently reproducible numerical result: 20.
• Boundary and violation tests: 20.
• Clear interpretation and data provenance: 15.

Discussion prompts

Explain why your assumptions are necessary; demonstrate whether changing the record length or excitation changes the result; discuss which error is numerical and which is modeling error; and propose a minimal real-world test to determine whether the simplified model is appropriate. A visually convincing trace without a numeric reference earns no numerical verification credit. Refer to the corresponding lessons for the domain-specific limitations.