Information Measure, Source Entropy, Shannon-Fano, and Huffman Source Coding

Unit 5 — Fading, diversity and spatial communication

Why this unit exists

The unit centers on mobile vehicle-to-infrastructure channel, where a moving vehicle exchanges sensor messages while surrounding reflectors change. Its controlling difficulty is that coverage holes and packet deadlines matter more than average SNR alone. The four lessons isolate different parts of the mechanism, yet the delivered system must satisfy all of them at once. You will link equations to implementation, design measurements and deliberately test situations in which a convenient idealization becomes misleading.

Concept sequence

Lesson 5.1 — Rayleigh fading statistics and outage

Fast and slow fading describe variation relative to packet or symbol duration, not simply 'bad' and 'good' links. In a flat Rayleigh channel, the envelope has a Rayleigh distribution when many independent scattered contributions combine without a deterministic dominant component. Instantaneous SNR fluctuates with squared envelope, and rate adaptation may fail when fades are deeper than the coding/interleaving can handle. Average SNR alone cannot predict reliability; outage probability relates the supported rate to the distribution of channel state.

Key relation: For normalized Rayleigh flat fading, G=|h|² is exponential with mean 1; outage at threshold γ_th with mean SNR γ_bar is P_out=1-exp(-γ_th/γ_bar).

Design boundary: Shadow fading, spatial correlation and a line-of-sight component change the distribution. A Rayleigh formula cannot describe all propagation environments or a site-specific coverage map.

Lesson 5.2 — Time, frequency and spatial diversity

Diversity places multiple independently faded observations of the same information at the receiver. Time diversity needs a channel that changes sufficiently across repeats or interleaved symbols; frequency diversity needs independently varying spectral regions; antenna diversity needs sufficiently independent spatial channels. Maximum-ratio combining weights each branch by its channel conjugate and noise level, producing combined SNR equal to the sum of branch SNRs in the independent-noise idealization. Selection combining is simpler and often less effective than coherent combining.

Key relation: For independent exponentially distributed branch SNRs, selection combining of M equal-mean branches yields P_out=(1-exp(-γ_th/γ_bar))^M.

Design boundary: Antenna spacing does not guarantee zero correlation, especially with narrow angular spread or nearby coupling. Noise covariance matters when forming optimal linear combiners.

Lesson 5.3 — Space-time block coding and Alamouti structure

The Alamouti construction provides transmit diversity without requiring two independent data streams at the same instant. Its two complex symbols occupy two time intervals, so the orthogonal design has code rate one symbol per use for the two-antenna idealization. The receiver combines conjugated observations using channel estimates, separating the two symbols when the channel is sufficiently constant across both intervals. Training and receiver noise affect detection. Space-time coding should not be confused with spatial multiplexing, which transmits independent information streams and demands sufficient channel rank.

Key relation: A two-transmit one-receive Alamouti block sends [[s1,s2],[-s2,s1]] across two time slots under a channel constant over the block, enabling linear orthogonal combining.

Design boundary: If the channel changes between time slots, the textbook orthogonality cancellation no longer holds exactly. Antenna power normalization must also be stated when comparing with one-transmit operation.

Lesson 5.4 — MIMO capacity and rank limitations

Multiple antennas can create spatial diversity, multiplexing gain or a beamforming advantage depending on channel rank, CSI and power allocation. A large antenna count does not guarantee equally many independent streams: channels aligned in spatial response can be nearly rank deficient. Singular-value decomposition exposes orthogonal spatial modes with different strengths. The log determinant capacity formula assumes Gaussian signaling and known channel at the receiver; practical coding, channel estimation and control traffic reduce deliverable throughput.

Key relation: For Gaussian MIMO with channel H and receiver noise covariance I, C=log2 det(I+(ρ/Nt)HHᴴ) bits/s/Hz when transmit power is equally allocated over Nt antennas and ρ is total linear SNR.

Design boundary: Capacity is not the modulation order or an achievable payload rate without coding and overhead. A nearly singular channel can make naive spatial multiplexing extremely error-prone.

Integrated case study

An engineer reviews the architecture for mobile vehicle-to-infrastructure channel. The first review identifies the performance or integrity quantity at the receiver. The second asks which subsystem can change that quantity. The third checks the impact on user payload, energy consumption, delay and operating cost. A favorable conclusion requires comparable conditions; changing both the channel model and signal power while comparing decoders makes it impossible to attribute improvement to one change.

Three-stage assessment plan

1. Analytical baseline. Derive a transparent relation using one of the four listed key models. Describe the allowed parameter region, units and what was held constant in the comparison. For mobile vehicle-to-infrastructure channel, decide which model variable is realistically measurable and which must be inferred.

2. Synthetic controlled test. Isolate one impairment, vary its magnitude and compare to the baseline. Re-run with a different seed and a second numerical implementation. Build a plot with labeled axes and, for error probabilities, uncertainty intervals.

3. Engineering hand-off. Replace the idealized assumption with a more plausible impairment relevant to a moving vehicle exchanges sensor messages while surrounding reflectors change. State which earlier conclusion remains reliable and which needs further data. Record what must be checked before a prototype is trusted outside the laboratory.

Unit questions

• Which of the four mechanisms is most likely to control acceptance for mobile vehicle-to-infrastructure channel, and what measured evidence would establish that claim?

• How would the design fail if the assumption “Shadow fading, spatial correlation and a line-of-sight component change the distribution. A Rayleigh formula cannot describe all propagation environments or a site-specific coverage map.” were ignored?

• Identify a numerical sanity check, an implementation test, and a separate real-world validation requirement.

• Where would additional redundancy help and where might it merely increase latency or occupy already-limited bandwidth?

Suggested learning order

Read the four lessons in order; complete the simulation, then submit the project with a result table and the associated limitations.

Unit 5, Lesson 1: Rayleigh fading statistics and outage

Module: Fading, diversity and spatial communication. Prerequisites: Communication Systems I, introductory probability, linear systems, complex algebra and elementary Python or JavaScript.

Learning outcomes

• Explain rayleigh fading statistics and outage from a physical or algorithmic model rather than memorizing an isolated equation.

• Distinguish assumptions, symbols, measured quantities and synthesized values in a complete communications link.

• Perform an independent limiting-case check and identify an operating region where the model fails.

• Design and document a reproducible synthetic experiment that tests a stated prediction.

System context and motivating decision

Consider mobile vehicle-to-infrastructure channel: a moving vehicle exchanges sensor messages while surrounding reflectors change. In this setting, coverage holes and packet deadlines matter more than average SNR alone. The engineer therefore needs a model that is useful at the right reference plane, not an attractive formula copied from a different link. A quantity measured at the transmitter cannot automatically be used as if it were the receive-filter output, and uncoded symbol reliability cannot be silently treated as packet reliability. The purpose of this lesson is to connect rayleigh fading statistics and outage with observable decisions in this chain.

Physical or algorithmic explanation

Fast and slow fading describe variation relative to packet or symbol duration, not simply 'bad' and 'good' links. In a flat Rayleigh channel, the envelope has a Rayleigh distribution when many independent scattered contributions combine without a deterministic dominant component. Instantaneous SNR fluctuates with squared envelope, and rate adaptation may fail when fades are deeper than the coding/interleaving can handle. Average SNR alone cannot predict reliability; outage probability relates the supported rate to the distribution of channel state.

Core mathematical relationship

For normalized Rayleigh flat fading, G=|h|² is exponential with mean 1; outage at threshold γ_th with mean SNR γ_bar is P_out=1-exp(-γ_th/γ_bar).

Meaning and conventions

The central expression above describes rayleigh fading statistics and outage. Before calculating, identify the set of variables, their units and whether the expression applies to discrete or continuous time. When the relevant quantities are probabilities, confirm the conditioning event and whether samples are independent. When complex amplitudes occur, remember that a conjugate, not a real transpose, normally defines an energy inner product. Where a ratio of powers is stated in decibels, 10 log10 rather than 20 log10 is the appropriate conversion; for voltage magnitudes with identical impedances, a 20 log10 form may be suitable. This model is one part of the signal processing chain, not a substitute for a performance measurement.

Derive, calculate and inspect

First mark the source of the input and output quantities in For normalized Rayleigh flat fading, G=|h|² is exponential with mean 1; outage at threshold γ_th with mean SNR γ_bar is P_out=1-exp(-γ_th/γ_bar).. State which symbols are known, which must be estimated and which are chosen by design. Translate the equation into a reproducible step-by-step computation, then test zero or very small noise, an intermediate operating point and a stressed case. A result should remain physically interpretable under these changes. Where the relationship is approximate, determine the approximation error before interpreting small performance improvements as significant. Never add gains or losses twice because the same physical effect appears in two bookkeeping categories.

Fully explained example and verification

If mean linear SNR is 10 and the receiver needs linear SNR 2 for a certain operating mode, outage is 1-exp(-0.2)=0.1813. Increasing mean SNR to 20 reduces outage to 1-exp(-0.1)=0.0952. These are channel-model predictions, not guaranteed packet delivery rates.

How to verify: Recompute the numeric statement from the specified inputs without reading a plotted curve. Re-run after increasing the most influential input by 10%, and explain the direction and approximate size of the change. Then compare that outcome with the limiting case for the model. A plausible number is not sufficient if the observation plane, normalization or statistical assumptions have changed.

Boundary conditions and common mistakes

Shadow fading, spatial correlation and a line-of-sight component change the distribution. A Rayleigh formula cannot describe all propagation environments or a site-specific coverage map.

An additional failure mode in mobile vehicle-to-infrastructure channel arises when the local mechanism is interpreted as an end-to-end guarantee. For example, packets may be rejected by framing or replay checks even after an error-correcting decoder outputs a plausible bit sequence; conversely, a successful frame may be too late to serve a time-critical application. To separate causes, log the inputs and outputs of each major subsystem, retain the raw observation when possible, and name the exact stage at which a failure is declared.

Guided computational experiment

Generate independent complex Gaussian channel coefficients and verify that squared magnitudes match the theoretical exponential CDF. Compare simulated outage against 1-exp(-threshold/mean).

Reproducibility protocol. Record the independent variables, their increments and physical units; state random seeds, number of simulated trials and target metrics. Use two numerical implementations for at least one predicted point. When drawing a probability curve, use enough trials to estimate its uncertainty and report the confidence interval; small error counts produce unstable estimates. When a parameter sweep crosses a model limit, annotate the plot rather than truncating inconvenient results.

Problem set with targeted response guidance

Question 1. Reference planes and dimensional consistency

Draw the component-level path through a moving vehicle exchanges sensor messages while surrounding reflectors change. Label exactly where the inputs to “For normalized Rayleigh flat fading, G=|h|² is exponential with mean 1; outage at threshold γ_th with mean SNR γ_bar is P_out=1-exp(-γ_th/γ_bar).” are acquired or estimated. Construct a three-column table of quantity, unit, and uncertainty source. Identify one tempting but invalid substitution and explain which physical interface it crosses.

Answer guidance: A complete solution has a block diagram and a clear distinction between physical measurement and algorithmic estimate. For rayleigh fading statistics and outage, justify every normalization and explicitly say what is held constant when comparing two conditions.

Question 2. Rebuild the numerical case

Independently reconstruct the worked calculation for rayleigh fading statistics and outage. Change the leading numerical parameter by 20%, holding other inputs fixed, and explain whether the result changes linearly or nonlinearly. Supply every intermediate numerical step.

Answer guidance: The answer must reproduce the worked statement under its stated assumptions, account for units, and include an inverse or limiting check. If a result disagrees, trace the exact operation; do not round intermediate values until the final display.

Question 3. Competing design changes

For mobile vehicle-to-infrastructure channel, propose two ways to improve the outcome represented by For normalized Rayleigh flat fading, G=|h|² is exponential with mean 1; outage at threshold γ_th with mean SNR γ_bar is P_out=1-exp(-γ_th/γ_bar).: one changes a transmitter or source parameter, the other changes receiver processing. List their respective energy, implementation, latency and spectral costs.

Answer guidance: Grade the response on tradeoffs, not a single optimization metric. For this topic, specify which impairment each intervention addresses and whether a gain in one stage increases overhead elsewhere.

Question 4. Break the assumptions

Create a deliberately unrealistic operating point for rayleigh fading statistics and outage and explain a specific broken assumption. Then propose a synthetic observation that would reveal the failure. Describe what a poorly documented analysis might incorrectly conclude.

Answer guidance: The response must identify an assumption explicitly and design a measurement that detects the discrepancy. Replacing one uncertain parameter with a convenient nominal value is not an assumption test.

Further engineering synthesis

To write a defensible report for rayleigh fading statistics and outage, separate evidence into three columns: a derivation, a reproducible numerical implementation and a system-level observation. The derivation establishes the modeled relationship; simulation checks implementation and explore cases that are hard to calculate by hand; field observation tests the relevance of modeling assumptions. Failure of a field measurement to match the derivation may reveal either a coding bug or a missing physical effect. Avoid the reflex to adjust free parameters until curves agree, because that conceals rather than explains uncertainty.

Finally trace the effect of rayleigh fading statistics and outage onto throughput, occupied bandwidth, energy per delivered information bit and deadline failures for mobile vehicle-to-infrastructure channel. Describe which of these metrics has a monotonic response to parameter changes and which displays a tradeoff. Explain the direction of the tradeoff with one numerical or plotted piece of evidence; where evidence is absent, label the claim as a hypothesis. Every numerical conclusion should be reproducible from recorded inputs.

Cross-reference: See the model for Unit 5, Unit 5 project brief and its assessment. The simulation depicts a deliberately simplified subproblem; it does not certify a live communication system.

Unit 5, Lesson 2: Time, frequency and spatial diversity

Module: Fading, diversity and spatial communication. Prerequisites: Communication Systems I, introductory probability, linear systems, complex algebra and elementary Python or JavaScript.

Learning outcomes

• Explain time, frequency and spatial diversity from a physical or algorithmic model rather than memorizing an isolated equation.

• Distinguish assumptions, symbols, measured quantities and synthesized values in a complete communications link.

• Perform an independent limiting-case check and identify an operating region where the model fails.

• Design and document a reproducible synthetic experiment that tests a stated prediction.

System context and motivating decision

Consider mobile vehicle-to-infrastructure channel: a moving vehicle exchanges sensor messages while surrounding reflectors change. In this setting, coverage holes and packet deadlines matter more than average SNR alone. The engineer therefore needs a model that is useful at the right reference plane, not an attractive formula copied from a different link. A quantity measured at the transmitter cannot automatically be used as if it were the receive-filter output, and uncoded symbol reliability cannot be silently treated as packet reliability. The purpose of this lesson is to connect time, frequency and spatial diversity with observable decisions in this chain.

Physical or algorithmic explanation

Diversity places multiple independently faded observations of the same information at the receiver. Time diversity needs a channel that changes sufficiently across repeats or interleaved symbols; frequency diversity needs independently varying spectral regions; antenna diversity needs sufficiently independent spatial channels. Maximum-ratio combining weights each branch by its channel conjugate and noise level, producing combined SNR equal to the sum of branch SNRs in the independent-noise idealization. Selection combining is simpler and often less effective than coherent combining.

Core mathematical relationship

For independent exponentially distributed branch SNRs, selection combining of M equal-mean branches yields P_out=(1-exp(-γ_th/γ_bar))^M.

Meaning and conventions

The central expression above describes time, frequency and spatial diversity. Before calculating, identify the set of variables, their units and whether the expression applies to discrete or continuous time. When the relevant quantities are probabilities, confirm the conditioning event and whether samples are independent. When complex amplitudes occur, remember that a conjugate, not a real transpose, normally defines an energy inner product. Where a ratio of powers is stated in decibels, 10 log10 rather than 20 log10 is the appropriate conversion; for voltage magnitudes with identical impedances, a 20 log10 form may be suitable. This model is one part of the signal processing chain, not a substitute for a performance measurement.

Derive, calculate and inspect

First mark the source of the input and output quantities in For independent exponentially distributed branch SNRs, selection combining of M equal-mean branches yields P_out=(1-exp(-γ_th/γ_bar))^M.. State which symbols are known, which must be estimated and which are chosen by design. Translate the equation into a reproducible step-by-step computation, then test zero or very small noise, an intermediate operating point and a stressed case. A result should remain physically interpretable under these changes. Where the relationship is approximate, determine the approximation error before interpreting small performance improvements as significant. Never add gains or losses twice because the same physical effect appears in two bookkeeping categories.

Fully explained example and verification

For two statistically independent branches, single-branch outage p=0.2 implies selection outage p²=0.04. If the branches experience exactly the same fade, selecting between them does not improve outage and it remains 0.2. Independence is therefore a mathematical assumption carrying real engineering consequences.

How to verify: Recompute the numeric statement from the specified inputs without reading a plotted curve. Re-run after increasing the most influential input by 10%, and explain the direction and approximate size of the change. Then compare that outcome with the limiting case for the model. A plausible number is not sufficient if the observation plane, normalization or statistical assumptions have changed.

Boundary conditions and common mistakes

Antenna spacing does not guarantee zero correlation, especially with narrow angular spread or nearby coupling. Noise covariance matters when forming optimal linear combiners.

An additional failure mode in mobile vehicle-to-infrastructure channel arises when the local mechanism is interpreted as an end-to-end guarantee. For example, packets may be rejected by framing or replay checks even after an error-correcting decoder outputs a plausible bit sequence; conversely, a successful frame may be too late to serve a time-critical application. To separate causes, log the inputs and outputs of each major subsystem, retain the raw observation when possible, and name the exact stage at which a failure is declared.

Guided computational experiment

Simulate two correlated complex Gaussian channels with adjustable correlation and compare selection and maximum-ratio combining SNR distributions. Plot performance versus the correlation parameter.

Reproducibility protocol. Record the independent variables, their increments and physical units; state random seeds, number of simulated trials and target metrics. Use two numerical implementations for at least one predicted point. When drawing a probability curve, use enough trials to estimate its uncertainty and report the confidence interval; small error counts produce unstable estimates. When a parameter sweep crosses a model limit, annotate the plot rather than truncating inconvenient results.

Problem set with targeted response guidance

Question 1. Reference planes and dimensional consistency

Draw the component-level path through a moving vehicle exchanges sensor messages while surrounding reflectors change. Label exactly where the inputs to “For independent exponentially distributed branch SNRs, selection combining of M equal-mean branches yields P_out=(1-exp(-γ_th/γ_bar))^M.” are acquired or estimated. Construct a three-column table of quantity, unit, and uncertainty source. Identify one tempting but invalid substitution and explain which physical interface it crosses.

Answer guidance: A complete solution has a block diagram and a clear distinction between physical measurement and algorithmic estimate. For time, frequency and spatial diversity, justify every normalization and explicitly say what is held constant when comparing two conditions.

Question 2. Rebuild the numerical case

Independently reconstruct the worked calculation for time, frequency and spatial diversity. Change the leading numerical parameter by 20%, holding other inputs fixed, and explain whether the result changes linearly or nonlinearly. Supply every intermediate numerical step.

Answer guidance: The answer must reproduce the worked statement under its stated assumptions, account for units, and include an inverse or limiting check. If a result disagrees, trace the exact operation; do not round intermediate values until the final display.

Question 3. Competing design changes

For mobile vehicle-to-infrastructure channel, propose two ways to improve the outcome represented by For independent exponentially distributed branch SNRs, selection combining of M equal-mean branches yields P_out=(1-exp(-γ_th/γ_bar))^M.: one changes a transmitter or source parameter, the other changes receiver processing. List their respective energy, implementation, latency and spectral costs.

Answer guidance: Grade the response on tradeoffs, not a single optimization metric. For this topic, specify which impairment each intervention addresses and whether a gain in one stage increases overhead elsewhere.

Question 4. Break the assumptions

Create a deliberately unrealistic operating point for time, frequency and spatial diversity and explain a specific broken assumption. Then propose a synthetic observation that would reveal the failure. Describe what a poorly documented analysis might incorrectly conclude.

Answer guidance: The response must identify an assumption explicitly and design a measurement that detects the discrepancy. Replacing one uncertain parameter with a convenient nominal value is not an assumption test.

Further engineering synthesis

To write a defensible report for time, frequency and spatial diversity, separate evidence into three columns: a derivation, a reproducible numerical implementation and a system-level observation. The derivation establishes the modeled relationship; simulation checks implementation and explore cases that are hard to calculate by hand; field observation tests the relevance of modeling assumptions. Failure of a field measurement to match the derivation may reveal either a coding bug or a missing physical effect. Avoid the reflex to adjust free parameters until curves agree, because that conceals rather than explains uncertainty.

Finally trace the effect of time, frequency and spatial diversity onto throughput, occupied bandwidth, energy per delivered information bit and deadline failures for mobile vehicle-to-infrastructure channel. Describe which of these metrics has a monotonic response to parameter changes and which displays a tradeoff. Explain the direction of the tradeoff with one numerical or plotted piece of evidence; where evidence is absent, label the claim as a hypothesis. Every numerical conclusion should be reproducible from recorded inputs.

Cross-reference: See the model for Unit 5, Unit 5 project brief and its assessment. The simulation depicts a deliberately simplified subproblem; it does not certify a live communication system.

Unit 5, Lesson 3: Space-time block coding and Alamouti structure

Module: Fading, diversity and spatial communication. Prerequisites: Communication Systems I, introductory probability, linear systems, complex algebra and elementary Python or JavaScript.

Learning outcomes

• Explain space-time block coding and alamouti structure from a physical or algorithmic model rather than memorizing an isolated equation.

• Distinguish assumptions, symbols, measured quantities and synthesized values in a complete communications link.

• Perform an independent limiting-case check and identify an operating region where the model fails.

• Design and document a reproducible synthetic experiment that tests a stated prediction.

System context and motivating decision

Consider mobile vehicle-to-infrastructure channel: a moving vehicle exchanges sensor messages while surrounding reflectors change. In this setting, coverage holes and packet deadlines matter more than average SNR alone. The engineer therefore needs a model that is useful at the right reference plane, not an attractive formula copied from a different link. A quantity measured at the transmitter cannot automatically be used as if it were the receive-filter output, and uncoded symbol reliability cannot be silently treated as packet reliability. The purpose of this lesson is to connect space-time block coding and alamouti structure with observable decisions in this chain.

Physical or algorithmic explanation

The Alamouti construction provides transmit diversity without requiring two independent data streams at the same instant. Its two complex symbols occupy two time intervals, so the orthogonal design has code rate one symbol per use for the two-antenna idealization. The receiver combines conjugated observations using channel estimates, separating the two symbols when the channel is sufficiently constant across both intervals. Training and receiver noise affect detection. Space-time coding should not be confused with spatial multiplexing, which transmits independent information streams and demands sufficient channel rank.

Core mathematical relationship

A two-transmit one-receive Alamouti block sends [[s1,s2],[-s2,s1]] across two time slots under a channel constant over the block, enabling linear orthogonal combining.

Meaning and conventions

The central expression above describes space-time block coding and alamouti structure. Before calculating, identify the set of variables, their units and whether the expression applies to discrete or continuous time. When the relevant quantities are probabilities, confirm the conditioning event and whether samples are independent. When complex amplitudes occur, remember that a conjugate, not a real transpose, normally defines an energy inner product. Where a ratio of powers is stated in decibels, 10 log10 rather than 20 log10 is the appropriate conversion; for voltage magnitudes with identical impedances, a 20 log10 form may be suitable. This model is one part of the signal processing chain, not a substitute for a performance measurement.

Derive, calculate and inspect

First mark the source of the input and output quantities in A two-transmit one-receive Alamouti block sends [[s1,s2],[-s2,s1]] across two time slots under a channel constant over the block, enabling linear orthogonal combining.. State which symbols are known, which must be estimated and which are chosen by design. Translate the equation into a reproducible step-by-step computation, then test zero or very small noise, an intermediate operating point and a stressed case. A result should remain physically interpretable under these changes. Where the relationship is approximate, determine the approximation error before interpreting small performance improvements as significant. Never add gains or losses twice because the same physical effect appears in two bookkeeping categories.

Fully explained example and verification

Let h1=1 and h2=0.5 be fixed, with s1=+1 and s2=-1 real. At time one, y1=h1s1+h2s2=0.5. At time two, y2=h1(-s2)+h2s1=1.5. Combining gives s1_hat=(h1y1+h2y2)/(h1²+h2²)=1, and s2_hat=(h2y1-h1y2)/(h1²+h2²)=-1, with zero noise.

How to verify: Recompute the numeric statement from the specified inputs without reading a plotted curve. Re-run after increasing the most influential input by 10%, and explain the direction and approximate size of the change. Then compare that outcome with the limiting case for the model. A plausible number is not sufficient if the observation plane, normalization or statistical assumptions have changed.

Boundary conditions and common mistakes

If the channel changes between time slots, the textbook orthogonality cancellation no longer holds exactly. Antenna power normalization must also be stated when comparing with one-transmit operation.

An additional failure mode in mobile vehicle-to-infrastructure channel arises when the local mechanism is interpreted as an end-to-end guarantee. For example, packets may be rejected by framing or replay checks even after an error-correcting decoder outputs a plausible bit sequence; conversely, a successful frame may be too late to serve a time-critical application. To separate causes, log the inputs and outputs of each major subsystem, retain the raw observation when possible, and name the exact stage at which a failure is declared.

Guided computational experiment

Encode QPSK symbol pairs using the Alamouti map, pass through independent fixed channel coefficients, and recover them with and without channel estimation errors. Test time-varying coefficients.

Reproducibility protocol. Record the independent variables, their increments and physical units; state random seeds, number of simulated trials and target metrics. Use two numerical implementations for at least one predicted point. When drawing a probability curve, use enough trials to estimate its uncertainty and report the confidence interval; small error counts produce unstable estimates. When a parameter sweep crosses a model limit, annotate the plot rather than truncating inconvenient results.

Problem set with targeted response guidance

Question 1. Reference planes and dimensional consistency

Draw the component-level path through a moving vehicle exchanges sensor messages while surrounding reflectors change. Label exactly where the inputs to “A two-transmit one-receive Alamouti block sends [[s1,s2],[-s2,s1]] across two time slots under a channel constant over the block, enabling linear orthogonal combining.” are acquired or estimated. Construct a three-column table of quantity, unit, and uncertainty source. Identify one tempting but invalid substitution and explain which physical interface it crosses.

Answer guidance: A complete solution has a block diagram and a clear distinction between physical measurement and algorithmic estimate. For space-time block coding and alamouti structure, justify every normalization and explicitly say what is held constant when comparing two conditions.

Question 2. Rebuild the numerical case

Independently reconstruct the worked calculation for space-time block coding and alamouti structure. Change the leading numerical parameter by 20%, holding other inputs fixed, and explain whether the result changes linearly or nonlinearly. Supply every intermediate numerical step.

Answer guidance: The answer must reproduce the worked statement under its stated assumptions, account for units, and include an inverse or limiting check. If a result disagrees, trace the exact operation; do not round intermediate values until the final display.

Question 3. Competing design changes

For mobile vehicle-to-infrastructure channel, propose two ways to improve the outcome represented by A two-transmit one-receive Alamouti block sends [[s1,s2],[-s2,s1]] across two time slots under a channel constant over the block, enabling linear orthogonal combining.: one changes a transmitter or source parameter, the other changes receiver processing. List their respective energy, implementation, latency and spectral costs.

Answer guidance: Grade the response on tradeoffs, not a single optimization metric. For this topic, specify which impairment each intervention addresses and whether a gain in one stage increases overhead elsewhere.

Question 4. Break the assumptions

Create a deliberately unrealistic operating point for space-time block coding and alamouti structure and explain a specific broken assumption. Then propose a synthetic observation that would reveal the failure. Describe what a poorly documented analysis might incorrectly conclude.

Answer guidance: The response must identify an assumption explicitly and design a measurement that detects the discrepancy. Replacing one uncertain parameter with a convenient nominal value is not an assumption test.

Further engineering synthesis

To write a defensible report for space-time block coding and alamouti structure, separate evidence into three columns: a derivation, a reproducible numerical implementation and a system-level observation. The derivation establishes the modeled relationship; simulation checks implementation and explore cases that are hard to calculate by hand; field observation tests the relevance of modeling assumptions. Failure of a field measurement to match the derivation may reveal either a coding bug or a missing physical effect. Avoid the reflex to adjust free parameters until curves agree, because that conceals rather than explains uncertainty.

Finally trace the effect of space-time block coding and alamouti structure onto throughput, occupied bandwidth, energy per delivered information bit and deadline failures for mobile vehicle-to-infrastructure channel. Describe which of these metrics has a monotonic response to parameter changes and which displays a tradeoff. Explain the direction of the tradeoff with one numerical or plotted piece of evidence; where evidence is absent, label the claim as a hypothesis. Every numerical conclusion should be reproducible from recorded inputs.

Cross-reference: See the model for Unit 5, Unit 5 project brief and its assessment. The simulation depicts a deliberately simplified subproblem; it does not certify a live communication system.

Unit 5, Lesson 4: MIMO capacity and rank limitations

Module: Fading, diversity and spatial communication. Prerequisites: Communication Systems I, introductory probability, linear systems, complex algebra and elementary Python or JavaScript.

Learning outcomes

• Explain mimo capacity and rank limitations from a physical or algorithmic model rather than memorizing an isolated equation.

• Distinguish assumptions, symbols, measured quantities and synthesized values in a complete communications link.

• Perform an independent limiting-case check and identify an operating region where the model fails.

• Design and document a reproducible synthetic experiment that tests a stated prediction.

System context and motivating decision

Consider mobile vehicle-to-infrastructure channel: a moving vehicle exchanges sensor messages while surrounding reflectors change. In this setting, coverage holes and packet deadlines matter more than average SNR alone. The engineer therefore needs a model that is useful at the right reference plane, not an attractive formula copied from a different link. A quantity measured at the transmitter cannot automatically be used as if it were the receive-filter output, and uncoded symbol reliability cannot be silently treated as packet reliability. The purpose of this lesson is to connect mimo capacity and rank limitations with observable decisions in this chain.

Physical or algorithmic explanation

Multiple antennas can create spatial diversity, multiplexing gain or a beamforming advantage depending on channel rank, CSI and power allocation. A large antenna count does not guarantee equally many independent streams: channels aligned in spatial response can be nearly rank deficient. Singular-value decomposition exposes orthogonal spatial modes with different strengths. The log determinant capacity formula assumes Gaussian signaling and known channel at the receiver; practical coding, channel estimation and control traffic reduce deliverable throughput.

Core mathematical relationship

For Gaussian MIMO with channel H and receiver noise covariance I, C=log2 det(I+(ρ/Nt)HHᴴ) bits/s/Hz when transmit power is equally allocated over Nt antennas and ρ is total linear SNR.

Meaning and conventions

The central expression above describes mimo capacity and rank limitations. Before calculating, identify the set of variables, their units and whether the expression applies to discrete or continuous time. When the relevant quantities are probabilities, confirm the conditioning event and whether samples are independent. When complex amplitudes occur, remember that a conjugate, not a real transpose, normally defines an energy inner product. Where a ratio of powers is stated in decibels, 10 log10 rather than 20 log10 is the appropriate conversion; for voltage magnitudes with identical impedances, a 20 log10 form may be suitable. This model is one part of the signal processing chain, not a substitute for a performance measurement.

Derive, calculate and inspect

First mark the source of the input and output quantities in For Gaussian MIMO with channel H and receiver noise covariance I, C=log2 det(I+(ρ/Nt)HHᴴ) bits/s/Hz when transmit power is equally allocated over Nt antennas and ρ is total linear SNR.. State which symbols are known, which must be estimated and which are chosen by design. Translate the equation into a reproducible step-by-step computation, then test zero or very small noise, an intermediate operating point and a stressed case. A result should remain physically interpretable under these changes. Where the relationship is approximate, determine the approximation error before interpreting small performance improvements as significant. Never add gains or losses twice because the same physical effect appears in two bookkeeping categories.

Fully explained example and verification

For a 2x2 identity channel with ρ=10 and equal power, each of two eigenmodes has SNR 5, giving C=2 log2(1+5)=5.1699 bits/s/Hz. For an effective rank-one channel with a single eigenmode of energy 2 at the same power split, C=log2(1+10)=3.4594 bits/s/Hz. The example holds normalization fixed but channels differ in rank.

How to verify: Recompute the numeric statement from the specified inputs without reading a plotted curve. Re-run after increasing the most influential input by 10%, and explain the direction and approximate size of the change. Then compare that outcome with the limiting case for the model. A plausible number is not sufficient if the observation plane, normalization or statistical assumptions have changed.

Boundary conditions and common mistakes

Capacity is not the modulation order or an achievable payload rate without coding and overhead. A nearly singular channel can make naive spatial multiplexing extremely error-prone.

An additional failure mode in mobile vehicle-to-infrastructure channel arises when the local mechanism is interpreted as an end-to-end guarantee. For example, packets may be rejected by framing or replay checks even after an error-correcting decoder outputs a plausible bit sequence; conversely, a successful frame may be too late to serve a time-critical application. To separate causes, log the inputs and outputs of each major subsystem, retain the raw observation when possible, and name the exact stage at which a failure is declared.

Guided computational experiment

Build diagonal and correlated 2x2 channel matrices and calculate singular values and capacity. Compare equal-power allocation with water-filling in a stated CSI regime.

Reproducibility protocol. Record the independent variables, their increments and physical units; state random seeds, number of simulated trials and target metrics. Use two numerical implementations for at least one predicted point. When drawing a probability curve, use enough trials to estimate its uncertainty and report the confidence interval; small error counts produce unstable estimates. When a parameter sweep crosses a model limit, annotate the plot rather than truncating inconvenient results.

Problem set with targeted response guidance

Question 1. Reference planes and dimensional consistency

Draw the component-level path through a moving vehicle exchanges sensor messages while surrounding reflectors change. Label exactly where the inputs to “For Gaussian MIMO with channel H and receiver noise covariance I, C=log2 det(I+(ρ/Nt)HHᴴ) bits/s/Hz when transmit power is equally allocated over Nt antennas and ρ is total linear SNR.” are acquired or estimated. Construct a three-column table of quantity, unit, and uncertainty source. Identify one tempting but invalid substitution and explain which physical interface it crosses.

Answer guidance: A complete solution has a block diagram and a clear distinction between physical measurement and algorithmic estimate. For mimo capacity and rank limitations, justify every normalization and explicitly say what is held constant when comparing two conditions.

Question 2. Rebuild the numerical case

Independently reconstruct the worked calculation for mimo capacity and rank limitations. Change the leading numerical parameter by 20%, holding other inputs fixed, and explain whether the result changes linearly or nonlinearly. Supply every intermediate numerical step.

Answer guidance: The answer must reproduce the worked statement under its stated assumptions, account for units, and include an inverse or limiting check. If a result disagrees, trace the exact operation; do not round intermediate values until the final display.

Question 3. Competing design changes

For mobile vehicle-to-infrastructure channel, propose two ways to improve the outcome represented by For Gaussian MIMO with channel H and receiver noise covariance I, C=log2 det(I+(ρ/Nt)HHᴴ) bits/s/Hz when transmit power is equally allocated over Nt antennas and ρ is total linear SNR.: one changes a transmitter or source parameter, the other changes receiver processing. List their respective energy, implementation, latency and spectral costs.

Answer guidance: Grade the response on tradeoffs, not a single optimization metric. For this topic, specify which impairment each intervention addresses and whether a gain in one stage increases overhead elsewhere.

Question 4. Break the assumptions

Create a deliberately unrealistic operating point for mimo capacity and rank limitations and explain a specific broken assumption. Then propose a synthetic observation that would reveal the failure. Describe what a poorly documented analysis might incorrectly conclude.

Answer guidance: The response must identify an assumption explicitly and design a measurement that detects the discrepancy. Replacing one uncertain parameter with a convenient nominal value is not an assumption test.

Further engineering synthesis

To write a defensible report for mimo capacity and rank limitations, separate evidence into three columns: a derivation, a reproducible numerical implementation and a system-level observation. The derivation establishes the modeled relationship; simulation checks implementation and explore cases that are hard to calculate by hand; field observation tests the relevance of modeling assumptions. Failure of a field measurement to match the derivation may reveal either a coding bug or a missing physical effect. Avoid the reflex to adjust free parameters until curves agree, because that conceals rather than explains uncertainty.

Finally trace the effect of mimo capacity and rank limitations onto throughput, occupied bandwidth, energy per delivered information bit and deadline failures for mobile vehicle-to-infrastructure channel. Describe which of these metrics has a monotonic response to parameter changes and which displays a tradeoff. Explain the direction of the tradeoff with one numerical or plotted piece of evidence; where evidence is absent, label the claim as a hypothesis. Every numerical conclusion should be reproducible from recorded inputs.

Cross-reference: See the model for Unit 5, Unit 5 project brief and its assessment. The simulation depicts a deliberately simplified subproblem; it does not certify a live communication system.

Unit 5 project — Fading, diversity and spatial communication

Design brief

Create an original computer-based engineering investigation of mobile vehicle-to-infrastructure channel: a moving vehicle exchanges sensor messages while surrounding reflectors change. The stakeholder fears that coverage holes and packet deadlines matter more than average SNR alone. Deliver a short technical report that combines the four models in Unit 5, an independent numeric calculation, a simple synthetic implementation and a comparison between two candidate solutions.

Required artifact A — model assumptions and operating points

Write a system block diagram and a table defining the reference points for all quantities in the four lessons. Include a benign operating point and two stresses, one concerning time, frequency and spatial diversity and the other concerning mimo capacity and rank limitations. Give symbolic units and numerical values. Make clear which values are synthetic; do not label simulated observations as measured data.

Required artifact B — two methods, one controlled comparison

Implement an equation or algorithm from Rayleigh fading statistics and outage, then independently recompute a selected point. Next vary an input related to Space-time block coding and Alamouti structure while holding the baseline model fixed. Record the dependent metric at at least ten settings; if the output is an estimated failure probability, run multiple seeds and show sampling uncertainty. Report a parameter setting at which the second candidate outperforms the first and one at which it does not.

Required artifact C — intentionally broken assumption

The limitations you must investigate include: (1) Shadow fading, spatial correlation and a line-of-sight component change the distribution. A Rayleigh formula cannot describe all propagation environments or a site-specific coverage map. (2) If the channel changes between time slots, the textbook orthogonality cancellation no longer holds exactly. Antenna power normalization must also be stated when comparing with one-transmit operation. Choose the more relevant limitation for mobile vehicle-to-infrastructure channel, inject an impairment that invalidates the original assumption, and explain in technical language why the ideal calculation no longer predicts the result. An analysis that merely says “noise got worse” will not pass this requirement.

Required artifact D — user-level consequence

The application is a moving vehicle exchanges sensor messages while surrounding reflectors change. Define payload size, raw resource rate, protocol overhead, retransmission rule and the deadline for an accepted message. Trace low-level failure through framing and decoding into delivery success, delay and useful goodput. Prefer a table containing both one-attempt performance and end-to-end outcomes. Explain what real deployment measurements would be required.

Reproducibility and reporting rubric

Submit the source code, version or runtime description, seed list, parameter ranges and generated CSV. Use descriptive filenames, include a short README with instructions for a fresh run, and test one identity or limiting case. Cite the assumptions that make each formula valid. Allocate 30% to physics and mathematical correctness, 25% to experiment design, 20% to interpretation and failure analysis, 15% to reproducibility, and 10% to clarity. An unsupported claim of production readiness receives no credit.

Oral defense prompts

Explain why Time, frequency and spatial diversity was included or excluded in the final design. Which numerical result is most sensitive to a poorly known parameter? What single new piece of hardware or field evidence would most change the conclusion? Finally, explain why the synthetic model is adequate for learning but does not establish a radio license, an optical product certification or safety compliance.

Unit 5 assessment — Fading, diversity and spatial communication

Context: a moving vehicle exchanges sensor messages while surrounding reflectors change

Problems (at least three required per unit)

Question 1: Rayleigh fading statistics and outage

Problem: Starting with For normalized Rayleigh flat fading, G=|h|² is exponential with mean 1; outage at threshold γ_th with mean SNR γ_bar is P_out=1-exp(-γ_th/γ_bar)., produce a dimensionally consistent worked example and one limiting case, then identify the violated assumption in this scenario: Shadow fading, spatial correlation and a line-of-sight component change the distribution. A Rayleigh formula cannot describe all propagation environments or a site-specific coverage map.

Mark scheme (10 points): 3 for model and assumptions, 3 for correct arithmetic or logical steps, 2 for limiting-case check, 2 for explaining why the stated limitation changes the conclusion. A correct final number without units and reference plane earns no more than 5 points.

Question 2: Time, frequency and spatial diversity

Problem: Starting with For independent exponentially distributed branch SNRs, selection combining of M equal-mean branches yields P_out=(1-exp(-γ_th/γ_bar))^M., produce a dimensionally consistent worked example and one limiting case, then identify the violated assumption in this scenario: Antenna spacing does not guarantee zero correlation, especially with narrow angular spread or nearby coupling. Noise covariance matters when forming optimal linear combiners.

Mark scheme (10 points): 3 for model and assumptions, 3 for correct arithmetic or logical steps, 2 for limiting-case check, 2 for explaining why the stated limitation changes the conclusion. A correct final number without units and reference plane earns no more than 5 points.

Question 3: Space-time block coding and Alamouti structure

Problem: Starting with A two-transmit one-receive Alamouti block sends [[s1,s2],[-s2,s1]] across two time slots under a channel constant over the block, enabling linear orthogonal combining., produce a dimensionally consistent worked example and one limiting case, then identify the violated assumption in this scenario: If the channel changes between time slots, the textbook orthogonality cancellation no longer holds exactly. Antenna power normalization must also be stated when comparing with one-transmit operation.

Mark scheme (10 points): 3 for model and assumptions, 3 for correct arithmetic or logical steps, 2 for limiting-case check, 2 for explaining why the stated limitation changes the conclusion. A correct final number without units and reference plane earns no more than 5 points.

Question 4: MIMO capacity and rank limitations

Problem: Starting with For Gaussian MIMO with channel H and receiver noise covariance I, C=log2 det(I+(ρ/Nt)HHᴴ) bits/s/Hz when transmit power is equally allocated over Nt antennas and ρ is total linear SNR., produce a dimensionally consistent worked example and one limiting case, then identify the violated assumption in this scenario: Capacity is not the modulation order or an achievable payload rate without coding and overhead. A nearly singular channel can make naive spatial multiplexing extremely error-prone.

Mark scheme (10 points): 3 for model and assumptions, 3 for correct arithmetic or logical steps, 2 for limiting-case check, 2 for explaining why the stated limitation changes the conclusion. A correct final number without units and reference plane earns no more than 5 points.

Question 5: Joint design

Combine two lessons in the mobile vehicle-to-infrastructure channel case. Propose a before/after experiment where only one controlled variable changes and show how you will report both a link-level metric and a delivered-payload metric.

Mark scheme: prioritize controlled comparison (4), technically justified outcome (4), reproducible evidence (2).

Question 6: Critical evidence review

Find a plausible but unsupported claim of improvement, identify which additional variable may account for the effect, and design one negative control to disprove your own conclusion.

Mark scheme: claims supported by computed or experimentally generated data receive credit; appeals to authority or unsupported statements do not.

Submission policy

Use explicit parameter values, code or workings, and a conclusion that distinguishes verified arithmetic from engineering assumptions.