Shannon-Hartley theorem - Wikipedia, the free encyclopedia
Shannon-Hartley theorem. From Wikipedia, the free encyclopedia. Jump ... 3 Implications of the theorem. 3.1 Comparison of Shannon's capacity to Hartley's law ...
en.wikipedia.org

Shannon-Hartley Theorem - Hill2dot0
The Shannon-Hartley Theorem is a theorem in information theory that establishes ... So the Shannon-Hartley Theorem tells us that the maximum bit rate of a given ...
www.hill2dot0.com

Shannon-Hartley theorem
The Shannon-Hartley theorem tells the maximum amount of error-free digital data ... The theorem, named after its developers, Claude Shannon and Ralph Hartley, both ...
www.linfo.org

Talk:Shannon-Hartley theorem - Wikipedia, the free encyclopedia
Talk:Shannon-Hartley theorem. From Wikipedia, the free encyclopedia. Jump to: navigation, search ... should be merged and redirected to Shannon-Hartley theorem. ...
en.wikipedia.org

Noisy-channel coding theorem - Network Dictionary Wiki
Stated by Claude Shannon in 1948, the theorem describes the maximum possible ... a band-limited channel with Gaussian noise, using the Shannon-Hartley theorem. ...
wiki.networkdictionary.com

Claude E. Shannon
Claude Elwood Shannon (April 30, 1916 - February 24, 2001) has been called "the ... Shannon's theorem, Shannon-Hartley law, Nyquist-Shannon sampling theorem, ...
academickids.com

Claude E. Shannon - Wikinfo
Claude Elwood Shannon (April 30, 1916 - February 24, 2001) has been called "the ... Shannon's theorem, Shannon-Hartley law, Nyquist-Shannon sampling theorem, ...
www.wikinfo.org

xMax meets Shannon once again ... " Wireless Facts and Fiction
... referred to as the Shannon-Hartley theorem which establishes the channel ... In an analogous way, the Shannon theorem provides an absolute lower limit on the ...
marconig.wordpress.com

Turbo code
Turbo code: Encyclopedia II - Shannon-Hartley theorem - Introduction ... white Gaussian noise channel, Shannon-Hartley theorem - Examples ...
www.experiencefestival.com

Bandwidth - Facts, Encyclopedia article, and Discussion forum
Shannon-Hartley Theorem " Signal Processing " Spectral Line " Spectroscopy. Topic Home ... According to the Shannon-Hartley theorem, the data rate of reliable ...
www.absoluteastronomy.com

Warning: mkdir() [function.mkdir]: Permission denied in /home/webs/affiliatelib2/CacheManager.php on line 12

Warning: mkdir() [function.mkdir]: No such file or directory in /home/webs/affiliatelib2/CacheManager.php on line 12

Warning: fopen(/home/templatecore2cache//*cluesnet.com/c8/c8e42faacd73727257ce257dec160b673c4618bb.tc2cache) [function.fopen]: failed to open stream: No such file or directory in /home/webs/affiliatelib2/CacheManager.php on line 130

Warning: fwrite(): supplied argument is not a valid stream resource in /home/webs/affiliatelib2/CacheManager.php on line 131

Warning: fclose(): supplied argument is not a valid stream resource in /home/webs/affiliatelib2/CacheManager.php on line 132

In information theory, the Shannon–Hartley theorem is an application of the noisy channel coding theorem to the archetypal case of a continuous-time analog communications channel subject to Gaussian noise. The theorem establishes Shannon's channel capacity, a bound on the maximum amount of error-free digital data (that is, information) that can be transmitted over such a communication link with a specified bandwidth in the presence of the noise interference, under the assumption that the signal power is bounded and the Gaussian noise process is characterized by a known power or power spectral density. The law is named after Claude Elwood Shannon and Ralph Hartley.

Statement of the theorem Considering all possible multi-level and multi-phase encoding techniques, the Shannon–Hartley theorem states that the channel capacity C, meaning the theoretical tightest upper bound on the rate of clean (or arbitrarily low bit error rate) data that can be sent with a given average signal power S through an analog communication channel subject to additive white Gaussian noise of power N, is:

C = B \log_2 \left( 1+\frac{S}{N} \right)

where C is the channel capacity in bits per second; B is the bandwidth of the channel in hertz; S is the total signal power over the bandwidth, measured in watt or volt2; N is the total noise power over the bandwidth, measured in watt or volt2; and S/N is the signal-to-noise ratio (SNR) or the carrier-to-noise ratio (CNR) of the communication signal to the Gaussian noise interference expressed as a straight power ratio (not as decibels).

Historical development During the late 1920s, Harry Nyquist and Ralph Hartley developed a handful of fundamental ideas related to the transmission of information, particularly in the context of the telegraph as a communications system. At the time, these concepts were powerful breakthroughs individually, but they were not part of a comprehensive theory. In the 1940s, Claude Elwood Shannon developed the concept of channel capacity, based in part on the ideas of Nyquist and Hartley, and then formulated a complete theory of information and its transmission.

Nyquist rate In 1927, Nyquist determined that the number of independent pulses that could be put through a telegraph channel per unit time is limited to twice the bandwidth of the channel. In symbols,

f_p \le 2B \,

where fp is the pulse frequency (in pulses per second) and B is the bandwidth (in hertz). The quantity 2B later came to be called the Nyquist rate, and transmitting at the limiting pulse rate of 2B pulses per second as signalling at the Nyquist rate. Nyquist published his results in 1928 as part of his paper "Certain topics in Telegraph Transmission Theory."

Hartley's law During that same year, Hartley formulated a way to quantify information and its rate of transmission across a communications channel. This method, later known as Hartley's law, became an important precursor for Shannon's more sophisticated notion of channel capacity.

Hartley argued that the maximum number of distinct pulses that can be transmitted and received reliably over a communications channel is limited by the dynamic range of the signal amplitude and the precision with which the receiver can distinguish amplitude levels. Specifically, if the amplitude of the transmitted signal is restricted to the range of –A ... +A volts, and the precision of the receiver is +/– ΔV volts, then the maximum number of distinct pulses M is given by

M = 1 + { A \over \Delta V }

By taking information per pulse in bit/pulse to be the base-2-logarithm of the number of distinct messages M that could be sent, Hartley constructed a measure of the information rate R as:

R = f_p \log_2(M) \, ,

where fp is the pulse rate, also known as the symbol rate, in symbols/second or baud.

Hartley then combined the above quantification with Nyquist's observation that the number of independent pulses that could be put through a channel of bandwidth B hertz was 2B pulses per second, to arrive at his quantitative measure for achievable information rate.

Hartley's law is sometimes quoted as just a proportionality between the analogue bandwidth B in Hertz and what today is called the digital bandwidth R in bit/s.Other times it is quoted in this more quantitative form, as an achievable information rate of R bits per second:

R \le 2B \log_2(M)

Hartley did not work out exactly how the number M should depend on the noise statistics of the channel, or how the communication could be made reliable even when individual symbol pulses could not be reliably distinguished to M levels; with Gaussian noise statistics, system designers had to choose a very conservative value of M to achieve a low error rate.

The concept of an error-free capacity awaited Claude Shannon, who built on Hartley's observations about a logarithmic measure of information and Nyquist's observations about the effect of bandwidth limitations.

Hartley's rate result can be viewed as the capacity of an errorless M-ary channel of 2B symbols per second. Some authors refer to it as a capacity. But such an errorless channel is an idealization, and the result is necessarily less than the Shannon capacity of the noisy channel of bandwidth B, which is the Hartley–Shannon result that followed later.

Noisy channel coding theorem and capacity Claude Elwood Shannon's development of information theory during World War II provided the next big step in understanding how much information could be reliably communicated through noisy channels. Building on Hartley's foundation, Shannon's noisy channel coding theorem (1948) describes the maximum possible efficiency of error-correcting code versus levels of noise interference and data corruption. The proof of the theorem shows that a randomly constructed error correcting code is essentially as good as the best possible code; the theorem is proved through the statistics of such random codes.

Shannon's theorem shows how to compute a channel capacity from a statistical description of a channel, and establishes that given a noisy channel with capacity C and information transmitted at a rate R, then if

R < C \,

there exists a coding technique which allows the probability of error at the receiver to be made arbitrarily small. This means that theoretically, it is possible to transmit information nearly without error up to nearly a limit of C bits per second.

The converse is also important. If

R > C \,

the probability of error at the receiver increases without bound as the rate is increased. So no useful information can be transmitted beyond the channel capacity. The theorem does not address the rare situation in which rate and capacity are equal.

Shannon–Hartley theorem The Shannon–Hartley theorem establishes what that channel capacity is, for a finite-bandwidth continuous-time channel subject to Gaussian noise. It connects Hartley's result with Shannon's channel capacity theorem in a form that is equivalent to specifying the M in Hartley's information rate formula in terms of a signal-to-noise ratio, but achieving reliability through error-correction coding rather than through reliably distinguishable pulse levels.

If there were such a thing as an infinite-bandwidth, noise-free analog channel, one could transmit unlimited amounts of error-free data over it per unit of time. Real channels, however, are subject to limitations imposed by both finite bandwidth and nonzero noise.

So how do bandwidth and noise affect the rate at which information can be transmitted over an analog channel?

Surprisingly, bandwidth limitations alone do not impose a cap on maximum information rate. This is because it is still possible for the signal to take on an indefinitely large number of different voltage levels on each symbol pulse, with each slightly different level being assigned a different meaning or bit sequence. If we combine both noise and bandwidth limitations, however, we do find there is a limit to the amount of information that can be transferred by a signal of a bounded power, even when clever multi-level encoding techniques are used.

In the channel considered by the Shannon-Hartley theorem, noise and signal are combined by addition. That is, the receiver measures a signal that is equal to the sum of the signal encoding the desired information and a continuous random variable that represents the noise. This addition creates uncertainty as to the original signal's value. If the receiver has some information about the random process that generates the noise, one can in principle recover the information in the original signal by considering all possible states of the noise process. In the case of the Shannon-Hartley theorem, the noise is assumed to be generated by a Gaussian process with a known variance. Since the variance of a Gaussian process is equivalent to its power, it is conventional to call this variance the noise power.

Such a channel is called the Additive White Gaussian Noise channel, because Gaussian noise is added to the signal; "white" means equal amounts of noise at all frequencies within the channel bandwidth. Such noise can arise both from random sources of energy and also from coding and measurement error at the sender and receiver respectively. Since sums of independent Gaussian random variables are themselves Gaussian random variables, this conveniently simplifies analysis, if one assumes that such error sources are also Gaussian and independent.

Implications of the theorem Comparison of Shannon's capacity to Hartley's law Comparing the channel capacity to the information rate from Hartley's law, we can find the effective number of distinguishable levels M:{{cite book | title = An Introduction to Information Theory: symbols, signals & noise| author = John Robinson Pierce | url = http://books.google.com/books?id=fXxde44_0zsC&pg=PP1&ots=5E_3-muERA&dq=intitle:information+intitle:theory+inauthor:pierce&sig=k7r9ow9BK5AG8sF6ie8DlA22tXk#PPA146,M1 | publisher = Courier Dover Publications | year = 1980 | isbn = 0486240614 -->

2B \log_2(M) = B \log_2 \left( 1+\frac{S}{N} \right) M = \sqrt{1+\frac{S}{N-->

The square root effectively converts the power ratio back to a voltage ratio, so the number of levels is approximately proportional to the ratio of root mean square signal amplitude to noise standard deviation.

This similarity in form between Shannon's capacity and Hartley's law should not be interpreted to mean that M pulse levels can be literally sent without any confusion; more levels are needed, to allow for redundant coding and error correction, but the net data rate that can be approached with coding is equivalent to using that M in Hartley's law.

Alternative forms Frequency-dependent (colored noise) case In the simple version above, the signal and noise are fully uncorrelated, and in that case S + N is the total power of the received signal and noise together. A generalization of the above equation for the case where the additive noise is not white (or that the S/N is not constant with frequency over the bandwidth) is obtained by treating the channel as many narrow, independent Gaussian channels in parallel:

C = \int_{0}^B \log_2 \left( 1+\frac{S(f)}{N(f)} \right) df

where C is the channel capacity in bits per second; B is the bandwidth of the channel in Hz; S(f) is the signal power spectrum N(f) is the noise power spectrum f is frequency in Hz.

Note: the theorem only applies to noises that are Gaussian stationary processes. This formula's way of introducing frequency-dependent noise cannot describe all continuous-time noise processes. For example, consider a noise process that consists of adding a random wave whose amplitude is 1 or -1 at any point in time, and a channel that adds such a wave to the source signal. Such a wave's frequency components are highly dependent. Though such a noise may have a high power, it is fairly easy to transmit a continuous signal with much less power than one would need if the underlying noise was a sum of independent noises in each frequency band.

Approximations For large or small and constant signal-to-noise ratios, the capacity formula can be approximated:

• If S/N >> 1, then

: C \approx 0.332 \cdot B \cdot \mathrm{SNR (in \ dB)} where ::\mathrm{SNR (in \ dB)} = 10\log_{10}{S \over N}

• Similarly, if S/N
  
  

  Shannon–Hartley theorem - Wikipedia, the free encyclopedia
  edit] Statement of the theorem. Considering all possible multi-level and multi-phase encoding techniques, the Shannon–Hartley theorem states that the channel capacity C, meaning ...

  Noisy-channel coding theorem - Wikipedia, the free encyclopedia
  edit] Overview. Stated by Claude Shannon in 1948, the theorem describes the maximum possible efficiency of error-correcting methods versus levels of noise interference and data ...

  CS3282: Digital Communications '05-'06 Section 7: The Shannon-Hartley ...
  The Shannon-Hartley Theorem. This is a famous theorem of information theory that gives us a theoretical maximum bit-rate that can be transmitted with an arbitrarily small bit-error ...

  Digital Communications \(CS3282\)
  University of Manchester CS3282: Digital Communications 2005 Section 7: The Shannon-Hartley Theorem. Digital Communications \(CS3282\)

  Shannon-Hartley theorem
  The Shannon-Hartley theorem tells the maximum amount of error-free digital data that can be transmitted over a communications channel (e.g., a copper wire or an optical fiber) with ...

  INEX: Wikipedia, the free encyclopedia (Shannon–Hartley theorem)
  Table of Contents. 1 Theorem; 2 Capacity of the additive white gaussian noise channel; 3 Examples; 4 References; 5 See also; 6 External links; In information theory, the Shannon ...

  Channel Capacity
  ... errors per second will also increase. Surprisingly, however, this is not the case . Shannon ... to develop a coding method that reaches the channel capacity. The negation of this theorem ...

  Shannon's Law - Wikiversity
  The Shannon-Hartley Capacity Theorem, more commonly known as the Shannon-Hartley theorem or Shannon's Law, relates the system capacity of a channel with the averaged recieved ...

  Shannon's Law - Definition at the #1 Online Dictionary
  Shannon's Law also is known as the Shannon-Hartley theorem, as Shannon developed the theorem in collaboration with R.V.L. Hartley, a colleague at Bell Labs.

  Shannon-Hartley law
  ... below the noise level, using wide bandwidth communication, as in spread spectrum communications. The law is named after Claude Shannon and Ralph Hartley. See also Shannon's theorem