
	Where results make sense

Topic: A Mathematical Theory of Communication

Related Topics

Communication Theory of Secrecy Systems

Bell System Technical Journal

Information theory

Claude Shannon

Warren Weaver

Information entropy

On Computable Numbers

Bell Telephone Laboratories

Telecommunication

RBOC

Transfer function

Mathematician

Packet switching

Leonhard Euler

John Venn

In the News (Tue 24 Nov 09)

Northern Trust

Marvin Harrison

Peter Chernin

Gary Locke

Match Play

Penelope Cruz

Mickey Rourke

AR Rahman

Danny Boyle

Hugh Jackman

	Information theory - Wikipedia, the free encyclopedia
		His theory for the first time considered communication as a rigorously stated mathematical problem in statistics and gave communications engineers a way to determine the capacity of a communication channel in terms of the common currency of bits.
		This division of information theory into compression and transmission is justified by the information transmission theorems, or source-channel separation theorems that justify the use of bits as the universal currency for information in many contexts.
		The theory is almost universally rejected by the scientific community, though some feel it might be able to create algorithms which could detect intelligence in purely naturalistic settings, and that Dembski's idea might actually have some utility, though not in the way he intended.
	en.wikipedia.org /wiki/Information_theory (1591 words)

	UCSB English Dept: Alan Liu: Study Materials
		A basis for such a theory is contained in the important papers of Nyquist[1] and Hartley[2] on this subject.
		In the present paper we will extend the theory to include a number of new factors, in particular the effect of noise in the channel, and the savings possible due to the statistical structure of the original message and due to the nature of the final destination of the information.
		The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point.
	www.english.ucsb.edu /faculty/ayliu/unlocked/shannon/mathematical-theory.html (1228 words)

	Information theory
		Information theory is a branch of the mathematical theory of probability and mathematical statistics, that quantifies the concept of information.
		The transmission part of the theory is not concerned with the meaning (semantics) of the message conveyed, though the complementary wing of information theory concerns itself with content through lossy compression of messages subject to a fidelity criterion.
		These two wings of information theory are joined together and mutually justified by the information transmission theorems, or source-channel separation theorems that justify the use of bits as the universal currency for information in many contexts.
	www.sciencedaily.com /encyclopedia/information_theory (719 words)

	Theory of Data Compression
		In his 1948 paper, ``A Mathematical Theory of Communication,'' Claude E. Shannon formulated the theory of data compression.
		Lossless data compression theory and rate-distortion theory are known collectively as source coding theory.
		The theory assumes that the statistical properties of the source is known.
	www.data-compression.com /theory.shtml (2876 words)

	[No title]
		Thus for a communication source one can say, just as he would also say it of a thermodynamic ensemble, This situation is highly organized, it is not characterized by a large degree of randomness or of choice -- that is to say, the information (0r the entropy) is low.
		This means, of course, that the theory is sufficiently imaginatively motivated so that it is dealing with the real inner core of the communication problem--with those basic relationships which hold in general, no matter what special form the actual case may take.
		It is an evidence of this generality that the theory contributes importantly to, and in fact is really the basic theory of cryptography which is, of course, a form of coding.
	www.uoregon.edu /~felsing/virtual_asia/info.html (2161 words)

	Shannon (Site not responding. Last check: 2007-10-09)
		Communication was then thought of as requiring electromagnetic waves to be sent down a wire.
		In A Mathematical Theory of Communication, which introduced the word "bit" for the first time, Shannon showed that adding extra bits to a signal allowed transmission errors to be corrected.
		He had held a position as a visiting professor of communication sciences and mathematics at the Massachusetts Institute of Technology in 1956, then from 1957 he was appointed to the Faculty there, but remained a consultant with Bell Telephones.
	www-groups.dcs.st-and.ac.uk /%7Ehistory/Mathematicians/Shannon.html (1214 words)

	Recent Contributions to the Mathematical Theory of Communication (Site not responding. Last check: 2007-10-09)
		The mathematical theory of the engineering aspects of communication, as developed chiefly by Claude Shannon at the Bell Telephone Laboratories, admittedly applies in the first instance only to problem A, namely, the technical problem of accuracy of transference of various types of signals from sender to receiver.
		Thus the theory of Level A is, at least to a significant degree, also a theory of levels B and C. I hope that the succeeding parts of this memorandum will illuminate and justify these last remarks.
		The obvious first remark, and indeed the remark that carries the major burden of the argument, is that the mathematical theory is exceedingly general in its scope, fundamental in the problems it treats, and of classic simplicity and power in the results it reaches.
	academic.evergreen.edu /a/arunc/compmusic/weaver/weaver.html (7857 words)

	shannonbio.html
		His best subjects in school were science and mathematics, and at home he constructed such devices as model planes, a radio-controlled model boat and a telegraph system to a friend's house half a mile away.
		In a paper ``Communication Theory of Secrecy Systems'' [25] cryptography is related to communication in a noisy channel, the ``noise'' being in this case the scrambling by the key of the cryptographic system.
		Among these were communications systems with feedback and a study of the rate at which it is possible to approach ideal coding as a function of delay.
	www.research.att.com /~njas/doc/shannonbio.html (3740 words)

	claude shannon - computer science theory
		This led him to think about a mathematical way to describe the open and closed states, and he recalled the logical theories of mathematician George Boole, who in the middle 1800s advanced what he called the logic of thought, in which all equations were reduced to a binary system consisting of zeros and ones.
		Shannon’s information theories eventually saw application in a number of disciplines in which language is a factor, including linguistics, phonetics, psychology and cryptography, which was an early love of Shannon’s.
		His theories also became a cornerstone of the developing field of artificial intelligence, and in 1956 he was instrumental in convening a conference at Dartmouth College that was the first major effort in organizing artificial intelligence research.
	www.thocp.net /biographies/shannon_claude.htm (1372 words)

	CLAUDE SHANNON
		The concept of entropy was an important feature of Shannon's theory, which he demonstrated to be equivalent to a shortage in the information content (a degree of uncertainty) in a message.
		Besides Shannon's theory of communication, he published a classic paper "A Symbolic Analysis of Relay and Switching Circuits." This paper point out the identity between the two "truth values" of symbolic logic and the binary values 1 and 0 of electronic circuits.
		Shannon is as the founding father of electronic communications age since he noticed and discovered the similarity between Boolean algebra and the telephone switching circuits.
	www.nyu.edu /pages/linguistics/courses/v610003/shan.html (1917 words)

	Information News & Theory - Daily Republican Newspaper - The Nation's Daily (Site not responding. Last check: 2007-10-09)
		Claude Shannon's "A mathematical theory of communication" was first published in two parts in the July and October 1948 editions of the Bell System Technical Journal.
		The 1948 "A Mathematical Theory of Communication" paper on information theory included this statement "the fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point." Shannon's paper was an immediate success with communications engineers and stimulated the technology which led to today's Information Age.
		Prefaced by Warren Weaver's introduction, ``Recent contributions to the mathematical theory of communication,'' the paper was included in The Mathematical Theory of Communication, published by the University of Illinois Press in 1949.
	www.dailyrepublican.com /information_trans.html (1658 words)

	Ingenuity - 3/00 - Coming to a theater near you! : The Mathematical Theory of Communication (Site not responding. Last check: 2007-10-09)
		"The Mathematical Theory of Communication" by Claude E. Shannon-a book with important Illinois and ECE connections-will appear in the office of a mathematical genius in "Lost Souls," a story about a conspiracy to bring the devil to life in human form.
		Shannon's theory first appeared in the "Bell System Technical Journal" in 1948 and was published as a book a year later by the University of Illinois Press, along with an introductory essay by Warren Weaver.
		Shannon argued that all communication was essentially digital and could be partitioned into sources and channels, coders and decoders.
	www.ece.uiuc.edu /ingenuity/300/theory.html (370 words)

	Physiology (from information theory) -- Encyclopædia Britannica
		Almost as soon as Shannon's papers on the mathematical theory of communication were published in the 1940s, people began to consider the question of how messages are handled inside human beings.
		in mathematics and mechanics, theory that studies systems behaving unpredictably and randomly despite their seeming simplicity and fact that forces involved are supposedly governed by well-understood physical laws; applications of theory are diverse, including study of turbulent flow of fluids, irregularities in heartbeat, traffic jams, population dynamics, chemical...
		The theory's evolution in the 19th century was preceded by more than two centuries of observations of small life forms under the microscope.
	www.britannica.com /eb/article-214958 (817 words)

	Bell Labs: Claude Shannon, Father of Information Theory, Dies at 84 (Site not responding. Last check: 2007-10-09)
		Shannon's theories are as relevant today as they were when he first formulated them.
		He begins this pioneering paper on information theory by observing that "the fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point." He then proceeds to so thoroughly establish the foundations of information theory that his framework and terminology remain standard.
		Shannon's theory was an immediate success with communications engineers and stimulated the technology which led to today's Information Age.
	www.bell-labs.com /news/2001/february/26/1.html (468 words)

	Information Theory (Site not responding. Last check: 2007-10-09)
		It is an example of a theory that was initiated primarily by one man, the U.S. electrical engineer, Claude E. Shannon, whose initial ideas appeared in the article "The Mathematical Theory of Communication" in the Bell System Technical Journal (1948).
		While the central results are chiefly of interest to communication engineers, some of the concepts have been adopted and found useful in such fields as psychology and linguistics.
		The theory overlaps heavily with communication theory but is more oriented toward the fundamental limitations on the processing and communication of information and less oriented toward the detailed operation of the devices employed.
	www.dam.brown.edu /people/yiannis/info.html (600 words)

	The Mathematical Theory of Communication (Site not responding. Last check: 2007-10-09)
		The Mathematical Theory of Communication, by Claude Shannon and Warren Weaver.
		In the second essay, Weaver discusses the 3 levels of communication: a) the engineering level, b) the semantic level, and c) the action level.
		I think this aspect of communication is often overlooked, when it is ever considered.
	www.geocities.com /Athens/8994/read_029.html (461 words)

	Amazon.co.uk: The Mathematical Theory of Communication: Books (Site not responding. Last check: 2007-10-09)
		This is probably the most imprtant book in the whole of communications theory.
		As usual with breakthru authors, their efforts get commercially applied and the insightfulness of the original work is closeted, where it can conveniently be academically referred to "what he said was..." (ellipsis filled in by whatever your professor used to characterize the book.) Shannon took an early art form to a rigorous science.
		You will agree with me that focusing on the source rather than the sink (terms he coined) is the weakness of communication theory as currently modeled on Shannon's first, obvious conclusion.
	www.amazon.co.uk /exec/obidos/ASIN/0252725484 (632 words)

	DLIST - The Communication Turn in the Theory of Social Systems
		At the interfaces between systems theory, communication theory, and evolution theory puzzles emerge which can also be formulated as analytical and empirical questions.
		The mathematical theory of communication can be used for the clarification of the relations among these different perspectives, since a message is expected to contain an information.
		A Mathematical Theory of Communication I and II.
	dlist.sir.arizona.edu /102 (650 words)

	Communication Theory: A First Look
		Shannon’s published theory was paired with an interpretive essay by Weaver that presented information theory as ‘‘exceedingly general in its scope, fundamental in the problems it treats, and of classic simplicity and power in the results it reaches."1 The essay suggested that whatever the communication problem, reducing information loss was the solution.
		Since the discipline was ripe for a model of communication and information theory was there to fill the need, its source-channel-receiver diagram quickly became the standard description of what happens when one person talks to another.
		Comprehensive statement: Claude Shannon and Warren Weaver, The Mathematical Theory of Communication, University of Illinois, Urbana, 1949.
	www.afirstlook.com /archive/information.cfm?source=archther (3037 words)

	Transmission Model of Communication (Site not responding. Last check: 2007-10-09)
		They developed a model of communication which was intended to assist in developing a mathematical theory of communication.
		This is particularly important since it underlies the 'commonsense' understanding of what communication is. Whilst such usage may be adequate for many everyday purposes, in the context of the study of media and communication the concept needs critical reframing.
		One appalling consequence of the postal metaphor for communication is the current reference to 'delivering the curriculum' in schools, as a consequence of which teachers are treated as postal workers.
	www.aber.ac.uk /media/Documents/short/trans.html (3212 words)

	MS Communications
		Students in the program are mentored by faculty members who are active researchers in the theory and practice of communication.
		The communications industry is expanding rapidly with the dramatic growth in the use of cellular telephones, personal communication devices, and the internet for electronic commerce.
		To be admitted to the program, the student should have training equivalent to that required for an undergraduate degree in mathematics or electrical engineering with a strong background in mathematics.
	www.math.sdsu.edu /Math_Appl/ms_comm.htm (584 words)

	Claude Shannon: Mathematical Theory of Communication
		This was a jarring notion to a generation of engineers who were accustomed to thinking of communication in terms of sending electromagnetic waveforms down a wire.
		First printing of Shannon’s extremely influential theory of communication; virtually all electronic forms of communication today are indebted to Shannon’s work.
		He reduced the notion of information to a series of yes/no choices, which could be presented by a binary code.
	www.theworldsgreatbooks.com /shannon1.htm (347 words)

	Information about information theory. (Site not responding. Last check: 2007-10-09)
		It provided a new model for communication between humans (one that has met with mixed success, but one that still excites me).
		The Mathematical Theory of Communication by Claude Shannon and Warren Weaver is readily available as a book.
		Science and Information Theory by Leon Brillouin (1962) is a fairly early attempt to apply information theory to a wide variety of problems, notably Maxwell's demon, thermodynamics, and measurement problems.
	www.phys.psu.edu /~endwar/infothy.html (322 words)

	20010830: Shannon, The mathematical theory of communication (Site not responding. Last check: 2007-10-09)
		Introduces the basis for information theory wherein a communication system consists of five parts which work together to deliver a message: an information source, a transmitter, a channel, a receiver and a destination.
		Each of these parts can be represented as mathematical entities and thus empirical studies can be made of the transfer of information through the system.
		Presumably an adherent to Shannon's theory would suggest that the preconceptions are in fact feedback noise fed into the channel from the receiver.
	www.burningchrome.com /~cdent/fiaarts/docs/999232539:18871.html (323 words)

	Claude Shannon (1916 - 2001)
		Shannon's later work, 'A Mathematical Theory of Communication' (1948), outlining what we now know as Information Theory, described the measurement of information by binary digits representing yes-no alternatives - the fundamental basis of today's telecommunications.
		Luckily, 'A Mathematical Theory of Communication' was written while Shannon was employed by Bell Labs - because Shannon wasn't planning on publishing his work, and only did so at the urging of fellow employees.
		The paper outlined a mathematical definition of information and, probably based on his work in cryptography during the war, Shannon described ways to measure data using the quantity of disorder in any given system, together with the concept of entropy.
	www.kerryr.net /pioneers/shannon.htm (530 words)

	Mathematical Theory of Communication (Site not responding. Last check: 2007-10-09)
		I think it is fair to say that this book, based on Shannons landmark paper represents what I believe to be, the most important engineering paper ever written in the history of the world (both up to this point, and likely will remain so in the future).
		In terms of "practical implementation" of theory, it's fair to say that this seminal work has had a far greater contribution to mankind than Einsteins' paper on general and special relativity (just don't say that to a physicists face)....
		It's rather unfortunate, with todays advanced communication systems, and techniques of coding (Turbo codes, modified LDPC codes, etc..)which push the boundaries to the ultimate limits as defined by Shannon....
	mountainstatestech.com /bookstore/item_0252725484.html (776 words)

	A Mathematical Theory of Communication - Wikipedia, the free encyclopedia (Site not responding. Last check: 2007-10-09)
		A Mathematical Theory of Communication, published in 1948 by mathematician and computer scientist Claude E. Shannon, was one of the founding works of the field of information theory.
		Shannon, A mathematical theory of communication, Bell System Technical Journal, vol.
		This article about a non-fiction book is a stub.
	en.wikipedia.org /wiki/A_Mathematical_Theory_of_Communication (93 words)

Try your search on: Qwika (all wikis)