
	Where results make sense

Topic: Classical information theory

Related Topics

Information theory

	Information Theory
		Like the physically primitive notions of mass and energy of a particle, the information content, I, of an arbitrary measurement or message composed of particular symbol sequence, is itself a primitive concept.
		While the roots of information theory extend back to the definition of the classical entropy of a physical system introduced by Clausius in 1864 and Boltzman's probabilistic re-interpretation of classical entropy in 1896, the mathematical formalism for measuring I is due largely to a seminal 1948 paper by Claude E. Shannon.
		A measure of the information gain, I, is obtained by required that I be additive for independent events.
	www.iscid.org /encyclopedia/Information_Theory (242 words)

	Information Theory and Creationism: Classical Information Theory (Shannon)
		The Mathematical Theory of Communciation with Warren Weaver in 1949.
		That is, the information source is assumed to be a random process, outputing a sequence of symbols from a fixed symbol set, where the probability of each new symbol depends on only on the preceding symbol.
		Science and Information Theory, Brillouin described the Negentropy Principle of Information or NPI, the gist of which is that acquiring information about a system’s microstates is associated with a decrease in entropy (work is needed to extract information, erasure leads to increase in thermodynamic entropy).
	www.talkorigins.org /faqs/information/shannon.html (3369 words)

	Information Headquarters: Classical mechanics
		Classical mechanics is subdivided into statics (which deals with objects in equilibrium) and dynamics (which deals with objects in motion).
		In particular, classical electrodynamics predicts that the speed of light is constant to all observers, a prediction that is difficult to reconcile with classical mechanics and which led to the development of special relativity.
		When combined with classical thermodynamics, classical mechanics leads to the Gibbs paradox in which entropy is not a well-defined quantity and to the ultraviolet catastrophe in which a flbody is predicted to emit infinite amounts of energy.
	www.informationheadquarters.com /Physics/Classical_mechanics.shtml (1390 words)

	Non-Violent Defence in Classical Strategic Theory by Anders Boserup and Andrew Mack
		This theory makes two main assumptions: first, that the aim of war is to ‘win’ over the opponent, so that the conflict is conceived of as pure antagonism; second, that winning is the sole criterion by which possible courses of action are to be judged.
		The main elements of the theory which need to be considered are the relations between war and politics, the principle of polarity or unchecked escalation in war, the principle of the superiority of the defence over the offence, and the concept of centre of gravity.
		In classical strategic theory, therefore, military stalemate, cease-fire and peace are not the result of some delicate balance of opposing strength, of an impossible equality of antagonistic forces, but of the inequality of the forces of offence and defence.
	tmh.floonet.net /articles/wow.html (13231 words)

	Quantum Information Theory
		While von Neumann surely had some inkling of the potential interrelations between quantum mechanics and information [witness his expression (7)], the first direct connection with the new information theory appears to be that given by Jerome Rothstein in 1951 (Ref.125).
		Its adherents consider this to be a quantum theory of information and, though it has not been developed very far, it is indeed a precursor of more recent work in quantum theory.
		For this reason, new methods of secure information transfer are being explored, and one very promising scheme is that of quantum cryptography, which in turn employs some fundamental features of quantum information theory.
	w3.uwyo.edu /~wtg/infophys/node17.html (2411 words)

	Scientific American: Claude E. Shannon: Founder of Information Theory (Site not responding. Last check: 2007-10-14)
		Classical information science, by contrast, sprang forth about 50 years ago, from the work of one remarkable man: Claude E. Shannon.
		A year after he founded and launched information theory, Shannon published a paper that proved that unbreakable cryptography was possible.
		The extraordinary pattern of information processing that was Claude Shannon finally succumbed to the depredations of thermodynamic entropy in February 2001.
	cispom.boisestate.edu /murli/links/ShannonSciAm.htm (1069 words)

	CLASSICAL and QUANTUM INFORMATION THEORY
		Information is the underlying basis of the Quantum Consciousness of All Life in ALL SPACES.
		Quantum Computing and Information Theory, a promising New Technology, is based on the Galois field GF(4) = {0,1,w,w^2} where w = (1/2)(- 1 + sqrt(3) i) and w^2 = (1/2)(- 1 - sqrt(3) i).
		In quantum information theory, Cerf and Adami describe virtual qubit-anti-qubit pairs (they call them ebit-anti-ebit pairs) that are related to negative conditional entropies for quantum entangled systems and are similar to fermion particle-antiparticle pairs of particle physics.
	www.valdostamuseum.org /hamsmith/info.html (6749 words)

	ScienceWeek
		In the quantum information paradigm, the basic elements are quantum state vectors [describing the possible states of the quantum bits (qubits)] and unitary operators (describing the desired transformations); information is encoded in a quantum state, and the computational algorithm, or communication protocol, is implemented via a sequence of unitary operators acting on that quantum state.
		Information would be encoded in "quantum bits", and the search is on for a physical system that could form a reliable, controllable quantum bit.
		In all known classical factoring algorithms, the amount of time needed to find the prime factors of a number grows as an exponential function of the size of the number (this factor is approximately exp(L^(1/3)), where L is the length of the number in question).
	scienceweek.com /2004/sc040123-3.htm (1781 words)

	Information Theory and physics
		To complete a thermodynamic cycle, the demon must erase its memory, and it is during this erasure operation that we identify an increase in entropy in the environment, as required by the 2nd law.
		Classical information theory is founded on the definition of information.
		The observation that information can be translated from one form to another is encapsulated and quantified in Shannon's noiseless coding theorem (1948), which quantifies the resources needed to store or transmit a given body of information.
	www.ewh.ieee.org /r10/bombay/news3/page10.html (783 words)

	Quantum Information: Basic Concepts
		In fact, some approaches to the foundations of quantum theory (e.g., Ludwig's from the 60ies [Lu83]) are based on the view that Quantum Theory is precisely about the kind of influence transported from a preparing device (the "transmitter") to a measuring device (the "receiver").
		Teleportation with purely classical means is impossible, which is precisely the observation making the theory of Quantum Information a new branch of Information Theory.
		In the theory of Quantum Information entanglement is no longer viewed merely as a means to "subtly humiliate the opponents of quantum mechanics" (C.H. Bennett), but as a resource needed to perform otherwise impossible tasks of information processing or computation.
	www.imaph.tu-bs.de /qi/concepts.html (3109 words)

	Information Theory and Creationism: Classical Information Theory (Shannon)
		Modern digital communication depends on Information Theory, which was invented in the 1940's by Claude E.
		The use of a logarithm to measure information is owed to Ralph V.L. Hartley whose 1928 paper is cited by Shannon.
		When an information source capable of outputing any one of the 128 basic ASCII symbols, all equally likely, produces a symbol, the observer obtains 7 bits of information, exactly the number of bits used to encode the basic ASCII symbol set.
	home.mira.net /~reynella/debate/shannon.htm (2565 words)

	Physics 219 Course Information
		Information is something that can be encoded in the state of a physical system, and a computation is a task that can be performed with a physically realizable device.
		Therefore, since the physical world is fundamentally quantum mechanical, the foundations of information theory and computer science should be sought in quantum physics.
		In fact, quantum information -- information stored in the quantum state of a physical system -- has weird properties that contrast sharply with the familiar properties of "classical" information.
	theory.caltech.edu /people/preskill/ph229 (1034 words)

	IQI Courses
		Many of the results in QIS are "quantum analogues" of well-established information theory results.
		This course is designed for graduate and advanced undergraduate students who desire an in-depth study of the foundations of classical information theory.
		Overview of classical information theory, compression of quantum information, transmission of quantum information through noisy channels, quantum error-correcting codes, quantum cryptography and teleportation.
	www.iqi.caltech.edu /courses.html (465 words)

	Some practical encoding/decoding questions (from information theory) -- Encyclopædia Britannica
		Most closely associated with the work of the American electrical engineer Claude Elwood Shannon in the mid-20th century, information theory is chiefly of interest to communication engineers, though some of the concepts have been adopted and used in such...
		In their work some physicists have tried to construct a unified field theory that would describe all fundamental forces in nature and the relationships between elementary particles in terms of a single theory.
		Includes information on measurement, matter, atoms, reactions, acids and bases, redox reactions, stoichiometry, quantum theory, consumer chemistry, history of chemistry, laboratory practices, and periodic tables.
	www.britannica.com /eb/article?tocId=214948 (818 words)

	From message alphabet to signal alphabet (from information theory) -- Encyclopædia Britannica
		Classical information theory > Four types of communication > Discrete, noiseless communication and the concept of entropy > From message alphabet to signal alphabet
		in mathematics and mechanics, theory that studies systems behaving unpredictably and randomly despite their seeming simplicity and fact that forces involved are supposedly governed by well-understood physical laws; applications of theory are diverse, including study of turbulent flow of fluids, irregularities in heartbeat, traffic jams, population dynamics, chemical...
		Includes information on medical experiments, crematoria, escape attempts, the use of Zyklon B in the gas chambers, and the perpetrators and victims of the camp's atrocities.
	www.britannica.com /eb/article?tocId=214947 (857 words)

	ESA-WR Seminar Abstract
		As in classical information theory, uncertainty is the primary concept in GIT and information is defined in terms of uncertainty reduction.
		Each uncertainty theory that is recognizable within the expanded framework is characterized by: (i) a particular formalized language (a theory of fuzzy sets of some particular type); and (ii) a generalized measure of some particular type (additive or nonadditive).
		One important result of research in the area of GIT is that the tremendous diversity of uncertainty theories made possible by the expanded framework is made tractable due to some key properties of these theories that are invariant across the whole spectrum or, at least, within broad classes of uncertainty theories.
	public.lanl.gov /kmh/uncertainty/meetings/klirabs.html (751 words)

	Information Theory and Creationism: Algorithmic Information Theory (Chaitin, Solomonoff & Kolmogorov)
		Knowledge of this subject can be useful when arguing with Creationists whose use of concepts from both Classical and Algorithmic Information Theory tends to be sloppy.
		The joint information content H(X,Y) of strings X and Y is the size of the smallest program to produce both X and Y simultaneously.
		It must be stressed that, despite a similarity in notation and form to Classical Information Theory, Algorithmic Information Theory deals with individual objects, while Classical Information Theory deals with the statistical behavior of information sources.
	home.mira.net /~reynella/debate/algorith.htm (1194 words)

	Mathematics Colloquium #1 (Site not responding. Last check: 2007-10-14)
		A research program whose objective is to study uncertainty and uncertainty-based information in all their manifestations was introduced by the author in the early 1990’s under the name “generalized information theory.” This research program is based on a two-dimensional expansion of the framework of classical information theory based on probability theory.
		As in classical information theory, uncertainty is the primary concept in generalized information theory and information is defined in terms of uncertainty reduction.
		His current research interests include the areas of intelligent systems, generalized information theory, knowledge acquisition and discovery, fuzzy set theory and fuzzy logic, theory of monotone measures, various theories of imprecise probabilities, systems modeling and simulation, and soft computing, as well as some aspects of the philosophy of science and philosophy of mathematics.
	www.unomaha.edu /~wwwmath/Colloquium/coll5.html (702 words)

	COMP-761: Advanced Quantum Information Theory
		This area has seen an explosion of interest and a correspondingly rapid technical advance over the past ten years, largely in response to the development of quantum-mechanically based cryptographic protocols and Shor’s famous algorithm for factoring integers.
		The unavoidable presence of noise in any quantum-mechanical information processing device means that error-correction techniques will play a crucial role in any practical application of quantum cryptography or computing.
		However, roughly the first month’s worth of material can be found in Quantum Computation and Quantum Information by Nielsen and Chuang, which is an excellent introduction to the field as a whole.
	www.cs.mcgill.ca /~patrick/qit761 (268 words)

	Innsbruck Lectures (Site not responding. Last check: 2007-10-14)
		Connected to this lecture is this cartoon of Alice and Bob communicating via a physical means.
		This suggests that coherent information is related to the quantum channel capacity, but there are curious problems involving quantum supercapacity.
		Also included are two diagrams (1 and 2) of outlining Lloyd's argument that up to I qubits of entanglement can be sent through a noisy quantum channel with fidelity approaching unity.
	www2.kenyon.edu /People/schumacb/Innsbruck/lectures.htm (452 words)

	Autosophy Information Theory
		The new information theory reveals the theoretical flaws of other data compression methods, including: the Huffman; Ziv Lempel; LZW codes and commercial compression codes such as V.42bis and MPEG-2.
		According to Shannon’s theory, information “removes uncertainty” so that the more bits transmitted, the more accurate is the data pattern reconstruction in the receiver.
		Information is communicated with address tokens, called “Tips”, each of which may represent any amount of data.
	www.autosophy.com /infotheo.htm (9963 words)

	Category:Quantum information theory - Wikipedia, the free encyclopedia
		Wikimedia needs your help in its 21-day fund drive.
		Quantum information theory is a generalization of classical information theory to use quantum-mechanical particles and interference.
		It is used in the study of quantum computation and quantum cryptography.
	en.wikipedia.org /wiki/Category:Quantum_information_theory (83 words)

	Readings from quant-ph (Site not responding. Last check: 2007-10-14)
		The idea of typical states with given properties is fundamental in classical statistical mechanics, as is the idea of typical sequences in classical information theory.
		His arguments, that string theory has failed as yet to live up to the often extravagant promises of its proponents and that other avenues are also worth exploring, echo the opinions of P.
		This makes his claim that his theory describes an objective reality independent of observers quite incomprehensible, unless that objective reality is the reality of the entire set of possible frameworks, which is presumably the reality of a no-collapse interpretation of quantum theory, and is therefore very different from the reality which we apparently observe.
	www.poco.phy.cam.ac.uk /~mjd1014/readings.html (10956 words)

	Related Links (Site not responding. Last check: 2007-10-14)
		"18th-century theory is new force in computing" (by Michael Kanellos, CNET News.com, February 18, 2003) Besides Microsoft and Autonomy, Google and Intel are now avid users and advocates of Bayesian techniques.
		Since classical probability is in some sense a subset of (or parallel to) quantum mechanics, it should be possible to calculate a probability predicted by quantum mechanics for each probability predicted by classical probability and classical Bayesian nets.
		This web site includes "A Mathematical Theory of Communication", by Claude Shannon-- the 1948 paper that took the field of Information Theory and instantly transformed it from an embryo to a mature adult.
	www.ar-tiste.com /related_links.html (2604 words)

	Quantum Information Theory (Site not responding. Last check: 2007-10-14)
		The basics of classical information theory are presented, but for greater depth please see the references.
		Here are a list of topics in quantum information theory, presented in the order in which you will probably need to read them.
		All logarithms in the text are to the base 2, so that information is measured in units of bits.
	members.aol.com /jmtsgibbs/infothry.htm (162 words)

Try your search on: Qwika (all wikis)