
	Where results make sense

Topic: Mutual information

Related Topics

Joint distribution

Joint entropy

Conditional entropy

Correlation

Exponentiation

Copula (statistics)

Information theory

Information entropy

Multinomial distribution

Logarithm

Statistical inference

	Mutual information - Wikipedia, the free encyclopedia
		In probability theory and, in particular, information theory, the mutual information, or transinformation, of two random variables is a quantity that measures the mutual dependence of the two variables.
		Mutual information is often used as a significance function for the computation of collocations in corpus linguistics.
		Mutual information is used in medical imaging for image registration.
	en.wikipedia.org /wiki/Mutual_information (659 words)

	Information theory - Wikipedia, the free encyclopedia
		Information theory in the 1950s was sometimes classified as a branch of the then voguish field called "cybernetics", which included many aspects of potential machine representation of the world; it is a broad and deep mathematical theory, with equally broad and deep applications, chief among them coding theory.
		In the case of information theory, the choice of logarithmic base merely determines the unit that is used to measure information.
		The mutual information has the distinction of being the only one of Shannon's basic measures of information that remains fundamentally meaningful in the continuous case, in the sense of remaining invariant under linear transformation, and furthermore it is non-negative.
	en.wikipedia.org /wiki/Information_theory (3938 words)

	PlanetMath: mutual information
		Mutual information, or just information, is measured in bits if the logarithm is to the base 2, and in ``nats'' when using the natural logarithm.
		Mutual information, or simply information, was introduced by Shannon in his landmark 1948 paper ``A Mathematical Theory of Communication.''
		This is version 1 of mutual information, born on 2002-04-30.
	planetmath.org /encyclopedia/MutualInformation.html (230 words)

	Mutual Fund Information (Site not responding. Last check: 2007-10-08)
		Mutual funds are not tax-paying entities, and are typically managed with utter disregard for tax considerations of significance to their shareholders.
		Mutual funds report their annual results as if taxes did not exist, and distribute taxable gains, and the tax burden, to their shareholders.
		Nevertheless, a mutual fund’s portfolio manager’s performance is measured on the basis of pretax returns and, therefore, few portfolio managers concern themselves with the tax consequences of their decisions and actions.
	www.gabrielwisdom.com /mutual.php (1702 words)

	Maximization of Mutual Information (Site not responding. Last check: 2007-10-08)
		One of the strengths of using mutual information (and perhaps in some special cases, one of the weaknesses) is that MI does not use any prior information about the relationship between joint intensity distributions.
		Mutual information does not use an a priori model of the relationships between the intensities of the different images.
		Our method not only expects the relationship between the intensity values of registered images to be maximal in mutual information, but also to be similar to that of the pre-registered training data of the same modalities.
	www.ai.mit.edu /people/leventon/Research/9810-MICCAI-Reg/node3.html (214 words)

	ITK Mutual Information - KitwarePublic
		It is again unfortunate that the usage of "bit" as unit of information measurement has been distorted in order to become the a symbol for binary encoding, o a unit of measurement for raw capacity of memory storage (along with its derivatives the byte, KiloByte, MegaByte...
		Note that the reason why the measure of Mutual Information is reported as a negative number in ITK is because traditionally that has been used as a cost function for minimization.
		However, in principle, Mutual information should be reported in the range [0,H(A)], where zero corresponds to two totally uncorrelated images and H(A) corresponds to perfectly correlated images, case in which H(A)=H(B).
	public.kitware.com /Wiki/Itk_Mutual_Information (533 words)

	Mutual information and Kullback-Leibler divergence
		The mutual information is a natural measure of the dependence between random variables.
		The problem with mutual information is that it is difficult to estimate.
		Cumulant-based approximations such as the one in (19) simplify the use of mutual information considerably.
	www.cis.hut.fi /aapo/papers/NCS99web/node26.html (603 words)

	Mutual information
		Mutual information is a measure of the information that members of a set of random variables have on the other random variables in the set.
		An analogy is this: Upon arriving at the airport, we receive less information when the ticket agent tells us that (1) we missed the plane, and (2) the plane left 15 minutes ago, than either of those pieces of information would provide individually.
		We can thus think of mutual information as the information that is ``shared'' by the random variables.
	www.users.bigpond.com /pclim/papers/thesis/node51.html (269 words)

	MatrixPlot: Introduction
		The sequence information is computed as in the structure logo, but when including gaps we have introduced displacement of the baseline of the plain sequence information content profile.
		First the contribution to the computation of information content when gaps are included in the alignment, and secondly the sample size robustness of mutual information for RNA secondary structure co-variance analysis.
		The upper triangle is mutual information content computed by type 2, and the lower triangle is the mutual information content computed by using type 1.
	www.cbs.dtu.dk /services/MatrixPlot/introduction (1912 words)

	Relative entropy and mutual information
		Another important concept is that of mutual information.
		The channel coding theorem (which is one of the high points we are trying to reach in the class) is basically a statement about mutual information.
		The information that X tells about Y is the uncertainty in X plus the uncertainty about Y minus the uncertainty in both X and Y.
	www.engineering.usu.edu /classes/ece/7680/lecture2/node3.html (317 words)

	Rate distortion theory - Wikipedia, the free encyclopedia
		Rate distortion theory is the branch of information theory addressing the problem of determining the minimal amount of entropy (or information) R that should be communicated over a channel such that the source (input signal) can be reconstructed at the receiver (output signal) with given distortion D.
		X) are the entropy of the output signal Y and the conditional entropy of the output signal given the input signal, respectively:
		The mutual information can be understood as a measure for prior uncertainty the receiver has about the sender's signal (H(Y)), diminished by the uncertainty that is left after receiving information about the sender's signal (H(Y
	en.wikipedia.org /wiki/Rate_distortion_theory (1019 words)

	Information Theory (Site not responding. Last check: 2007-10-08)
		The IEEE Transactions on Information Theory is the main western journal devoted to information theory.
		Concurrent with the growth of devices for transmitting and processing information, a unifying theory known as information theory was developed and became the subject of intensive research.
		In its broadest sense, information is interpreted to include the messages occurring in any of the standard communications media, such as telegraphy, radio, or television, and the signals involved in electronic computers, servomechanism systems, and other data-processing devices.
	www.dam.brown.edu /people/yiannis/info.html (600 words)

	Computing Papers on Mutual (Site not responding. Last check: 2007-10-08)
		A maximum Mutual information approach is presented for selecting acoustic features to be combined together to represent the distinctions coded by a set of correlated phonological features.
		In this paper we investigate the Mutual information in speech between the spectral envelope of the high frequency band and low frequency bands of various widths.
		Mutual information is calculated between cepstral features and the vowel phonetic class for different age groups and signal bandwidths.
	computing.breinestorm.net /Mutual (1963 words)

	Mutual Information For Evidence Fusion
		To undermine the relevance of mutual information in the context of object model combination, we briefly refer to the well-known Kullback-Leibler divergence.
		By maximizing mutual information with a second, complementary face model the algorithm detects and locates faces in the image.
		The mutual information between the two distributions is computed.
	homepages.inf.ed.ac.uk /rbf/CVonline/LOCAL_COPIES/KRUPPA1/cvonline.html (1020 words)

	Mutual information and learning
		The aim of learning is to generalize the information obtained from training data to non-training situations.
		meaning that the mutual information is the sum of the two individual entropies diminished by the entropy common to both variables.
		Nevertheless, the mutual information decays and the correct hypothesis has finally to be found through ``local'' learning.
	pauli.uni-muenster.de /~lemm/papers/dens/node9.html (656 words)

	What is a mutual fund, start here to use a wide array of information about mutual funds
		A mutual fund is an investment vehicle where a person or group of persons, called mutual fund managers, choose a group of stocks and sell them in one package.
		Mutual funds are generally lower risk investments for a beginner or intermediate investor because:
		Mutual funds are also recommended for those who do not have the time, energy or desire to research their own stocks.
	msfinancialsavvy.com /mutual_funds101 (205 words)

	Mutual Information (Site not responding. Last check: 2007-10-08)
		The mutual information between two discrete random variables is denoted by ℐ(X;Y) and defined as
		Mutual information is a useful concept to measure the amount of information shared between input and output of noisy channels.
		However, for additional information on typical sequences, please refer to Typical Sequences.
	cnx.rice.edu /content/m10178/latest (355 words)

	[No title] (Site not responding. Last check: 2007-10-08)
		INFORMATION THEORY -- an over-simplified recap by Charles Fan Abstract -- The following is an attempt to understand the fundamental ideas of Information Theory without introducing rigorous mathematical proofs or detailed application examples.
		It introduced the idea of channel capacity, C, which is defined as the maximum of I(X;Y), in which X is the sequence before the channel and Y is the sequence after the channel.
		Also notice that a duality exists between R(D) and C. (H is simply a special case of R(D), D=0) R(D) is defined as the minimum mutual information and C is defined as the maximum mutual information.
	vigeland.paradise.caltech.edu /~fan/essays/it.txt (1307 words)

	Distribution of Mutual Information - Hutter (ResearchIndex) (Site not responding. Last check: 2007-10-08)
		Abstract: The mutual information of two random variables i and j with joint probabilities t ij is commonly used in learning Bayesian nets as well as in many other fields.
		The chances t ij are usually estimated by the empirical sampling frequency n ij /n leading to a point estimate I(n ij /n) for the mutual information.
		To answer questions like "is I(n ij /n) consistent with zero?" or "what is the probability that the true mutual information is much larger than the point estimate?" one has to go beyond...
	citeseer.ist.psu.edu /483515.html (502 words)

	Mutual Funds Information by Itsaboutfinance.com (Site not responding. Last check: 2007-10-08)
		Find mutual funds information on Itsaboutfinance.com with the terms annual vehicle inspection report, bettyford + annual report, investor relations ottawa, annual report writer baltimore, and utc corp shareholders.
		Mutual funds information related phrases on Itsaboutfinance.com include annual report writer baltimore, utc corp shareholders, bettyford + annual report, annual vehicle inspection report, Just wanted to let you know we appriciate your help finding what we needed.
		Mutual funds information, annual report writer baltimore, utc corp shareholders, bettyford + annual report, annual vehicle inspection report, and investor relations ottawa are related to Itsaboutfinance.com.
	www.itsaboutfinance.com /mutual_funds_information_j.html (453 words)

	Mutual fund information
		Mutual fund information: picking a mutual fund out of the thousands available can be difficult to do.
		There are thousands of mutual funds to invest your money in.
		All of the information I mentioned above on mutual funds can usually be found in a special mutual fund issue published at the beginning of each year by Kiplinger’s or Money Magazine.
	wy.essortment.com /mutualfundin_rqnh.htm (455 words)

	Defining ICA by Mutual Information (Site not responding. Last check: 2007-10-08)
		Since mutual information is the natural information-theoretic measure of the independence of random variables, we could use it as the criterion for finding the ICA transform.
		Rigorously, speaking, (29) shows that ICA estimation by minimization of mutual information is equivalent to maximizing the sum of nongaussianities of the estimates, when the estimates are constrained to be uncorrelated.
		The constraint of uncorrelatedness is in fact not necessary, but simplifies the computations considerably, as one can then use the simpler form in (29) instead of the more complicated form in (28).
	www.cis.hut.fi /~aapo/papers/IJCNN99_tutorialweb_old2/node18.html (207 words)

	Corporate Information - Medical Mutual - Individual Health Insurance, Group Health Insurance, SuperMed One, Health ...
		As a mutual company, Medical Mutual is owned by its policyholders and acts in their best interest, not according to the demands of stockholders and Wall Street analysts.
		Medical Mutual has 2,500 employees, each of whom is dedicated to meeting and exceeding the needs of our customers; including policyholders, members, brokers and group benefit managers.
		Medical Mutual provides links to other sites as a service to users, and access to any other sites linked to Medical Mutual is at your own risk.
	www.medmutual.com /global/corporate/default.aspx (538 words)

	Reit mutual funds information - resources from Stock Market News (Site not responding. Last check: 2007-10-08)
		Mutual Funds - Real Estate Mutual Funds If you are drawn to investing in reits, a mutual fund is the only safe way to do it.
		The Preferred Group of Mutual Funds - Glossary The Preferred Group of Mutual Funds is an open-end, diversified series...
		REITs: Explanation and Demystification Mutual funds and REITs are both subject to several requirements (distributions, income/asset tests, etc.) in order to receive an exemption from corporate...
	www.yourstocksnews.com /reit_mutual_funds.html (1130 words)

	Mutual Funds Information Resources Information at Business.com
		Information on the Ameristock Mutual Fund, a no-load, value based, domestic equity-income mutual fund that invests in large capitalization companies.
		Information on the Clipper Fund, a long-term value-oriented no-load mutual fund with both capital preservaton and long-term growth of capital as its investment objectives.
		Provider of information on the Volumetric Fund, a no-load mutual fund that invests in a broadly diversified portfolio of large and mid-cap stocks, primarily those of the New York Stock Exchange.
	www.business.com /directory/financial_services/asset_management/mutual_funds/reference/index.asp?partner=2662601 (1362 words)

	maximizing mutual information
		Criterion is to maximize the mutual information between class labels and transformed features in a way described in the references.
		The arrows represent "information forces", the directions and magnitudes where the samples of data would like the transform move them in order to maximize the criterion.
		Gradient ascent is used for learning, but rather than computing all million mutual interactions between the thousand data points each iteration, a random sample of mere 30 interactions (pairs of points) is evaluated at each iteration (which corresponds to a frame of the movie clip).
	members.cox.net /torkkola/mmi.html (618 words)

	ipedia.com: Mutual information Article (Site not responding. Last check: 2007-10-08)
		In probability theory, the mutual information between two variables X and Y is given by where P and P are the probability distributions of X and Y. Table of contents 1 Properties of mutual information...
		In probability theory, the mutual information between two variables X and Y is given by
		Thus mutual information can be understood as a weighted Kullback-Leibler divergence: the more different the distributions P(X) and P(X
	www.ipedia.com /mutual_information.html (194 words)

	News & Features: Mutual Information in Protein Multiple Sequence Alignments Reveals Two Classes of ...
		Abstract: Information theory was used to identify nonconserved coevolving positions in multiple sequence alignments from a variety of protein families.
		These results imply that information theory may be applied generally to find coevolving, nonconserved positions that are part of functional sites in uncharacterized protein families.
		We propose that these coevolving positions compose an important subset of the positions in an alignment, and may be as important to the structure and function of the protein family as are highly conserved positions.
	www.iscid.org /boards/ubb-get_topic-f-1-t-000270.html (307 words)

Try your search on: Qwika (all wikis)