Where results make sense

About us   |   Why use us?   |   Reviews   |   PR   |   Contact us

Topic: Cross-validation

    Note: these results are not from the primary (high quality) database.

Cross-validation - Wikipedia, the free encyclopedia In statistics cross-validation is the practice of partitioning a sample of data into subsamples such that analysis is initially performed on a single subsample, while further subsamples are retained "blind" in order for subsequent use in confirming and validating the initial analysis. Cross-validation is important in guarding against testing hypotheses suggested by the data, especially where further samples are hazardous, costly or impossible ( uncomfortable science) to collect. en.wikipedia.org /wiki/Cross-validation

Salford Systems Cross validation does not affect the growth of the maximal tree at all -- it is conducted after the maximal tree is grown. For instance, if 10 cross validation trees are grown, each uses 90% of the learn sample for tree growth and the remaining 10% as a pseudo test sample with which to estimate error rates for the nodes in the cross validation tree. The cross validation error rate is derived from one cross-validation procedure, whereas a test sample error rate is derived from a one test sample. www.salford-systems.com /carttechfaq18.php

V-fold Cross Validation Cross validation would seem to be paradoxical: we need independent data that was not used to build the tree to measure the generalized classification error, but we want to use all data to build the tree. V-fold cross validation is a technique for performing independent tree size tests without requiring separate test datasets and without reducing the data used to build the tree. The cross validation cost for each possible tree size is displayed in the Tree Size report that DTREG generates. www.dtreg.com /crossvalidation.htm

A Single-Sample Estimate of Shrinkage in Meteorological Forecasting For many researchers, the method of choice for cross- validation is to create a model on one sample and test the model on a second sample drawn from the same population; alternatively, a model is created on a substantial portion of a sample and tested on the remaining portion of the sample. Mosier (1951) suggested a double cross-validation procedure where the regression coefficients are calculated for both the calibration and validation samples and the two regression equations are cross-validated on the sample that was not used to establish the regression coefficients. While no estimate of predictive validity is available for the combined sample, Mosier (1951) posited that it may be approximated by the average of the predictive validities obtained for the original calibration and validation samples. www.aoml.noaa.gov /hrd/Landsea/singlesample

Cross Validation Leave-one-out cross validation is K-fold cross validation taken to its logical extreme, with K equal to N, the number of data points in the set. Cross validation is a model evaluation method that is better than residuals. Cross validation tells us that very little smoothing is best for this data set. www.cs.cmu.edu /~schneide/tut5/node42.html

Sociology and Simulation - Statistical and Qualitative Cross-Validation We argue that this cross-validation of agent based social simulation models is a significant advancement in the analysis of social process. An agent based simulation model of the effect of drought on domestic water consumption is reported here that is the outcome of a process of development involving stakeholders to inform and validate the model qualitatively at micro level while ensuring that numerical outputs from the model cohere with observed time series data. Such models are not, however, validated directly against qualitative evidence about the behaviour of individuals and how they interact. cfpm.org /cpmrep105.html

Cross-validation software downloads The purpose of Cross +A is to simplify the solution of cross word s, word -based puzzle s and nonogram s. The Prestwood Load Balancer is a cross- web server, cross-platform web request dispatcher that distributes direct HTTP calls to various web servers, based on the total number of pending requests to each server and the average response time. In this no-clue Cross word, the grid is filled with numbers.Each number represents a letter. www.freedownloadsoft.com /cross-validation.html

American Journal of Pharmaceutical Education: Development and cross-validation of an instrument to measure first-year pharmacy students' attitudes toward AIDS/HIV patients The number of extractable factors was given by the value immediately prior to the crossing point of the two plots( 2). The purpose of this study was to develop and validate an instrument that measures first-year professional pharmacy students' attitudes toward AIDS/HIV patients. Due to the distinct roles of pharmacists, physicians, and nurses in patient care, it is important to possess a reliable and valid instrument that measures pharmacy students' attitudes toward AIDS/HIV patients. www.findarticles.com /p/articles/mi_qa3833/is_199807/ai_n8804047

Martens Uncertainty Test : Cross Validation, Jack-Knifing and Stability Plots You validate your PLS, PCR, or PCA model with cross validation, choosing full cross validation or segmented cross validation as you find appropriate for your data. These sub-models are based on the samples that were not held out of the cross validation segment. Thus, the cross validation created 34 sub-models, where one sample had been left out of each sub-model. www.camo.no /rt/Resources/infodoc/infodoc_martens.html

cross-validation Cross Validation tut5 Next: Blackbox Model Selection Up: Autonomous Modeling Previous: Judging Model Quality by Cross Validation Cross validation is a model evaluation method that is better than residuals... fold Cross Validation The method used by DTREG to determine the optimal tree size is V-fold cross validation. We'll review testset validation, leave-one-one cross validation (LOOCV) and k-fold cross-validation, and we'll discuss a wide variety of places that these techniques can be... cross-validation.networklive.org

Cross-Validation Analysis Cross validation analysis is not available for Conditional Simulation. Each point on the graph represents a location in the input data set for which an actual and estimated value are available. Placing the cursor over a point provides information on the estimate for a specific location as in the example below. www.geostatistics.com /GSWinHelp/cross_validation_analysis.htm

Prediction of acute renal failure after cardiac surgery: retrospective cross-validation of a clinical algorithm -- Eriksen et al. 18 (1): 77 -- Nephrology Dialysis Transplantation Lins RL, Elseviers M, Daelemans R, De Broe ME. Problems in the development, validation and adaptation of prognostic models for acute renal failure. Validity of four models for predicting outcome in critically ill acute renal failure patients. score algorithm was validated in a patient population from a ndt.oupjournals.org /cgi/content/full/18/1/77

Generalized Cross Validation part I The term Generalized cross validation ( GCV) stands a numerically efficient method of computing the CV required by this method. Effectively, the minimum GCV yields the model that is least affected by any single data point. www.geop.ubc.ca /ubcgif/tutorials/lininv/sld028.htm

Cross-validation Robust criteria are used for both esimating the parameters in the calibration sample, and assessing performance in the validation sample. Considers the in-sample (using estimates of effective degrees of freedom) and out-of-sample (using last 14 observations as validation sample) predictive performance of various models, illsutrating the influence of overfitting on especially the most complicated models. Also `repeated learning-testing methods' where data are repeatedly split at random into (uneven) calibration and validation samples. www.nuff.ox.ac.uk /sociology/alcd/models/node15.html

cv.lsp (defmeth dataset-proto :cross-validation (&key validation-set (fraction.33) remove) "Method args: (&key validation-set (fraction.33) new remove) When new is t, this method sets up cross validation. A validation set is selected, either according to the subsrripts given in the keyword validation-set, or else selected at random with probability fraction if validation-set is not set. www.stat.umn.edu /~sandy/cv.lsp

cross validation We can avoid overfitting the data by monitoring the cross validation R-factor, which is sometimes called the free-R. I won't say much about the theory of cross validation. Free R value: Cross validation in crystallography, by Brunger (1997) Methods in Enzymology, 277, 366-396. Assessment of phase accuracy by cross validation, by Brunger (1993) Acta Cryst. www.chem.missouri.edu /TannerGroup/people/tanner/xraycourse/cv/cv.html

Asymptotic Optimality of Likelihood-Based Cross-Validation Crucial conditions of our theorem are that the size of the validation sample converges to infinity, which excludes leave-one-out cross-validation, and that the candidate density estimates are bounded away from zero and infinity. We illustrate these asymptotic results and the practical performance of likelihood-based cross-validation for the purpose of bandwidth selection with a simulation study. www.bepress.com /sagmb/vol3/iss1/art4

Cross-Validation of the Self-Appraisal Questionnaire (SAQ): An Offender Risk and Need Assessment Measure on Australian, British, Canadian, Singaporean, and American Offenders -- Loza et al. 19 (10): 1172 -- Journal of Interpersonal Violence validity of the SAQ to be used with the culturally diverse offenders jiv.sagepub.com /cgi/content/short/19/10/1172

MG Cross Validation IC In other words, the cross validation of the measurement model for the six psychological tests across gender is not supported by the data of the two samples. The small P-value suggests that there is sufficient evidence that the null hypothesis should be rejected. www.ssicentral.com /lisrel/WebHelp/Examples/Multiple_Group_Analysis/Continuous/Incomplete_Data/Analyses/Cross_Validation.htm

Cross Validation and MLP Architecture Selection - Tim, Martinez (ResearchIndex) Abstract: The performance of cross validation (CV) based MLP architecture selection is examined using 14 real world problem domains. Andersen, Tim and Tony R. Martinez, "Cross Validation and MLP Architecture Selection", Proceedings of the IEEE International Joint Conference on Neural Networks IJCNN'99, CD Paper #192, 1999. Cross Validation and MLP Architecture Selection - Tim, Martinez (ResearchIndex) citeseer.ist.psu.edu /485703.html

data_structures Library - 1.1 K-fold Cross Validation The K-fold Cross Validation estimate is obtained by averaging over all iteration estimates : In this section we provide a brief introduction to the K-fold Cross Validation process. Given a dataset and an algorithm this method estimates the algorithm prediction error by averaging its error on K runs. search.niaad.liacc.up.pt /~ltorgo/Papers/CV_EVAL/cv_eval-1.1.html

What are cross-validation and bootstrapping? The crucial distinction between cross-validation and split-sample validation is that with cross-validation, after guessing the "best" subset, we train the linear regression model for that subset using all n cases, but with split-sample validation, only t cases are ever used for training. The distinction between cross-validation and split-sample validation is extremely important because cross-validation is markedly superior for small data sets; this fact is demonstrated dramatically by Goutte (1997) in a reply to Zhu and Rohwer (1996). Kearns, M. (1997), "A bound on the error of cross validation using the approximation and estimation rates, with consequences for the training-test split," Neural Computation, 9, 1143-1161. www.faqs.org /faqs/ai-faq/neural-nets/part3/section-12.html

cross-validation a process by which a method that works for one sample of a population is checked for validity by applying the method to another sample from the same population. www.infoplease.com /ipd/A0393975.html

ED230B/C Repeat cross validation using "Sample B" as screening sample and "Sample A" as calibration sample. Do cross validation using "Sample A" as screening sample and "Sample B" as calibration sample. If shrinkage is small and coefficients change little, combine samples and recompute regression. www.gseis.ucla.edu /courses/ed230bc1/notes2/cross.html

Cross-validation exercise Use the sums of squares for the prediction errors you found in #7 to obtain a prediction-based R-squared using the two models with the validation data. Variable selection and model fitting will be done with half of the data and the remaining half will be used for validation. Open the Albuquerque Home Prices data found in the the folder, R:/Minitab13/Regression, or by going to the course website, and copying and pasting the data into a Mintab worksheet. gozips.uakron.edu /~rle/Cross_validation_exercise.htm

A Bound on the Error of Cross Validation Using the Approximation and Estimation Rates, with Consequences for the Training-test Split -- Kearns 9 (5): 1143 -- Neural Computation A Bound on the Error of Cross Validation Using the Approximation and Estimation Rates, with Consequences for the Training-test Split general bound on the error of the simplest form of cross validation. A Bound on the Error of Cross Validation Using the Approximation and Estimation Rates, with Consequences for the Training-test Split -- Kearns 9 (5): 1143 -- Neural Computation neco.mitpress.org /cgi/content/abstract/9/5/1143

Geostatistics - Cross Validation (Jacknife) Analysis in GS+ Geostatistics - Cross Validation (Jacknife) Analysis in GS+ This provides a graph of estimated vs. actual values for each sample location; values can also be listed in a separate window. www.geostatistics.com /OverviewCrossValidation.html

crossval Documentation Outputs are the predictive residual error sum of squares (PRESS) press for each subset, the cumulative PRESS cumpress, the root mean square error of cross validation RMSECV rmsecv, the root mean square error of calibration RMSEC rmsec, the cross-valiated predictions for the y-block (if any) cvpred, and the fractional misclassifications misclassed. When set to 'no', calculation of "all variables" model is skipped (unless specifically required for plots or requested with multiple outputs) www.software.eigenvector.com /toolbox/3_5/manual/crossval.html

Tissue Dosimetry Expansion and Cross-Validation of Rat and Mouse Physiologically Based Pharmacokinetic Models for Trichloroethylene -- Keys et al. 76 (1): 35 -- Toxicological Sciences Liver predictions were calibrated and validated using a cross-validation validation increases both the utility and our confidence in and extensive tissue dosimetry validation of rodent PBPK models toxsci.oupjournals.org /cgi/content/abstract/76/1/35

Cross-Validation Estimates IMSE - Mark, Shinichi, Halbert (ResearchIndex) has shown that cross validation estimates Integrated Mean Squared Error (IMSE) within a constant due to noise. Techniques exist to alleviate this problem, such as using a cross validation set of samples to determine when to terminate optimization Thus every scribble in the file is used once for testing and four times for training. citeseer.ist.psu.edu /289669.html

Try your search on: Qwika (all wikis)

About us   |   Why use us?   |   Reviews   |   Press   |   Contact us   Copyright © 2005-2007 www.factbites.com Usage implies agreement with terms.