gov.sandia.cognition.learning.experiment
Class SupervisedLearnerComparisonExperiment<InputType,OutputType,StatisticType,SummaryType>

java.lang.Object
  extended by gov.sandia.cognition.util.AbstractCloneableSerializable
      extended by gov.sandia.cognition.learning.experiment.AbstractLearningExperiment
          extended by gov.sandia.cognition.learning.experiment.AbstractValidationFoldExperiment<InputDataType,FoldDataType>
              extended by gov.sandia.cognition.learning.experiment.LearnerComparisonExperiment<InputOutputPair<InputType,OutputType>,InputOutputPair<InputType,OutputType>,Evaluator<? super InputType,OutputType>,StatisticType,SummaryType>
                  extended by gov.sandia.cognition.learning.experiment.SupervisedLearnerComparisonExperiment<InputType,OutputType,StatisticType,SummaryType>
Type Parameters:
InputType - The type of the input data for supervised learning.
OutputType - The type of the output data for supervised learning.
StatisticType - The type of the statistic generated by the performance evaluator on the learned object for each fold. It is created by passing the learned object plus the test data for the fold into the performance evaluator.
SummaryType - The type produced by the summarizer at the end of the experiment from a collection of the given statistics (one for each fold). This represents the performance result for the learning algorithm for the whole experiment.
All Implemented Interfaces:
LearningExperiment, CloneableSerializable, Serializable, Cloneable

public class SupervisedLearnerComparisonExperiment<InputType,OutputType,StatisticType,SummaryType>
extends LearnerComparisonExperiment<InputOutputPair<InputType,OutputType>,InputOutputPair<InputType,OutputType>,Evaluator<? super InputType,OutputType>,StatisticType,SummaryType>

A comparison experiment for supervised learners.

Since:
3.0
Author:
Kevin R. Dixon
See Also:
Serialized Form

Nested Class Summary
 
Nested classes/interfaces inherited from class gov.sandia.cognition.learning.experiment.LearnerComparisonExperiment
LearnerComparisonExperiment.Result<SummaryType>
 
Field Summary
 
Fields inherited from class gov.sandia.cognition.learning.experiment.LearnerComparisonExperiment
confidence, learners, performanceEvaluator, statistics, summaries, summarizer
 
Fields inherited from class gov.sandia.cognition.learning.experiment.AbstractValidationFoldExperiment
foldCreator, numTrials
 
Fields inherited from class gov.sandia.cognition.learning.experiment.AbstractLearningExperiment
listeners
 
Constructor Summary
SupervisedLearnerComparisonExperiment()
          Creates a new instance of SupervisedLearnerComparisonExperiment.
SupervisedLearnerComparisonExperiment(ValidationFoldCreator<InputOutputPair<InputType,OutputType>,InputOutputPair<InputType,OutputType>> foldCreator, PerformanceEvaluator<? super Evaluator<? super InputType,OutputType>,Collection<? extends InputOutputPair<InputType,OutputType>>,? extends StatisticType> performanceEvaluator, NullHypothesisEvaluator<Collection<? extends StatisticType>> statisticalTest, Summarizer<? super StatisticType,? extends SummaryType> summarizer)
          Creates a new instance of SupervisedLearnerComparisonExperiment.
 
Method Summary
 
Methods inherited from class gov.sandia.cognition.learning.experiment.LearnerComparisonExperiment
evaluate, evaluate, getConfidence, getLearners, getPerformanceEvaluator, getStatisticalTest, getStatistics, getSummaries, getSummarizer, runTrial, setConfidence, setLearners, setPerformanceEvaluator, setStatisticalTest, setStatistics, setSummaries, setSummarizer
 
Methods inherited from class gov.sandia.cognition.learning.experiment.AbstractValidationFoldExperiment
getFoldCreator, getNumTrials, runExperiment, setFoldCreator, setNumTrials
 
Methods inherited from class gov.sandia.cognition.learning.experiment.AbstractLearningExperiment
addListener, fireExperimentEnded, fireExperimentStarted, fireTrialEnded, fireTrialStarted, getListeners, removeListener, setListeners
 
Methods inherited from class gov.sandia.cognition.util.AbstractCloneableSerializable
clone
 
Methods inherited from class java.lang.Object
equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

SupervisedLearnerComparisonExperiment

public SupervisedLearnerComparisonExperiment()
Creates a new instance of SupervisedLearnerComparisonExperiment.


SupervisedLearnerComparisonExperiment

public SupervisedLearnerComparisonExperiment(ValidationFoldCreator<InputOutputPair<InputType,OutputType>,InputOutputPair<InputType,OutputType>> foldCreator,
                                             PerformanceEvaluator<? super Evaluator<? super InputType,OutputType>,Collection<? extends InputOutputPair<InputType,OutputType>>,? extends StatisticType> performanceEvaluator,
                                             NullHypothesisEvaluator<Collection<? extends StatisticType>> statisticalTest,
                                             Summarizer<? super StatisticType,? extends SummaryType> summarizer)
Creates a new instance of SupervisedLearnerComparisonExperiment.

Parameters:
foldCreator - The object to use for creating the folds.
performanceEvaluator - The evaluator to use to compute the performance of the learned object on each fold.
statisticalTest - The statistical test to apply to the performance results of the two learners to determine if they are statistically different.
summarizer - The summarizer for summarizing the result of the performance evaluator from all the folds.