Martijho-PathNet-search-plots

Fra Robin

(Forskjeller mellom versjoner)
Gå til: navigasjon, søk
 
(27 mellomrevisjoner ikke vist.)
Linje 1: Linje 1:
-
== Population Diversity ==  
+
= Population Diversity =
-
Population diversity is calculated by the home-made metric of average distance to centroid genotype within each generation, which yields the same results as a pairwise Hamming distance
+
== Diversity metrics ==
 +
Three different diversity calculations have been performed, which resulted in three similar diversity messures:
{|style="margin: 0 auto;"
{|style="margin: 0 auto;"
-
| [[File:Population_diversity_recomb.png|300px|thumb|upright|alt=Population diversity in recomb search|FILLER]]
+
| [[File:Average_population_diversity_pairwise_hamming.png|300px|thumb|upright|alt=Hamming distance|Pairwise Hamming distance: Calculated for each layer and then averaged across each path. This plot took 22 minutes and 40 seconds to generate.]]
-
| [[File:Population_diversity_low.png|thumb|300px|upright|alt=Population diversity in low search|FILLER]]
+
| [[File:Average_population_diversity_homemade.png|thumb|300px|upright|alt=Homemade distance|Homemade diversity metric: This diversity metric resulted in a scaled version of Pairwise Hamming, but took only 36 seconds to generate. See description below]]
-
| [[File:Population_diversity_high.png|thumb|300px|alt=Population diversity in high search|FILLER]]
+
| [[File:Average_population_diversity_euclidean_centroid.png|thumb|300px|alt=Euclidean distance|Average euclidean distance to centroid: Calculated by averaging the euclidean distance between every genotype in a generation, and a "centroid genotype". The plot was generated in 40 seconds]]
|}
|}
 +
 +
== Home-made for each layer ==
{|style="margin: 0 auto;"
{|style="margin: 0 auto;"
-
| [[File:Population_diversity_low2high.png|thumb|300px|alt=Population diversity in low2high search|FILLER]]
+
| [[File:Population_diversity_recomb.png|300px|thumb|upright|alt=Population diversity in recomb search|Average population diversity for each layer in generation. Experiment: Recomb]]
-
| [[File:Population_diversity_high2low.png|thumb|300px|alt=Population diversity in high2low search|FILLER]]
+
| [[File:Population_diversity_low.png|thumb|300px|upright|alt=Population diversity in low search|Average population diversity for each layer in generation. Experiment: Low]]
 +
| [[File:Population_diversity_high.png|thumb|300px|alt=Population diversity in high search|Average population diversity for each layer in generation. Experiment: High]]
|}
|}
-
 
-
 
-
== Path size ==
 
{|style="margin: 0 auto;"
{|style="margin: 0 auto;"
-
| [[File:Average_path_size.png|300px|thumb|upright|alt=Path size|FILLER]]
+
| [[File:Population_diversity_low2high.png|thumb|300px|alt=Population diversity in low2high search|Average population diversity for each layer in generation. Experiment: Low to High]]
-
| [[File:Average_size_by_layer.png|thumb|300px|upright|alt=Layer size|FILLER]]
+
| [[File:Population_diversity_high2low.png|thumb|300px|alt=Population diversity in high2low search|Average population diversity for each layer in generation. Experiment: High to Low]]
|}
|}
-
 
+
= Path size =
-
== Capacity and Reuse ==
+
{|style="margin: 0 auto;"
{|style="margin: 0 auto;"
-
| [[File:Capacity_pr_generation.png|300px|thumb|upright|alt=Capacity development during search|FILLER]]
+
| [[File:Average_path_size.png|300px|thumb|upright|alt=Path size|The change in average path size for each generation. ]]
-
| [[File:Capacity_pr_validation_accuracy.png|thumb|300px|upright|alt=Capacity vs accuracy|FILLER]]
+
| [[File:Average_size_by_layer.png|thumb|300px|upright|alt=Layer size|The average size of each layer in each optimal path found.]]
-
| [[File:Module_reuse_pr_generation.png|thumb|300px|upright|alt=Module reuse development during search|FILLER]]
+
|}
|}
 +
= Capacity and Reuse =
 +
{|style="margin: 0 auto;"
 +
| [[File:Capacity_pr_generation.png|300px|thumb|upright|alt=Capacity development during search|Average number of modules used during the different searches plotted consecutively. The gray dotted line is what number of modules would be used if modules were selected randomly for each task.]]
 +
| [[File:Capacity_pr_validation_accuracy.png|thumb|300px|upright|alt=Capacity vs accuracy|Used capacity in a PathNet plotted against that networks average classification accuracy for all tasks]]
 +
| [[File:Module_reuse_pr_generation.png|thumb|300px|upright|alt=Module reuse development during search|Average reuse for each generation plotted for each experiment type. The gray dotted line is what reuse would be reached by random module selection]]
 +
|}
-
== Training ==
+
= Training =
{|style="margin: 0 auto;"
{|style="margin: 0 auto;"
-
| [[File:Training_accuracy.png|300px|thumb|upright|alt=Training accuracy|FILLER]]
+
| [[File:Training_accuracy.png|300px|thumb|upright|alt=Training accuracy|Average training accuracy for each of the five search algorithms during the search for each task. The dotted line is the validation accuracy reached after the search was completed.]]
-
| [[File:Training_value.png|thumb|300px|upright|alt=Training value|FILLER]]
+
| [[File:Training_value.png|thumb|300px|upright|alt=Training value|Number of training iterations in total for all modules in the PathNet plotted against the cumulative validation accuracy reached for all tasks. The size of the circle corresponds to the amount of modules used.]]
-
| [[File:Used_training_ration.png|thumb|300px|upright|alt=Used Training ratio|FILLER]]
+
| [[File:Used_training_ration.png|thumb|300px|upright|alt=Used Training ratio|Plot of the ratio of unit training in locked and stored modules on the total number of unit training in all modules for each task]]
|}
|}

Nåværende revisjon fra 28. feb 2018 kl. 16:12

Innhold

Population Diversity

Diversity metrics

Three different diversity calculations have been performed, which resulted in three similar diversity messures:

Hamming distance
Pairwise Hamming distance: Calculated for each layer and then averaged across each path. This plot took 22 minutes and 40 seconds to generate.
Homemade distance
Homemade diversity metric: This diversity metric resulted in a scaled version of Pairwise Hamming, but took only 36 seconds to generate. See description below
Euclidean distance
Average euclidean distance to centroid: Calculated by averaging the euclidean distance between every genotype in a generation, and a "centroid genotype". The plot was generated in 40 seconds

Home-made for each layer

Population diversity in recomb search
Average population diversity for each layer in generation. Experiment: Recomb
Population diversity in low search
Average population diversity for each layer in generation. Experiment: Low
Population diversity in high search
Average population diversity for each layer in generation. Experiment: High
Population diversity in low2high search
Average population diversity for each layer in generation. Experiment: Low to High
Population diversity in high2low search
Average population diversity for each layer in generation. Experiment: High to Low

Path size

Path size
The change in average path size for each generation.
Layer size
The average size of each layer in each optimal path found.

Capacity and Reuse

Capacity development during search
Average number of modules used during the different searches plotted consecutively. The gray dotted line is what number of modules would be used if modules were selected randomly for each task.
Capacity vs accuracy
Used capacity in a PathNet plotted against that networks average classification accuracy for all tasks
Module reuse development during search
Average reuse for each generation plotted for each experiment type. The gray dotted line is what reuse would be reached by random module selection

Training

Training accuracy
Average training accuracy for each of the five search algorithms during the search for each task. The dotted line is the validation accuracy reached after the search was completed.
Training value
Number of training iterations in total for all modules in the PathNet plotted against the cumulative validation accuracy reached for all tasks. The size of the circle corresponds to the amount of modules used.
Used Training ratio
Plot of the ratio of unit training in locked and stored modules on the total number of unit training in all modules for each task
Personlige verktøy