|
|
| (136 intermediate revisions by one user not shown) |
| Line 1: |
Line 1: |
| − | ==Introduction==
| + | #REDIRECT [[GenA: A Genetic Algorithms Framework]] |
| − | Over the last few months I have become interested in problems associated with the modeling of non-linear systems. This interest has lead me to look into artificial neural networks, and how they can be trained using genetic algorithms. For those with an interest in this area, development environments like [http://en.wikipedia.org/wiki/MATLAB Matlab] provide an ideal platform for quick implementation and testing. However, at deployment time, a Matlab script is of little use to clients with a limited budget, or to developers targeting some embedded platforms [What about on non-x86 architectures e.g. the supercomputer situated in the engineering department - that don't run Matlab?].
| + | |
| − | | + | |
| − | ... to be continued ...
| + | |
| − | | + | |
| − | | + | |
| − | | + | |
| − | What is the motivation here? Off-line training of neural networks via genetic algorithms to model non-linear systems in a low cost environment.
| + | |
| − | | + | |
| − | ==Theoretical Background==
| + | |
| − | Some Basic theory on genetic algorithms (perhaps some background on artificial neural networks, and artificial neural network training?)
| + | |
| − | | + | |
| − | ==Requirements==
| + | |
| − | What should a generic genetic-algorithms library do, and why? How might this change?
| + | |
| − | | + | |
| − | ==Examples of Genetic-Algorithms Libraries==
| + | |
| − | Describe the Matlab GA libraries, and how they are used. What other examples are there?
| + | |
| − | | + | |
| − | ==A First Attempt==
| + | |
| − | This is the starting point - something I put together around 6 months ago.
| + | |
| − | | + | |
| − | My first working attempt at a generic genetic-algorithms library is shown in Fig. 1. This section will dissect and critique portions of the initial library design.
| + | |
| − | | + | |
| − | [[image:gaFirstAttempt.jpg|thumb|800px|centre|'''Figure 1: A [[UML 2.1]] [[Class diagram|class diagram]] representing my first working attempt at a generic genetic-algorithms library''']]
| + | |
| − | | + | |
| − | ===Creating New Candidates===
| + | |
| − | A set of candidates are required to initiate the algorithm. The creation of this initial set or generation of candidates is the responsibility of the library user.
| + | |
| − | ====The First Attempt====
| + | |
| − | In the first attempt, a modified [[Factory|Factory pattern]] was used here, this was taken from a [http://msdn.microsoft.com/en-us/library/ms954600.aspx Microsoft Patterns and Practices article by Doug Purdy]. An abstract factory class is provided by the library, the user is expected to provide a concrete candidate factory class.
| + | |
| − | ====A New Design====
| + | |
| − | To facilitate building candidates, the user should provide the genetic algorithm with a concrete candidate factory.
| + | |
| − | ===Selection of the Fittest===
| + | |
| − | Upon creating a generation of candidates, the process of creating a new generation begins. To start, a portion of the candidates are selected from the current generation based on fitness. The fitness of each candidate is calculated, then one of several candidate selection algorithms is applied to the current generation. The selection strategy may vary per iteration. The library user is responsible for choosing and configuring the selection strategy.
| + | |
| − | ====The First Attempt====
| + | |
| − | Fitness calculations are known about by
| + | |
| − | *the GeneticAlgorithms class
| + | |
| − | *the Generation class
| + | |
| − | *the Candidate class
| + | |
| − | ====A New Design====
| + | |
| − | | + | |
| − | ===Creating New Candidates via Reproduction===
| + | |
| − | The fittest candidates are taken to begin a new generation. To make up the remainder of the population, new candidates are generated via reproduction. The parent Candidates should be randomly selected from the fittest candidates in the most recent generation. Reproduction, also known as crossover, is performed using one of many possible crossover algorithms. The same reproduction strategy is usually applied to the entire generation in any one iteration. And is often kept constant throughout the algorithm life-cycle. The library user is responsible for choosing the crossover strategy.
| + | |
| − | ====The First Attempt====
| + | |
| − | ====A New Design====
| + | |
| − | | + | |
| − | ===Mutating Candidates===
| + | |
| − | Before progressing onto the next generation, some Candidates are randomly mutated. There are two algorithms to be considered here: One is the algorithm for performing the mutation, the library user is responsible for this. The other is the algorithm used to select Candidates for mutation. There are several algorithms that may be applied here, this selection strategy may vary per iteration. The library user is responsible for choosing the selection strategy.
| + | |
| − | ====The First Attempt====
| + | |
| − | ====A New Design====
| + | |
| − | | + | |
| − | ==A New Design==
| + | |
| − | | + | |
| − | ===Core Class Structure===
| + | |
| − | | + | |
| − | [[image:gaCoreClassStructure.jpg|thumb|800px|centre|'''Figure 2: A [[UML 2.1]] [[Class diagram|class diagram]] representing an attempt to redesign the generic genetic-algorithms library''']]
| + | |
| − | | + | |
| − | ===Communications===
| + | |
| − | | + | |
| − | [[image:gaCommunications.jpg|thumb|800px|centre|'''Figure 3: A [[UML 2.1]] [[Communication diagram|communication diagram]] representing an attempt to redesign the generic genetic-algorithms library''']]
| + | |
| − | | + | |
| − | ==References==
| + | |
| − | #{{Note|1}} http://www.mathworks.com/access/helpdesk/help/toolbox/gads/
| + | |
| − | | + | |
| − | ==See Also==
| + | |
