Portions of a generic genetic-algorithms library

From CSSEMediaWiki
(Difference between revisions)
Jump to: navigation, search
(Requirements)
Line 7: Line 7:
  
 
==Requirements==
 
==Requirements==
The intention of this project is to provide a framework that is capable of mimicking the behaviour of the Matlab genetic algorithms library. This framework should be extensible; it should allow for:
+
The intention of this project is to provide a framework that is capable of mimicking the back-end behaviour of the Matlab genetic algorithms library. The framework should allow a client to [[Adapter|adapt]] and extend the framework to suit their specific needs. The framework should:
*Client defined types
+
*Allow optimizing of client defined types
*Client defined selection, reproduction, and mutation strategies
+
*Allow client defined selection, reproduction, and mutation strategies
*Packaged to provide the easy removal of unused strategies
+
*Provide the easy removal of unused strategies for the purposes of reducing the size of the final distributable
Control of the framework should be the domain of the clients application: the intention is to provide a framework that the client can [[Adapter|adapt]] to suit their needs.
+
  
 
==A First Attempt==
 
==A First Attempt==

Revision as of 03:35, 29 September 2008

Contents

Introduction

Over the last few months I have become interested in problems associated with modelling non-linear systems. This interest has lead me to look into artificial neural networks, and how they can be trained using genetic algorithms. For those with an interest in this area, development environments like Matlab provide an ideal platform for quick implementation and testing. However, at deployment time, a Matlab script is of little use to clients with a limited budget, or to developers targeting some embedded platforms. [What about on non-x86 architectures e.g. the supercomputer situated in the engineering department - that don't run Matlab?].

Genetic Algorithms for Dummies

Disclaimer about how much I actually know about genetic algorithms. [Damn it Jim I'm a software engineer, not an AI specialist!]

Requirements

The intention of this project is to provide a framework that is capable of mimicking the back-end behaviour of the Matlab genetic algorithms library. The framework should allow a client to adapt and extend the framework to suit their specific needs. The framework should:

  • Allow optimizing of client defined types
  • Allow client defined selection, reproduction, and mutation strategies
  • Provide the easy removal of unused strategies for the purposes of reducing the size of the final distributable

A First Attempt

This is the starting point - something I put together around 6 months ago.

My first working attempt at a generic genetic-algorithms library is shown in Fig. 1. This section will dissect and critique portions of the initial library design.

Figure 1: A UML 2.1 class diagram representing my first working attempt at a generic genetic-algorithms library

Creating New Candidates

A set of candidates are required to initiate the algorithm. The creation of this initial set or generation of candidates is the responsibility of the library user.

The First Attempt

In the first attempt, a modified Factory pattern was used here, this was taken from a Microsoft Patterns and Practices article by Doug Purdy. An abstract factory class is provided by the library, the user is expected to provide a concrete candidate factory class.

Figure 2: A UML 2.1 class diagram representing my first working attempt at generation initialisation structure
Figure 3: A UML 2.1 communication diagram representing my first working attempt at generation initialisation communications

A New Design

To facilitate building candidates, the user should provide the genetic algorithm with a concrete candidate factory.

Figure 4: A UML 2.1 class diagram representing an attempt to redesign the generation initialisation
Figure 5: A UML 2.1 communication diagram representing an attempt to redesign the generation initialisation communications

Selection of the Fittest

Upon creating a generation of candidates, the process of creating a new generation begins. To start, a portion of the candidates are selected from the current generation based on fitness. The fitness of each candidate is calculated, then one of several candidate selection algorithms is applied to the current generation. The selection strategy may vary per iteration. The library user is responsible for choosing and configuring the selection strategy.

The First Attempt

Fitness calculations are known about by

  • the GeneticAlgorithms class
  • the Generation class
  • the Candidate class
Figure 6: A UML 2.1 class diagram representing my first working attempt at a selection structure
Figure 7: A UML 2.1 communication diagram representing my first working attempt at selection communications

A New Design

Figure 8: A UML 2.1 class diagram representing an attempt to redesign the selection structure
Figure 9: A UML 2.1 communication diagram representing an attempt to redesign the selection communications

Creating New Candidates via Reproduction

A new generation begins by selecting a set of candidates based on fitness. These candidates become the parents in the new generation; they reproduce to create a new set of genetically similar candidates. Reproduction, also known as crossover, is performed using one of several possible crossover algorithms. The same reproduction strategy is usually applied to the entire generation in any one iteration. It is often kept constant throughout the algorithm life-cycle. The library user is responsible for choosing the crossover strategy.

The First Attempt

Figure 10: A UML 2.1 class diagram representing my first working attempt at a candidate reproduction structure
Figure 11: A UML 2.1 communication diagram representing my first working attempt at candidate reproduction communications

A New Design

File:GaNewDesignReproductionStructure.jpg
Figure 12: A UML 2.1 class diagram representing an attempt to redesign the reproduction structure
File:GaNewDesignReproductionCommunications.jpg
Figure 13: A UML 2.1 communication diagram representing an attempt to redesign the the reproduction communications

Mutating Candidates

Following the reproduction process, a proportion of the children produced may be mutated. In mutation, there are two responsibilities. One is performing the mutation - defining this algorithm is the responsibility of the library user. The other is selecting candidates for mutation - here the library user is responsible for choosing from one of several selection strategies defined within the library.

A New Design

File:GaNewDesignMutationStructure.jpg
Figure 14: A UML 2.1 class diagram representing an attempt to redesign the mutation structure
File:GaNewDesignMutationCommunications.jpg
Figure 15: A UML 2.1 communication diagram representing an attempt to redesign the mutation communications

A New Design

Core Class Structure

Figure 2: A UML 2.1 class diagram representing an attempt to redesign the generic genetic-algorithms library

Communications

Figure 3: A UML 2.1 communication diagram representing an attempt to redesign the generic genetic-algorithms library

References

  1. ^ http://www.mathworks.com/access/helpdesk/help/toolbox/gads/

See Also

Personal tools