Tkach, Itshak and Blackwell, Tim. 2022. 'Measuring optimiser performance on a conical barrier tree benchmark'. In: Genetic and Evolutionary Computation Conference (GECCO ’22). Boston, MA, United States 9 - 13 July 2022. [Conference or Workshop Item]

Preview

Text Measuring Optimiser.pdf - Accepted Version Download (1MB) | Preview

Abstract or Description

The common method for testing metaheuristic optimisation algorithms is to benchmark against problem test suites. However, existing benchmark problems limit the ability to analyse algorithm performance due to their inherent complexity. This paper proposes a novel benchmark, BTB, whose member functions have known geometric properties and critical point topologies. A given function in the benchmark is a realisation of a specified barrier tree in which funnel and basin geometries, and values and locations of all critical points are predetermined. We investigate the behaviour of two metaheuristics, PSO and DE, on the simplest manifestations of the framework, ONECONE and TWOCONES, and relate algorithm performance to a downhill walker reference algorithm. We study success rate, defined as the probability of optimal basin attainment, and inter-basin mobility. We find that local PSO is the slowest optimiser on the unimodal ONECONE but surpasses global PSO in all TWOCONES problems instances below 70 dimensions. DE is the best optimiser when basin difference depths are large but performance degrades as the differences become smaller. LPSO is the superior algorithm in the more difficult case where basins have similar depth. DE consistently finds the optimum basin when the basins have equal size and a large depth difference in all dimensions below 100D; the performance of LPSO falls away abruptly beyond 70D.

Item Type:	Conference or Workshop Item (Paper)
Identification Number (DOI):	https://doi.org/10.1145/3512290.3528842
Additional Information:	"© 2022 Copyright held by the owner/author(s). This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record is available at, https://doi.org/10.1145/3512290.3528842."
Keywords:	Optimization, Problem benchmarks, Particle swarm optimization, PSO, Differential evolution, DE
Departments, Centres and Research Units:	Computing
Dates:	Date Event 8 July 2022 Published
Event Location:	Boston, MA, United States
Date range:	9 - 13 July 2022
Item ID:	34122
Date Deposited:	27 Sep 2023 12:35
Last Modified:	13 Oct 2023 11:37
URI:	https://research.gold.ac.uk/id/eprint/34122

View statistics for this item...

Edit Record (login required)