Time series data is often composed of a multitude of individual, superimposed dynamics. We propose a novel algorithm for inferring time series compositions through evolutionary synchronization of modular networks (ESMoN). ESMoN orchestrates a set of trained dynamic modules, assuming that some of those modules’ dynamics, suitably parameterized, will be present in the targeted time series. With the help

We introduce and experimentally demonstrate the utility of tag-based genetic regulation, a new genetic programming (GP) technique that allows programs to dynamically adjust which code modules to express.Tags are evolvable labels that provide a flexible mechanism for referencing code modules. Tag-based genetic regulation extends existing tag-based naming schemes to allow programs to “promote” and “repress”

Various machine learning techniques exist to perform regression on temporal data with concept drift occurring. However, there are numerous nonstationary environments where these techniques may fail to either track or detect the changes. This study develops a genetic programming-based predictive model for temporal data with a numerical target that tracks changes in a dataset due to concept drift. When

When dealing with a new time series classification problem, modellers do not know in advance which features could enable the best classification performance. We propose an evolutionary algorithm based on grammatical evolution to attain a data-driven feature-based representation of time series with minimal human intervention. The proposed algorithm can select both the features to extract and the sub-sequences

Modifying standard gradient boosting by replacing the embedded weak learner in favor of a strong(er) one, we present SyRBo: symbolic-regression boosting. Experiments over 98 regression datasets show that by adding a small number of boosting stages—between 2 and 5—to a symbolic regressor, statistically significant improvements can often be attained. We note that coding SyRBo on top of any symbolic regressor

Genetic Network Programming (GNP) is a relatively recently proposed evolutionary algorithm which is an extension of Genetic Programming (GP). However, individuals in GNP have graph structures. This algorithm is mainly used in decision making process of agent control problems. It uses a graph to make a flowchart and use this flowchart as a decision making strategy that an agent must follow to achieve

Automated machine learning (AutoML) and artificial neural networks (ANNs) have revolutionized the field of artificial intelligence by yielding incredibly high-performing models to solve a myriad of inductive learning tasks. In spite of their successes, little guidance exists on when to use one versus the other. Furthermore, relatively few tools exist that allow the integration of both AutoML and ANNs

It is crucial in the field of image steganography to find an algorithm for hiding information by using various combinations of compression techniques. The primary factors in this research are maximizing the capacity and improving the quality of the image. The image quality cannot be compromised up to a certain level as it breaks the concept of steganography by getting distorted visibly. The second

Designing a Recurrent Neural Network to extract sentiment from tweets is a very hard task. When using memory cells in their design, the task becomes even harder due to the large number of design alternatives and the costly process of finding a performant design. In this paper we propose an original evolutionary algorithm to address the hard challenge of discovering novel Recurrent Neural Network memory

Recent advancements in deep learning have reinvigorated interest at the intersection of art, creativity and machine learning. Current interest in creative machines captivates diverse audiences, thus rekindling the 1960’s fascination with cybernetics. Readers are invited to choose between various types of studies introducing the issue of AI creativity, such as “Computational Creativity: The Philosophy

This paper describes a new modification of fuzzy cognitive maps (FCMs) for the modeling of autonomous entities that make decisions in a dynamic environment. The paper offers a general design for an FCM adjusted for the decision-making of autonomous agents through the categorization of its concepts into three different classes according to their purpose in the map: Needs , Activities , and States (FCM-NAS)

Supervised learning by means of Genetic Programming (GP) aims at the evolutionary synthesis of a model that achieves a balance between approximating the target function on the training data and generalising on new data. The model space searched by the Evolutionary Algorithm is populated by compositions of primitive functions defined in a function set . Since the target function is unknown, the choice

Intraday trading attempts to obtain a profit from the microstructure implicit in price data. Intraday trading implies many more transactions per stock compared to long term buy-and-hold strategies. As a consequence, transaction costs will have a more significant impact on the profitability. Furthermore, the application of existing long term portfolio selection algorithms for intraday trading cannot

Genetic Programming and Evolvable Machines (GPEM) published its inaugural volume in 2000, with four issues covering a range of topics, from applications in electronics to theoretical analyses. GPEM’s birth was one of several important events in a time of change and new beginnings in the field. The first GECCO was only a year earlier (GPEM’s issue 3 contained a short summary [1]), and the first EvoStar

Cyber security adversaries and engagements are ubiquitous and ceaseless. We delineate Adversarial Genetic Programming for Cyber Security , a research topic that, by means of genetic programming (GP), replicates and studies the behavior of cyber adversaries and the dynamics of their engagements. Adversarial Genetic Programming for Cyber Security encompasses extant and immediate research efforts in a

Symbolic regression (SR) is a powerful method for building predictive models from data without assuming any model structure. Traditionally, genetic programming (GP) was used as the SR engine. However, for these purely evolutionary methods it was quite hard to even accommodate the function to the range of the data and the training was consequently inefficient and slow. Recently, several SR algorithms

Genetic programming has found recent success as a tool for learning sets of features for regression and classification. Multidimensional genetic programming is a useful variant of genetic programming for this task because it represents candidate solutions as sets of programs. These sets of programs expose additional information that can be exploited for building block identification. In this work,

This special issue highlights particularly promising work presented at Genetic Programming events in 2019, including EuroGP’19 and GECCO’19 GP track. The European Conference on Genetic Programming (EuroGP) is the world’s only conference devoted to Genetic Programming (GP). The EuroGP’19 conference was held in Leipzig, Germany, in April 2019. The conference proceedings published 18 papers (12 presented

It is a great pleasure to present this special section for the Genetic Programming and Evolvable Machines journal on Integrating Numerical Optimization Methods with Genetic Programming (GP). In traditional GP the search space includes all possible syntactic expressions that can be generated from the set of functions and terminals. The structure of this search space depends on the program representation

Genetic programming is a powerful, robust and versatile tool that is suitable for predicting and forecasting, especially in the steelmaking industry, where the diversity of serial production processes and equipment strongly influence final product properties, quality and price. The article reviews a wide spectrum of implementation attempts of genetic programing in the steelmaking industry, including

We present a review of the application of genetic programming (GP) and other variations of evolutionary computation (EC) to the creative art of music composition. Throughout the development of EC methods, since the early 1990s, a small number of researchers have considered aesthetic problems such as the act of composing music alongside other more traditional problem domains. Over the years, interest

Manifold learning techniques have become increasingly valuable as data continues to grow in size. By discovering a lower-dimensional representation (embedding) of the structure of a dataset, manifold learning algorithms can substantially reduce the dimensionality of a dataset while preserving as much information as possible. However, state-of-the-art manifold learning algorithms are opaque in how they

We introduce a form of neutral horizontal gene transfer (HGT) to evolving graphs by graph programming (EGGP). We introduce the $$\mu \times \lambda$$ μ × λ evolutionary algorithm (EA), where $$\mu$$ μ parents each produce $$\lambda$$ λ children who compete only with their parents. HGT events then copy the entire active component of one surviving parent into the inactive component of another parent

Since the early nineties the lack of scalability of fitness evaluation has been the main bottleneck preventing the adoption of evolutionary algorithms for logic circuits synthesis. Recently, various formal approaches such as SAT and BDD solvers have been introduced to this field to overcome this issue. This made it possible to optimise complex circuits consisting of hundreds of inputs and thousands

Lexicase parent selection filters the population by considering one random training case at a time, eliminating any individual with an error for the current case that is worse than the best error of any individual in the selection pool, until a single individual remains. This process often stops before considering all training cases, meaning that it will ignore the error values on any cases that were

Genotype–phenotype mapping plays an essential role in the design of an evolutionary algorithm. Variation occurs at the genotypic level but fitness is evaluated at the phenotypic level, therefore, this mapping determines if and how variations are effectively translated into quality improvements. In evolutionary algorithms, this mapping has often been observed as highly redundant, i.e., multiple genotypes

Self-Organizing Coalitions for Managing Complexity by Juan C. Burguillo introduces a framework for designing algorithms based on ideas from network theory, cellular automata, multi-agent systems, and game theory; each of these is used to find solutions to complex problems. Centrally, this is done by leveraging cooperation and communication to elicit self-organization. This book is appropriate for any

Predictive algorithms are powerful tools to support infection surveillance plans based on the monitoring of vector abundance. In this article, we explore the use of genetic programming (GP) to build a predictive model of mosquito abundance based on environmental and climatic variables. We claim, in fact, that the heterogeneity and complexity of this kind of dataset demands algorithms capable of discovering

This article describes a new genetic-programming-based optimization method using a multi-gene approach along with a niching strategy and periodic domain constraints. The method is referred to as Niching MG-PMA, where MG refers to multi-gene and PMA to parameter mapping approach. Although it was designed to be a multimodal optimization method, recent tests have revealed its suitability for unimodal

In this paper we analyze the effects of using nonlinear least squares for parameter identification of symbolic regression models and integrate it as local search mechanism in tree-based genetic programming. We employ the Levenberg–Marquardt algorithm for parameter optimization and calculate gradients via automatic differentiation. We provide examples where the parameter identification succeeds and

We propose a genetic programming markup language (GPML), an XML-based standard for the interchange of genetic programming trees, and outline the benefits such a format would bring in allowing the deployment of trained genetic programming (GP) models in applications as well as the subsidiary benefit of allowing GP researchers to directly share trained trees. We present a formal definition of this standard

Evolutionary circuit design is a promising way to study new circuit design methodologies, and the passive filter is the most basic circuit module widely existing in modern electronic systems. Focused on the basic and fatal criterion related to the filter circuit design, this paper presents a novel evolutionary design model of passive filter circuit. The proposed model includes a circuit representation

Transfer learning (TL) is the process by which some aspects of a machine learning model generated on a source task is transferred to a target task, to simplify the learning required to solve the target. TL in Genetic Programming (GP) has not received much attention, since it is normally assumed that an evolved symbolic expression is specifically tailored to a problem’s data and thus cannot be used

Inspyred 1.0 is an open-source, freely available Python module developed by Dr. Aaron Garrett of Wofford College, Spartanburg, South Carolina, USA (https ://aaron garre tt.githu b.io/woffo rd-webs/). The project is under active development, with the latest updates released in January 2019. Inspyred provides Python implementations for some of the most commonly used Evolutionary Algorithms (Genetic Algorithms

The process of developing new test statistics is laborious, requiring the manual development and evaluation of mathematical functions that satisfy several theoretical properties. Automating this process, hitherto not done, would greatly accelerate the discovery of much-needed, new test statistics. This automation is a challenging problem because it requires the discovery method to know something about

GPTIPS is a widely used genetic programming software that was developed in Matlab. The most recent version of this software, GPTIPS 2.0, provides a symbolic multi-gene regression for data analysis, in addition to traditional evolutionary algorithms. We briefly explain the GPTIPS methodology and describe its main features, including its weaknesses and strengths, and give examples of GPTIPS applications

Aoun proposes the transformation of higher education by introducing an educational model inspired by humanics: a concept meaning the integration of critical thinking, systems thinking, entrepreneurship, cultural agility, and the three new literacies (data literacy, technological literacy, and human literacy). This educational model develops a professional characteristic that Aoun calls Robot-Proof

Automatic programming, the automatic generation of a computer program given a high-level statement of the program’s desired behaviour, is a stated objective of the field of genetic programming. As the general solution to a computational problem is to write a computer program, and given that genetic programming can automatically generate a computer program, researchers in the field of genetic programming

While the origins of genetic programming (GP) stretch back over 50 years, the field of GP was invigorated by John Koza’s popularisation of the methodology in the 1990s. A particular feature of the GP literature since then has been a strong interest in the application of GP to real-world problem domains. One application domain which has attracted significant attention is that of finance and economics

Cartesian genetic programming, a well-established method of genetic programming, is approximately 20 years old. It represents solutions to computational problems as graphs. Its genetic encoding includes explicitly redundant genes which are well-known to assist in effective evolutionary search. In this article, we review and compare many of the important aspects of the method and findings discussed

In this work we present an extensive bibliometric and content-based analysis of the scientific literature about genetic programming in the twenty-first century. Our work has two key peculiarities. First, we revealed the topics emerging from the literature based on an unsupervised analysis of the textual content of titles and abstracts. Second, we executed all of our analyses twice, once on the papers

Since its inception genetic programming, and later variations such as grammar-based genetic programming and grammatical evolution, have contributed to various domains such as classification, image processing, search-based software engineering, amongst others. This paper examines the role that genetic programming has played in education. The paper firstly provides an overview of the impact that genetic

This work takes us through the literature on applications of genetic programming to problems of natural language processing. The purpose of natural language processing is to allow us to communicate with computers in natural language. Among the problems addressed in the area is, for example, the extraction of information, which draws relevant data from unstructured texts written in natural language

Neutral program variants are alternative implementations of a program, yet equivalent with respect to the test suite. Techniques such as approximate computing or genetic improvement share the intuition that potential for enhancements lies in these acceptable behavioral differences (e.g., enhanced performance or reliability). Yet, the automatic synthesis of neutral program variants, through program

A novel feature selection method based on a multi-swarm particle swarm optimization (MSPSO) is proposed in this paper. The canonical particle swarm optimization (PSO) has been widely used for feature selection problems. However, PSO suffers from stagnation in local optimal solutions and premature convergence in complex feature selection problems. This paper employs the multi-swarm topology in which

The covariance matrix adaptation evolution strategy (CMA-ES) is an efficient derivative-free optimization algorithm. It optimizes a black-box objective function over a well-defined parameter space in which feature functions are often defined manually. Therefore, the performance of those techniques strongly depends on the quality of the chosen features or the underlying parametric function space. Hence

Evolutionary algorithms have been used to solve a number of variable-length problems, many of which share a common representation. A set of design variables is repeatedly defined, giving the genome a segmented structure. Each segment encodes a portion, frequently a single component, of the solution. For example, in a wind farm design problem each segment may encode the position and height of a single

We propose a novel method to evolve autoencoding structures through genetic programming (GP) for representation learning on high dimensional data. It involves a partitioning scheme of high dimensional input representations for distributed processing as well as an on-line form of learning that allows GP to efficiently process training datasets composed of hundreds or thousands of samples. The use of

The GPTP workshop series, which began in 2003, has served over the years as a focal meeting for genetic programming (GP) researchers. As such, we think it provides an excellent source for studying the development of GP over the past fifteen years. We thus present herein a trajectory of the thematic developments in the field of GP.

Research on classifier transferability intends that the information gathered in the solution of a given classification problem could be reused in the solution of similar or related problems. We propose the evolution of transferable classifiers based on the use of multi-objective genetic programming and new fitness-functions that evaluate the amount of transferability. We focus on the domain adaptation

This work presents a unique genetic programming (GP) approach that integrates a numerical local search method and a bloat-control mechanism to address some of the main issues with traditional GP. The former provides a directed search operator to work in conjunction with standard syntax operators that perform more exploration in design space, while the latter controls code growth by maintaining program

Stochastic synthesis of recursive functions has historically proved difficult, not least due to issues of non-termination and the often ad hoc methods for addressing this. This article presents a general method of implicit recursion which operates via an automatically-derivable decomposition of datatype structure by cases, thereby ensuring well-foundedness. The method is applied to recursive functions

The book’s title promises an evolutionary approach to machine learning and deep neural networks. In fact, it covers both an evolutionary approach to machine learning and machine learning approach to evolutionary computations. It presents the current trends in the research area connecting evolutionary algorithms (EAs) and machine learning (ML), and covers a wide range of various hybrid approaches benefiting

In computer vision, the salient object detection problem consists of finding the most attention-grabbing objects in images. In the last years, many researchers have proposed salient object detection algorithms to address this problem. However, most of the algorithms perform well only on images with specific conditions and they do not solve the general problem. To cope with a more significant number

This Volume marks the completion of two decades of Genetic Programming and Evolvable Machines, which we will celebrate with a Twentieth Anniversary Special Issue edited by Nicholas Freitag McPhee and W. B. Langdon. The editorial process for the anniversary issue is still in progress as I write this introduction, but it is already clear that it will include significant pieces on the history, state of

The scale at which the human race consumes data has increased exponentially in recent years. One key part in this increase has been the usage of smart phones and connected devices by the populous. Multi-level heterogeneous networks are the driving force behind this mobile revolution, but these are constrained with limited bandwidth and over-subscription. Scheduling users on these networks has become

The journal and in particular the resource reviews have been running for 20 years. We summarise the GP literature, including top papers and authors, as seen by users of the genetic programming bibliography. Then revisit our original goals for GPEM book reviews and compare them with what has achieved.

The automated design of a set of practice problems that co-adapts to a population of learners is a challenging problem. Fortunately, coevolutionary computation offers a rich framework to study interactions between two co-adapting populations of teachers and learners. This framework is also relevant in scenarios in which a population of students solve practice exercises that are synthesized by an evolutionary

Vector quantization (VQ) is a popular image compression technique with a simple decoding architecture and high compression ratio. Codebook designing is the most essential part in vector quantization. Linde–Buzo–Gray (LBG) is a traditional method of generation of VQ codebook which results in lower PSNR value. A codebook affects the quality of image compression, so the choice of an appropriate codebook