A framework for co-evolutionary algorithm using Q-learning with meme

A large number of metaheuristic algorithms have been proposed in the last three decades, but no metaheuristic algorithm is superior to the others for all the optimization problems. It is laborious to select an appropriate metaheuristic algorithm to solve a problem, especially for laymen. In this paper, a framework for co-evolutionary algorithm using Q-learning with the meme is proposed, which is called as QLMA. The solution generation method in the metaheuristic algorithm is named meme, which is also viewed as the action for an agent in Q-learning, and multiple memes form the action set. In the initial stage, the tent map and opposition based learning are employed to obtain the initial population. In updating stage, a new population is generated by an action that is chosen from the action set by the agent in Q-learning, then the disruption operation is applied, avoiding excessive aggregation of solutions around the current global optimal solution and improving the balance between exploration and exploitation. QLMA is compared to sixteen algorithms on 23 classical benchmark functions, CEC 2017, and CEC 2019 benchmark functions. The experimental results demonstrate that QLMA is superior to the peer algorithms and has a good balance between exploration and exploitation.