evolutionary-search

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.

Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)

[NeurIPS'22] Does Self-supervised Learning Really Improve Reinforcement Learning from Pixels?