Lucid

Lucid is developing interactive video models to create universe simulations. Their approach involves training video models capable of simulating hyper-realistic environments with immersive control. This replaces traditional game or physics engines with dynamic neural networks, offering a novel approach to simulation. The company has achieved significant advancements in action-conditioned diffusion video models, demonstrated by their Minecraft simulation running at over 20fps on a 4090 GPU. This model is reportedly five times faster than existing Minecraft World Models and was trained using significantly fewer resources. Lucid's innovation lies in aggressive compression within their tokenizer, achieving a 128x compression rate compared to the traditional 8x. This allows their model to run much faster due to the quadratic scaling of attention with the number of tokens. Currently, Lucid is focused on training a hyper-realistic world model, pushing the boundaries of interactive simulation technology.