Recent Posts

How LLMs Handle Infinite Context With Finite Memory

1. Introduction two years, we witnessed a race for sequence length in AI language models. We gradually evolved from 4k context length to 32k, then 128k, to the massive 1-million token window first promised by models like Gemini 1.5 pro. The promise was alluring: dump entire codebases or novels into the model and let it reason across the entire thing. …

Read More »

Baldur’s Gate 3 studio says it won’t use AI for concept art or writing

Following some controversy, the developers at Baldur’s Gate 3 creator Larian Studios have further clarified their use of generative AI. CEO Swen Vincke and other Larian developers held an AMA on Reddit where they answered users’ questions about the team’s next title, Divinity. They also fielded questions related to reports that the studio was using generative AI in its development …

Read More »