Recent Posts

Protester climbs onto balcony of Iranian embassy in London

A protester has climbed on to the balcony of the Iranian embassy in west London as hundreds gathered outside the building, waving flags and shouting anti-government slogans. The Metropolitan Police said two arrests had been made at the protest and that officers were also seeking another individual for trespass. Anti-government protests erupted in Iran on 28 December, with two human …

Read More »

How LLMs Handle Infinite Context With Finite Memory

1. Introduction two years, we witnessed a race for sequence length in AI language models. We gradually evolved from 4k context length to 32k, then 128k, to the massive 1-million token window first promised by models like Gemini 1.5 pro. The promise was alluring: dump entire codebases or novels into the model and let it reason across the entire thing. …

Read More »