AI lab by information labs

Let’s talk about AI tokenization in this third episode of our AI in Action series. Tokenization is actually pretty interesting, especially if you ever wondered how these fancy AI machines understand the stuff we type and say and produce things when we give them prompts.  Next time you're marvelling at an AI-generated text, remember it's all about those tiny tokens, dancing together in a complex symphony of language and prediction.