Some back-of-the-napkin math for Meta's Llama 4 Scout
Do you want to guest post this on AIMS?
I would love to. I've also got something else cooking that I think would make a great guest post.
Why not do both :)
Sounds good to me!
Thanks for such a simple but powerful explanation. Context costs memory and here is how much. Therefore, RAG is not dead and the bottom line will figure out that using a long context window has its uses but use it sparingly.
Exactly! I can't really advocate for or against using it sparingly, but understanding how it works is pretty important.
Do you want to guest post this on AIMS?
I would love to. I've also got something else cooking that I think would make a great guest post.
Why not do both :)
Sounds good to me!
Thanks for such a simple but powerful explanation. Context costs memory and here is how much. Therefore, RAG is not dead and the bottom line will figure out that using a long context window has its uses but use it sparingly.
Exactly! I can't really advocate for or against using it sparingly, but understanding how it works is pretty important.