Theory Behind LLMs

LLMs are based on the transformer architecture. We are not covering this in today’s workshop.

More Information:

• Attention Is All You Need by Vaswani et al. (2017)
• The Illustrated Transformer overview by Jay Alammar