Transformer Explainer
Really cool interactive tool to learn about the inner workings of a Transformer model.
Apparently, it runs a GPT-2 instance locally in the user's browser and allows you to experiment with your own inputs.
This is a nice tool to learn more about the different components inside the Transformer and the transformations that occur.
Here is a short video going over the tool: youtu.be/V5kAmFRwuxc
Tool: poloclub.github.io/tran…
Paper:
arxiv.org