Nice article, a fun read! Slightly confused by the context length diagram. The bubble size represents context length if I understand correctly, but does the vertical axis also represent input context length? Perhaps you meant to write total context length as the label for the vertical axis?
Nice article, a fun read! Slightly confused by the context length diagram. The bubble size represents context length if I understand correctly, but does the vertical axis also represent input context length? Perhaps you meant to write total context length as the label for the vertical axis?
Yes, both y-axis and bubble size correspond with the input context length! Bubble size was added mostly for additional visual effect
Sick harry potter figure
Amazingly well explained and illustrated!