Explaining SolidGoldMagikarp by looking at it from random directions
aizi.substack.com
[AI Safety Relevance Rating: AI] Summary I conducted an experiment that provides evidence that many of the weird tokens demonstrating the SolidGoldMagikarp phenomenon are interior points in the token embedding cloud. This would be sufficient to make them “unspeakable”.
Explaining SolidGoldMagikarp by looking at it from random directions
Explaining SolidGoldMagikarp by looking at it…
Explaining SolidGoldMagikarp by looking at it from random directions
[AI Safety Relevance Rating: AI] Summary I conducted an experiment that provides evidence that many of the weird tokens demonstrating the SolidGoldMagikarp phenomenon are interior points in the token embedding cloud. This would be sufficient to make them “unspeakable”.