9 ms·

could the long s `ſ` be throwing the model off?

• peri-cl 1mo ago
  Interesting hypothesis. Replacing "ſ" with "s" did not change the output. I think the simple explanation is the likely one (the reason I deliberately chose this specific benchmark): the model isn't intelligent enough to figure out use/mention distinctions. It understands Voltaire is discussing injustice, violence, tolerance; but it doesn't understand which side he's on.
  • alex_duf 1mo ago
    thanks for testing it! I guess that would make sense for such a small model to be missing the subtlety