Scaling the Size of LLMs Yields Sharply Diminishing Persuasive Returns

We find that:
➡️ current frontier models (GPT-4, Claude-3) are barely more persuasive than models smaller in size by an order of magnitude or more, and
➡️ mere task completion (coherence, staying on topic) appears to account for larger models' persuasive advantage.

— Kobi Hackenburg (@KobiHackenburg) June 21, 2024