Thanks for sharing, Mark. But jeez, do these companies test their AI models on real-world applications before they release them (we know the answer to that)?
I'm sure they'll say it's too hard to build a test rack for real-world use cases and then try to determine differences in behavior and responses across the different models. But that's an excuse, not a reason.
Heck, can't they leverage their very own AI to verify the differences? Just buy some more GPUs!!
The differences we see between Sonnet 5 and other Claude models suggests that the issue is human generated, meaning the dev team. Sonnet is a stop-gap according to our contacts at A, and Fable represents the strategic thrust for models far more than Sonnet. But you’re right — the major GenAI platforms change models without any reference to operating realities, nor do they give heads up advisories. A software company who did that would find itself ejected.
Mark, the other thing about these tools is how much of their capabilities you have to discover on your own. They release the next version and don't provide any guidance on how to leverage capabilities like Project-level contextual knowledgebases, how to activate different personas in the narratives in the Instruction panel, or how best to activate concepts like "Identity as Attraction".
Thanks for sharing, Mark. But jeez, do these companies test their AI models on real-world applications before they release them (we know the answer to that)?
I'm sure they'll say it's too hard to build a test rack for real-world use cases and then try to determine differences in behavior and responses across the different models. But that's an excuse, not a reason.
Heck, can't they leverage their very own AI to verify the differences? Just buy some more GPUs!!
The differences we see between Sonnet 5 and other Claude models suggests that the issue is human generated, meaning the dev team. Sonnet is a stop-gap according to our contacts at A, and Fable represents the strategic thrust for models far more than Sonnet. But you’re right — the major GenAI platforms change models without any reference to operating realities, nor do they give heads up advisories. A software company who did that would find itself ejected.
Mark, the other thing about these tools is how much of their capabilities you have to discover on your own. They release the next version and don't provide any guidance on how to leverage capabilities like Project-level contextual knowledgebases, how to activate different personas in the narratives in the Instruction panel, or how best to activate concepts like "Identity as Attraction".
Heck, maybe they don't even know...