It’s not that. It’s the idea that by being right just a bit more times than wrong, statistically this would bring out good results if you try it enough times. If that doesn’t happen, it’s really your fault 😀.
This is the power of specifications. With a specification, the LLM can create a test to ensure what it creates meets the specification. Then the agent can iterate on solution after solution until its proposed solution meets all your specifications. Then you get to discover how many holes you left open in your specifications.
Another thing AI agents based on LLMs aren’t half bad at: reviewing specifications for completeness and readiness for implementation. They’ll go ahead and fill in the blanks for you if you ask them to, but if you ask them instead to point out the holes then you can decide what should be done instead of “yeah, just make mine like all the other ones you have seen in your training.”
It’s not that. It’s the idea that by being right just a bit more times than wrong, statistically this would bring out good results if you try it enough times. If that doesn’t happen, it’s really your fault 😀.
This is the power of specifications. With a specification, the LLM can create a test to ensure what it creates meets the specification. Then the agent can iterate on solution after solution until its proposed solution meets all your specifications. Then you get to discover how many holes you left open in your specifications.
Another thing AI agents based on LLMs aren’t half bad at: reviewing specifications for completeness and readiness for implementation. They’ll go ahead and fill in the blanks for you if you ask them to, but if you ask them instead to point out the holes then you can decide what should be done instead of “yeah, just make mine like all the other ones you have seen in your training.”