I released Promptimizer – an automated approach to prompt optimization
I built Promptimizer to search for better prompts for a defined task. This July 2024 release links the framework and reports my stock-screening result.
What is Promptimizer?
Promptimizer is an open-source framework that automatically optimizes AI prompts using genetic algorithms. It's the brainchild of our team, born from the desire to make AI more accurate and easier to use.
Why should you care?
- Improved AI Performance: In July 2024, I reported our AI Stock Screener’s accuracy increasing from 70% to a range of 84% to 85% in one hour. This announcement does not include the evaluation sample size, scoring definition or before/after prompts, so those percentages describe the reported test rather than a reproducible benchmark.
- A starting project needs a defined question, example inputs with expected outputs, a candidate prompt, a scoring function and a configured model. For example, a screening task can ask which semiconductor stocks had the highest net income in fiscal 2020. Decide what makes a returned company list correct, then reserve evaluation examples that do not select the prompt.
- Open Source: You can use and contribute to Promptimizer for free via GitHub.
How can you get involved?
- Check out the Promptimizer GitHub repository: https://github.com/austin-starks/Promptimizer
- Read our detailed article on how it works: https://medium.com/p/bbcb9afaef83
- Start with the GitHub quick start: configure the model, question and evaluation examples, then run the prompt search. Compare the selected prompt on reserved examples using the same scoring definition. Report the sample count with your result before sharing it.
Follow me: LinkedIn | X (Twitter) | TikTok | Instagram
While I'm thrilled about how Promptimizer is enhancing NexusTrade, I'm even more excited about its potential to empower AI enthusiasts like you. Whether you're a developer, a business owner, or just curious about AI, I encourage you to explore Promptimizer.
I'd love to hear your thoughts and see what you create with this tool. Share your experiences and be sure to tag me and share the repo!
Happy optimizing!
Best regards,
Austin Starks
P.S. Don't forget to check out the latest AI-powered features in NexusTrade, now enhanced by Promptimizer!
Go to NexusTradeMake a Difference in the NexusTrade Story
I'm working to make NexusTrade the best algorithmic trading platform that the world has ever seen, and I need your help! Is there something you think I could be doing better?
Fill out the survey
No comments yet.