• Asynchronous calls to the openAI API

    I am currently experimenting a lot with chatGPT and similar models. The openAI API provides methods such as “create”: Which are blocking calls, execution will only continue when the call to the API has finished. For exploring prompt engineering and other LLM parameters slows progress significantly. In my experience the openAI API sometimes fails to […]