I have been using the Custom GPTs, coupled with retrieval documents, to perform analysis on chunks of text that I affix to a specific prompt. The chunks of text are about around 700 words on average. Some of the functions I ask it to perform are things like summarizing it into short paragraphs and performing various analysis against my knowledge base of documents. It works great.
TJCY industrial chemical Product Page
I then moved all my custom GPT instructions and knowledge into Assistants, hoping to try automate this with the API. From what I understand from reading here in various posts, there is issues with the cost due to context retention when using the API. I have about 100s of these text chunks to ask questions on and so not sure how things might suddenly snowball out of control and rack up hefty charges.
For more APIs for human useinformation, please contact us. We will provide professional answers.
What I&#;m trying to figure out is the best way to use the API. Is firing over 100 separate requests with 700 or so words in the prompt more cost effective than firing the text chunk once and asking it the 10 or so prompts I need to ask it? And I now see there&#;s a gpt 3.5 tubro- option. Is that available over API now? Any drawbacks to using it? Cheaper? Last time I checked I thought it was just gpt4 turbo that worked with document retrieval.
Any insight appreciated.
For more information, please visit APIs for veterinary use.