9 ms·
I am not sure, it depends on the cost. If they charge per token, a large context will mostly be irrelevant. For some reason, the article did not mention it.
by streetcat1 3y ago
I am not sure, it depends on the cost. If they charge per token, a large context will mostly be irrelevant. For some reason, the article did not mention it.
- kromem 3y agoThe article did mention costs, specifically it was provided to them for free and they don't know how much it will actually cost. As for your larger point, it really depends on the ROI. To summarize your Twitter feed, probably not. To identify correlating factors and trends across your industry's recent research papers, the $5 bill will probably be fine.