>> Have you measured your latency, and how sensitive are you to it? Not sensitive to latency at all. My users would rather have well researched answers than po

>> Have you measured your latency, and how sensitive are you to it? Not sensitive to latency at all. My users would rather have well researched answers than poor answers. Also, I use batch mode APIs for chunking .. it is so much cheaper.