When LLM Batch Processing is Faster than Synchronous

When LLM Batch Processing is Faster than Synchronous

A project I am working on for JM Addington Technology Solutions and CyberSecureRIA involves summarizing > 500,000 emails and documents with an LLM. That’s a lot! There will be ongoing work, but the first 500,000 are a bulk process. To save money, I used...

Can ChatGPT Be A Doctor?

Axios has the sensational headline: ChatGPT plays doctor with 72% success. Driving the news: A new study from Mass General Brigham researchers testing ChatGPT’s performance on textbook-drawn case studies found the AI bot achieved 72% accuracy in overall clinical...