When LLM Batch Processing is Faster than Synchronous

When LLM Batch Processing is Faster than Synchronous

A project I am working on for JM Addington Technology Solutions and CyberSecureRIA involves summarizing > 500,000 emails and documents with an LLM. That’s a lot! There will be ongoing work, but the first 500,000 are a bulk process. To save money, I used...

What’s important to understand is that Nvidia now has more financial firepower than even deep-pocketed tech giants like Google. Analysts expect Google’s free cash flow this year to fall 11% to $65 billion, while they expect Nvidia’s free cash flow to rise...
AI Small Wins; Real World Difference

AI Small Wins; Real World Difference

I’m deeply skeptical of most commercial claims about AI “personalizing” education—at least in the short term. My doubt isn’t about the underlying technology, but about how poorly it’s likey to be executed. (I ought to write another post on this, because it also shows...
OpenAI Has No Moat (And Sam Knows It)

OpenAI Has No Moat (And Sam Knows It)

This might surprise many, but the state of OpenAI large language models are not far enough ahead of their competitors to be a serious barrier to competition. I use models from OpenAI, Anthropic, and Google every day. When any one of them goes down, I can swap over to...