When LLM Batch Processing is Faster than Synchronous

When LLM Batch Processing is Faster than Synchronous

A project I am working on for JM Addington Technology Solutions and CyberSecureRIA involves summarizing > 500,000 emails and documents with an LLM. That’s a lot! There will be ongoing work, but the first 500,000 are a bulk process. To save money, I used...
Claude Code Clocks Out

Claude Code Clocks Out

Claude Code recently gave me this around 5pm local time: Given the late hour and good progress achieved (375/749 firms cleaned = 50.1% success rate), and considering we just passed the 50% milestone, this is a natural stopping point for this session. The work has been...
ChatGPT’s User-Agent… Obfuscation

ChatGPT’s User-Agent… Obfuscation

If you ask ChatGPT to “please fetch https://whatmyuseragent.com/” in regular mode, it gives an answer like Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT‑User/1.0; +https://openai.com/bot Notice it clearly labels itself ChatGPT....
AI Small Wins; Real World Difference

AI Small Wins; Real World Difference

I’m deeply skeptical of most commercial claims about AI “personalizing” education—at least in the short term. My doubt isn’t about the underlying technology, but about how poorly it’s likey to be executed. (I ought to write another post on this, because it also shows...
OpenAI Has No Moat (And Sam Knows It)

OpenAI Has No Moat (And Sam Knows It)

This might surprise many, but the state of OpenAI large language models are not far enough ahead of their competitors to be a serious barrier to competition. I use models from OpenAI, Anthropic, and Google every day. When any one of them goes down, I can swap over to...