When LLM Batch Processing is Faster than Synchronous

When LLM Batch Processing is Faster than Synchronous

A project I am working on for JM Addington Technology Solutions and CyberSecureRIA involves summarizing > 500,000 emails and documents with an LLM. That’s a lot! There will be ongoing work, but the first 500,000 are a bulk process. To save money, I used...
ChatGPT’s User-Agent… Obfuscation

ChatGPT’s User-Agent… Obfuscation

If you ask ChatGPT to “please fetch https://whatmyuseragent.com/” in regular mode, it gives an answer like Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT‑User/1.0; +https://openai.com/bot Notice it clearly labels itself ChatGPT....
OpenAI Has No Moat (And Sam Knows It)

OpenAI Has No Moat (And Sam Knows It)

This might surprise many, but the state of OpenAI large language models are not far enough ahead of their competitors to be a serious barrier to competition. I use models from OpenAI, Anthropic, and Google every day. When any one of them goes down, I can swap over to...
AI: It’s Upcoming Impacts On Small Businesses

AI: It’s Upcoming Impacts On Small Businesses

This essay is the result of months of thoughts and now about three years of work with AI (namely, LLMs), and 15 years in the MSP industry. It is an attempt to sketch out the future as I see it coming. This will dive into some of the technical, but as high of a level...