I'd be more interested in understanding why OAI would think exporting PII to a 3rd party platform was acceptable. As for whether they follow the same standard with other providers, all bets are now off
At Kilo (VScode plugin, BYOK so works with Claude Pro) we just rolled out autocomplete to 10% of our user base on Friday and we're happy with what we're seeing. The autocomplete is based a Mistal model (Codestral) that is fast and accurate https://mistral.ai/news/codestral We copied a lot of code from Continue.dev (best open source autocomplete in our view). We plan to roll it out to 100% of our users no later than Tuesday. The autocomplete is consumption priced (no markup) but the cost per month should be low single digit dollars.
Kilo’s been on my list of tools to try anyway. Good to hear you’ve got a strategy for useful autocomplete. Any idea how it compares with Supermaven both in terms of speed and quality? Supermaven really had found a sweet spot for both. I found LLM autocomplete was generally more annoying than it was worth prior to Supermaven.
The cost improvements are great. If you miss the automation that AWS does for database servers consider using something like https://www.ubicloud.com/ that is great for PostgreSQL servers. On bare metal these typically also support 5x the number of IOPS without paying through the nose.
So the core idea is to use an LLM to draft reasoning as a structured, JSON domain-specific language (DSL), then deterministically translate that into first-order logic and verify it with a theorem prover (Z3).
Interesting that the final answer is provably entailed (or you get a counterexample), instead of being merely persuasive chain-of-thought.
I was watching the crescent city webcam and watched the fishing boats rushing out of the harbor after the quake. The webcam is now down, so I hope they made it.
Crescent city has a long history of being devastated by norcal quakes due the the bathymetry and costline profile.
'Inmiced' lol! Thanks for keeping the titles accurate, so important especially with cancer research results. Happy holidays and I really enjoyed reading the quote on your profile https://news.ycombinator.com/user?id=dang
reply