Its a good read but are his intentions unambiguously good? He had a windfall from crypto (ie contributing nothing to society). Then he was desperate to avoid paying the tax he owed on that windfall.
Is there any actual need for this Solar Farm in the middle of nowhere (that was only built there because of a tax scheme)? Are Texas ratepayers meant to cover the cost of the interconnect in their $/Kwh instead of him?
Better to just pay his taxes and move on, and leave the subsidies for an actual useful solar project.
EDIT: Oh and mineral rights are basically the original cryptocurrency/memecoin, so its somewhat funny that they came into play
The extra costs and limits are ostensibly because of safety. Yes, I know that engineers can game the system, but they're listing real reasons why the plant should shoulder the costs to the larger grid.
Hilariously there was a story how Google could not train on Youtube data due to their TOS, so they changed it for new videos. Meanwhile everyone else was scraping Youtube as much as they liked and training on it.
Anyone who thinks the VA is well run should watch a few episodes of the “financial audit” YouTube channel. The most financially irresponsible people in the world (and generally bad people in general). Almost all are cashing a “disability” payment from the VA.
My theory for these PM's is its basically a cheap way to take potential entrepreneurs off the market. Its hard to predict if a startup will succeed but one genre of success is having a Type A "fake it till you make it" non technical cofounder who can keep raising long enough to get product market fit.
These types all go to the same schools and do really well, interview the same, and value the prestige of working in big tech. So it's pretty easy to identify them and offer them a great career path and take them off the market.
Technical founders are way trickier to identify as they can be dropouts, interview poorly, not value the prestige etc.
"knowing why a model refuses to answer something matters"
The companies that create these models cant answer that question! Models get jailbroken all the time to ignore alignment instructions. The robust refusal logic normally sits on top of the model, ie looking at the responses and flagging anything that they don't want to show to users.
The best tool we have for understanding if a model is refusing to answer a problem or actually doesn't know is mechanistic interp, which you only need the weights for.
This whole debate is weird, even with traditional open source code you cant tell the intent of a programmer, what sources they used to write that code etc.
Only one person in the groupchat needs to be using Telemessage, ie. a CIA agent can use a government device with Telemessage to talk to sources on Signal. Signal has a great protocol & robust clients, and getting caught with Signal on your phone is probably a bit better than being caught with CIAChat on your phone.
The actual implementation here is atrocious though.
From the paper it was a speedup on the XLA GPU kernel they wrote using Jax, which is probably not SOTA. I don't think Jax even has a official flash attention implementation.
Not sure what “official” means but would direct you to the GCP MaxText [0] framework which is not what this GDM paper is referring to but rather this repo contains various attention implementations in MaxText/layers/attentions.py
Is there any actual need for this Solar Farm in the middle of nowhere (that was only built there because of a tax scheme)? Are Texas ratepayers meant to cover the cost of the interconnect in their $/Kwh instead of him?
Better to just pay his taxes and move on, and leave the subsidies for an actual useful solar project.
EDIT: Oh and mineral rights are basically the original cryptocurrency/memecoin, so its somewhat funny that they came into play
reply