Revolut says that in less than a year it’s managed to slash its [code generation] costs by roughly 90 percent by making self-hosted models its default instead of relying primarily on commercial services like Claude.
Revolut says that in less than a year it’s managed to slash its [code generation] costs by roughly 90 percent by making self-hosted models its default instead of relying primarily on commercial services like Claude.
If AI isnʻt going to go away, it needs to be cheap, sustainable, open source, and self hosted/ hostable.
And ethically trained. People should be financially compensated if their data was used to train AI without their consent.
Private copying levy was implemented to compensate greedy media industry. This was included in the price of every writable massmedia device in Finland until 2015.
Maybe something similar could be used with AI. Directly compensating for the victims of ip theft would be pretty impossible but the money could be used to fund art programs and such. AI companies would be the ones paying, based on the usage their models have, be it online or self hosted.
https://en.wikipedia.org/wiki/Private_copying_levy
I don’t think it’s really possible to do this.
I mean speaking just logistically, how would you determine who gets how much? If it’s based on quality, how do you determine what is of high quality? Otherwise, does everyone who has every written anything that finds its way into a training dataset get like a tenth of a cent?
Alternative proposal: all AI models must be released as open weights, available to everyone.
AI, through its use of training data, has benefited from the sum total of human knowledge, therefore the results of this training should be given back for the use of all humanity.
That seems fair to me.
You are right if we look at it short term, long term llm will be replaced with the next thing and who knows maybe it can be trained ethically, at least we should require research into it.
Why not? Both parties have to figure out how much they want to pay or to get payed. Similar like it works for any other license like on Netflix or Spotify. It is not the AI companies job to determine how much they will get payed but how much the data is worth to them and the data creator how much they want.
If i am at a bakery and the bread they offer does not look like its for that much to me then i have not to buy it.
How do you suggest an individual should go about this?
Do I go down to my local courthouse and file a suit against Anthropic so I can ask the judge to subpoena them to determine if my Reddit shitpost from 2012 is in their training set?
Class action lawsuits. How would something like this work for anything else? Like Netflix subscription violations?
And we are talking about meaningful data not your shitpost, like licensed code or a book you wrote and anthropic pirated.
Ah ha! You see, that’s the problem. My shitpost is meaningful data. This is something people seem to have a really hard time understanding. Scaling laws and the size of the search space in AI training means that the datum is not valuable. It’s only the data (in conglomerate) that is value for training, and my shitpost would be a part of that.
Once you understand this, you should see what I meant when I said it’s not feasible. How do you determine and then fairly distribute the payout to everyone who has ever written or recorded anything in digital format? This is not a simple supply vs demand equation, like your bakery example assumes.
Also I have no idea what Netflix has to do with this discussion.
No. Meaningful in the sense of copyright. Data you get copyright
There you got your distinction.
Copyright isn’t something you “get.” It’s something that comes with the production, no extra steps required.
You’ve accidentally come upon the other reason why your example doesn’t hold in the training data case. How do you suss out who actually holds the copyright on that data.
Take my shitpost for example. Whonis the copyright holder? Me the author? Reddit the platform I published on? What if the source was an Internet Archive snapshot?
Do you earnestly believe this could work in practice?
That soup is already cooked. And obtaining consent is prohibitive, so your data set will be tiny.
It is, but the issue is the right time to buy hardware was 2 years ago.
Its like 1/ Mooreʻs law.
The right time to buy hardware was always 2 years ago.