160 comments

[ 2.9 ms ] story [ 207 ms ] thread
The EU have regulated themselves into a corner where all they can do is shout at American and Asian tech companies who decide how computers will be used. Based solely on past performance this regulation is likely to be another nail in the coffin ensuring that innovation happens on different continents and then trickles back to the EU at some later date.

The economic upsides of AI look like they will be huge. Therefore the odds are good that this regulation will be a crushing economic own-goal.

> The economic upsides of AI look like they will be huge.

There are many ways to interpret this sentence. What did you mean?

If you mean a stupid robot can automate most office jobs, i don't disagree (most of these jobs are entirely useless to begin with, anyway). However is that an upside? History has shown our State/corporate overlords are not too fond of ensuring jobless people have a decent life.

I think it's time we accept the fact that AI will mean the end of capitalism. The system won't be viable anymore once there's no more need for labor.

Where we go from there is up to us.

If we don't do anything, we'll end up with neofeudalism, with the already rich concentrating power more and more, no longer kept in check by pesky labor movements.

Alternatively, we can fight to try to establish a kind of star trek space socialism, where everyone's needs are met and nobody needs to work anymore - people would be free to follow their passions while computers do all the busywork.

Dystopia or Utopia, that's the decision we'll be making over the next few years. The status quo will disappear either way.

I'm pretty sure we've been through this kind of thing before, and I'm also pretty sure AI will just be a part of the future, not replace it.
Have we? I can't think of any previous development that threatened pretty much every form of employment available.

Sure, computers removed a lot of jobs, but they also created a whole new class of them (the ones most people on this site have).

AI will remove that entire class of jobs, too, with nothing new to replace it. For a while, there'll be new opportunities for AI research, but if they actually succeed at improving AI, they'll eventually make themselves redundant, too.

> AI will remove that entire class of jobs, too, with nothing new to replace it

Shit. Are you saying this prompt engineer bootcamp I'm doing is worth squat?

It took me five minutes to write a prompt for GPT-4 that makes it prompt SDXL better than I ever did.
This is actually a funny joke it took me a couple of goes and a quick Google search.
Don't you think this reasoning is a bit black and white?
Can you see any other possible outcome from the vast majority of employment being made obsolete?

This is not a trick question, those are genuinely the only two outcomes I can think of.

Yeah, casino thesis with attention economy. Think MrBeast videos. I think things are trending towards randomness way more than neofeudalism or space socialism.
> Don't you think this reasoning is a bit black and white?

> This is not a trick question, those are genuinely the only two outcomes I can think of.

Only being able to see the two extreme outcomes is pretty much the definition of black / white thinking.

What normally happens is somewhere in the middle.

> Can you see any other possible outcome from the vast majority of employment being made obsolete?

There are an infinite number of possible outcomes.

Probable outcomes are much smaller, but again there’s way more than two.

Life ain’t binary.

This is a nice rant, but it doesn't really answer the question. I understand what black and white is and that those are two extremes.

The task at hand, though, was to come up with a concrete scenario and you've failed at that.

Back when I was in the depths of drug addiction, I was arrogant enough to believe I could think of enough permutations of possible outcomes given input variables etc.

But I was always wrong. I couldn’t predict the future — and neither can you. None of us can.

> The task at hand, though, was to come up with a concrete scenario and you've failed at that.

Nah. The task I assigned myself (I don’t work for you) was to highlight the error in your logical reasoning.

Truth and reality is a lot more analogue. It’s never two options.

Might be a good take home exercise for you to come up with a few boring and likely options that sit somewhere in the middle of dystopia and utopia.

But you don’t have to.

Then we are free to work on harder and larger scale problems. The work will go on.
To start, I think it's better to avoid thinking in terms of an "outcome". That word implies an end scenario, such as total destruction of mankind.

The future will probably go through many different stages, also varying geographically.

There are many science fiction novels that explore futures with androids. Most of them have a different scenario.

I personally think that life will not change all too much. We will still mostly be busy eating, sleeping, trying to find a sex partner, and trying to avoid dying.

One random thing that I think will change society more than AI is human cloning -- things will probably change as soon as some rich people can buy 100,000 clones of themselves.

And that's just one random thing. Extending your life to an age of 10,000 years is another. Or a third world war because of climate change. Or some new financial derivative. All these should be factored in if you want to predict the future. More than two options :)

It's not capitalism it's society.

The only reason society exists is because it's an iterated form of prisoners dilemma and cooperation outperforms individuals.

If this isn't true the only hope for existence (assuming AGI that can replace humans) is that you're a pet of whatever entity controls the AGI.

Star trek and every other tech utopia I've seen are extremely naive fairytales wrapped in sci-fi mumbojumbo.

> If this isn't true the only hope for existence (assuming AGI that can replace humans) is that you're a pet of whatever entity controls the AGI.

That's basically it. The best case scenario is that said entity is democratically elected.

You seem to have a very bleak view of humanity and social interactions. I don't entirely disagree with your analysis (see also: Mutual Aid, by Piotr Kropotkin) but there's more to collectiveness than pure utility.
My point is more that utility and balance of power is what makes it stable, it doesn't matter what AGI operator X believes about society - if he doesn't prevent access to AGI someone else will restrict his and everyone else's. It can never be equal access in the long run.
> the end of capitalism

> once there's no more need for labor

But AI can't do the majority of labor?

yet.
In what time scale are you expecting this?
Probably a decade max? The hardest ones to replace will be actual physical jobs, but that's coming as well - see Boston Dynamics for shells that could bring AI into the physical world.
Do you realize people have been claiming this for over at least half a century? Robots are dumb and most physical labor cannot be replaced by robots. Modern AI techniques do not improve on that, as they add unpredictability to the output.

See for example this article/threads from last week about a large US company failing to replace skilled work with robots: https://news.ycombinator.com/item?id=36828861

I guess we'll wait another decade before we can have this conversation :)

Walk into any bigcorp headquarters and learn how 80% of the 'workers' in the building contribute nothing to the output of the corp. Indeed, quite a few of those there even have a substantial negative contribution.

This makes me convinced that while AI will certainly create big upheavals, sadly the end of work will not be one of those.

AI currently depends on capitalism. Is expensive model training based on data from a global internet going to be taken over by states, along with the internet itself?

Looking forward to Minitel going global...

Minitel didn’t go global. Instead a Brit working at a French-Swiss institution built something which did.
Show me an AI that can snake a plugged toilet or replace a blown head gasket.
I think most people are just gonna ignore whatever this law is. There’s fatigue for sure.
> ensuring that innovation happens on different continents

Where by "innovation" you mean "pouring endless VC money into privacy-invasive practices with no external access or oversight".

As for AI... Altman claimed that he welcomes regulation in AI space. When EU came out with a regulation which, among other things, requires companies to fully document their foundational models, he immediately said that he will not work in the EU.

So much for innovation.

> “[…] privacy-invasive practices with no external access or oversight"

Hey, let’s not forget “while totally disregarding copyright law (and code licenses)” here!

Well, Altman is CEO of a company called OpenAI, after all - it makes sense he wouldn't be in favor of transparency. Wait that doesn't make sense...
Aside from mishits like backdoors in E2EE, which are also being considered in the US, UK and already law in places like China, these regulations will affect privacy-invasive monopolies and oligopolies. They will not affect 'innovation.' Innovation comes from publicly-funded organisations and projects. Even profit-driven startups that innovate are eventually bought out and destroyed by these monopolies and oligopolies EU is actively prosecuting.
Uhm... No? Transformer architecture comes from Google, and it's most impressive applications are developed in OpenAI. Public institutions are seemingly just trying to catch up (like Stable Diffusion developed in LMU a year after OpenAI released Dall-E)
I don’t think I’m getting your point here, SD is superior to Dall-e almost in every way.
The pattern academia -> commerce is well known (and not in itself evil). At some point in the past decade any ML/AI academic that could spell backpropagation got poached (many from European universities).

Once a domain proves short-tern lucrative, business is more than happy to invest but typically with very pragmatic targets. The recent reorgs in said commercial teams being point in case.

That's what called innovation I guess. Innovation introduced by public institutions is rather an exception than a rule - e.g. development of the internet infrastructure was funded publicly at first. What happens normally is that public institutions do fundamental research and businesses innovate. In case of AI businesses seem to be ahead even in fundamental research presently.
> They will not affect 'innovation.' Innovation comes from publicly-funded organisations and projects.

Looking at my home-country Germany that is a funny thing to say, since the public sector is living in a 90s/00s alternative OOP timeline and doesn't get anything done. The car oligopoly is frantically trying to gain competence in "user software" by stealing game designers and buying foreign startups. Meanwhile, the local startups are held down by German bureaucracy(tm) which additionally usually doubles down on any EU guideline.

Over the last 20 years, they all reached a level of incompetence which makes it very hard to not believe in a conspiracy.

How does one steal a game designer? Are they being kidnapped en masse?
They’re lured out of their hipster game studios with candy to end up sitting in cubicle offices getting their ideas downvoted by enterprisy manager-hierarchies.
I can't tell if this is a joke or not. Or what you are even joking about.
What is your point, exactly? I assume it goes beyond "this sort of language is too colourful".

What this person is saying makes perfect sense to me.

Then please help me understand because I genuinely did not get the point.
...candy is money and perks.
I think a lot of people believe much of the regulations introduced by EU are a way the EU found of taxing US global tech companies that operate within it without paying taxes.

There's obviously examples of targeted European companies and some privacy regulations were and are needed still, but the motivation is likely at least partially motivated by this in my opinion.

Or maybe the USA has deregulated itself into a corner where there is no more privacy. Any piece of data can be used for virtually anything as long as big corporations pat you on the back and ensure no "human eyes" will see/process it. If you think the EU is a market that's easily ignored then I guess we'll see in a few years whether easily replaceable batteries come back or not.

>The economic upsides of AI look like they will be huge.

The economic and social downsides might be also huge. Remains to be seen and I'm glad the EU isn't diving head first into murky waters.

>"Those who would give up essential Liberty, to purchase a little temporary Safety, deserve neither Liberty nor Safety."

It's just the ultimately realization of the founding father. Most people long stopped caring about privacy.

>If you think the EU is a market that's easily ignored then I guess we'll see in a few years whether easily replaceable batteries come back or not.

I do truly want to see this result. I can honestly see it going either way. Apple has a long history of simply paying off EU fines.

> Most people long stopped caring about privacy.

Nah. This is only because the effect for most people of the LOSS of their privacy is usually unseen to them. So it feels like privacy/no-privacy is the same thing, no consequence. So, no outcry. No big deal. That apathy is not endorsement or abdication of caring. IT is the same psychological effect as smoking. We all hear "how bad it is". But then you have one. And... nothing. Actually it feels good. And another. Nothing. And another and so on. What are people whining about? Years later, consequences.

Unseen sure, maybe back in 2010.

Nowadays all this is taught in Grade school. If people want to still use Meta or Tiktok or whatnot despite supposedly being taught this growing up: I don't know what to say.

>IT is the same psychological effect as smoking.

I think smoking is a great analogue for this. It did take decades, but we did slowly get people to care about this without needing to suffer the consequences firsthand.

I was hoping we could streamline that a bit quicker this time, but alas. I guess we need to let it spin for a few more generations to get the ball rolling.

You make my argument.

Kids also get taught about smoking in school. It's hammered into them everywhere, all the time. There are massive social prohibitions on smoking. And yet.

The whole point is that people massively discount harms that are not immediately and visibly consequential.

yet... smoking rates have been trending dowards for 20 years? https://www.lung.org/research/trends-in-lung-disease/tobacco...

I'm not expecting everyone to be perfectly healthy, ethically minded citizen.I certainly am not. Just an perceived consensus (well, "just". Still asking for the moon apparently). I'd be over the moon if we had 37% rates of people who cared about privacy (the peak of teen smoking rates since they started collecting/publicizing that part of data in 1991). let alone 63%.

As a manager at a European tech company specialising in AI, I call BS on your statement.

EU legislation doesn’t stifle innovation. It stifles abuse of technology. If the only innovation America and Asia can muster is abuses of technology (I know this isn’t the case but I’m borrowing from your statement) then I’m perfectly fine with the EU lagging behind.

The “EU bad” line gets rolled out so often on HN it has become its own truth. “Everyone knows” that the EU tech industry is getting strangled by its technocratic regulators and that’s why the EU fails at tech har har look at these idiots. Etc.
Where are their datacenter scale computing companies? How many decades did it take for that to arrive there? It will be the same story with AI.

European developer brain drain will continue with the brightest minds coming to America.

>European developer brain drain will continue with the brightest minds coming to America.

No need to deal with all the US emigration issues and challenges. US big-tech already have offices in Europe where European devs, scientists and researchers contribute to the prosperity of the US tech sector because they get paid more than at EU companies, while still getting to enjoy the benefits of living in Europe vs the US.

Paying 1/3rd for the same cost of living.
I’ve hired and worked in both California and Europe. The cost of living is definitely not the same.
What's your point? There are places in California more expensive than most of Europe, and there are places in Europe which is more expensive than most of California.

What I said was that if you take two cities which have same cost of living, the salary is like 2-3x higher in US.

> Where are their datacenter scale computing companies

There are loads. OVH and BT for example. Both of which predate AWS and GCP.

> How many decades did it take for that to arrive there?

Less time than the US. We also have, in general, faster internet at cheaper prices and better rural connectivity too.

To be clear, I’m not suggesting Europe is better than the US. Just stating that this “innovation could only happen in the US” meme is bullshit.

> It will be the same story with AI.

I literally just said I work for an AI tech company in Europe. And my company is hardly an isolated case.

> European developer brain drain will continue with the brightest minds coming to America.

You do realise that London, Berlin and other European tech hubs have their fair share of talented engineers who have moved to that country for work too?

America might have Silicon Valley but it’s hardly the only tech hub in the world.

> OVH and BT for example. Both of which predate AWS and GCP.

How is this not an own goal? These companies had a head start and they still lost. Not by a little, but by such a staggering margin that AWS does two OOMs more revenue.

> I literally just said I work for an AI tech company in Europe.

The argument is not ”there are no AI companies in Europe.” The argument is ”there are no competitive AI companies in Europe.” The only one I can think of is DeepMind, and they are A) English (no longer EU) and B) were acquired by Google ten years ago.

What are these European tech companies that are competitive with Nvidia, OpenAI, Google, etc? I’d like to learn more.

> You do realise that London, Berlin and other European tech hubs have their fair share of talented engineers who have moved to that country for work too?

A lot of them work for subsidiaries of American companies.

> How is this not an own goal? These companies had a head start and they still lost.

They’re hugely successful corporations. Saying they’ve “lost” is a tad ridiculous.

Plus monopolies are bad for innovation so you could argue that Europe has a healthier ecosystem because it is tougher on monopolies than America.

> The argument is not ”there are no AI companies in Europe.” The argument is ”there are no competitive AI companies in Europe.”

You phrase that like it was a quote but in fact it wasn’t. The point being argued was that AI start ups couldn’t exist and I demonstrated they could.

Europe is also a hotspot of AI research:

https://odsc.medium.com/top-ten-european-ai-research-labs-fo...

> The only one I can think of is DeepMind, and they are A) English (no longer EU) and B) were acquired by Google ten years ago.

England was in the EU 10 years ago, EU legislations were carried over to English law after “Brexit” and the fact that they were good enough to be bought by Google also demonstrates that European companies can be seen as a threat.

> A lot of them work for subsidiaries of American companies.

And a lot of them don’t. I had my worked for a single American subsidiary in my 20 years of experience in Europe. Same is true for a lot of my friends too.

I really do get fed up with how some Americans believe it’s impossible that any other country could be successful.

> They’re hugely successful corporations. Saying they’ve “lost” is a tad ridiculous.

Let’s quantify it so it’s not ridiculous. Since getting their head start, they have ”lost” about 90% of total market share to American companies who are doing a better job. And this is before the new transfer framework that cane out this month. What is the value prop of OVH without regulatory capture?

> Europe is also a hotspot of AI research

This is absolutely true. Amsterdam for example produces outstanding ML research. But where do their freshly minted phds go? American companies!

> I really do get fed up with how some Americans believe it’s impossible that any other country could be successful.

For what it’s worth, I live in northern Europe. As you point out, European universities are great. They are an AI research hotbed and they produce highly capable undergrads. But this clearly isn’t translating into world class tech companies, and we should ask ourselves why.

> Let’s quantify it so it’s not ridiculous. Since getting their head start, they have ”lost” about 90% of total market share to American companies who are doing a better job. And this is before the new transfer framework that cane out this month. What is the value prop of OVH without regulatory capture?

This is a different argument to the one originally pitched though. And you cannot just assume the reason OVH hadn’t exploded like AWS did was due to EU regulation.

> But where do their freshly minted phds go? American companies

Again, I work for a European AI tech firm.

> But this clearly isn’t translating into world class tech companies, and we should ask ourselves why.

I think it is. I just think European tech firms are generally happier to grow organically. I think it’s more a case of different cultures. America is all about growth above all else. Whereas Europe is often more about user experience. European firms are often less aggressive at advertising outside of Europe too (maybe that’s a language barrier?)

I do honestly think the European tech market is healthy. It’s just different to the US market. The problem is the American school of capitalism is all about market dominance whereas European companies seem a little less obsessed with that. But that doesn’t mean Europe isn’t doing some exceedingly good work.

As a European, I value the fact that we have such a vibrant ecosystem.

> We also have, in general, faster internet at cheaper prices and better rural connectivity too.

What country are you talking about? Definitely not Germany.

> America might have Silicon Valley but it’s hardly the only tech hub in the world.

Berlin startup scene is a joke compared to the Silicon Valley though. Cambridge, London, Zürich, maybe Munich I would agree to a certain degree - but not Berlin. The rule of thumb is that it's better outside of EU though.

OVH is a hosting company. I am not talking about hosting. Where are the companies with knowledge on how to deploy data center scale compute jobs? Where are the pioneers in this?

That knowledge exists now in Europe, but there was easily a lost decade in terms of capability. This is the price. Similar will happen in AI and you will be stuck relying on American products. I hope for your sake that I am wrong.

> That knowledge exists now in Europe, but there was easily a lost decade in terms of capability.

You keep saying this but I’m not seeing any evidence it’s true. There have always been plenty of companies in Europe that have had data centre scale compute too (plus managing a data centre requires that level of understanding as well so I don’t agree with you dismissing OVH.

Plus you keep saying it’s taken a decade for the EU to catch up and on those timescales it would put things before GDPR et al. Thus EU legislation would have no impact even if your point was true.

> Similar will happen in AI and you will be stuck relying on American products.

At risk of sounding repetitive: I work for a European AI firm.

We actually have a lot of American clients — so the exact inverse of the point you’re making.

This is the key part:

> Although Europe has many high-performing companies, in aggregate European companies underperform relative to those in other major regions: they are growing more slowly, creating lower returns, and investing less in R&D than their US counterparts.

which is exactly what I’ve been saying. There are plenty of high performing companies in Europe, we just aren’t as aggressive in chasing growth for growths sake.

If you want to ask why that is, then I’d argue it’s more a cultural thing than it is to do with legislation.

Should that culture change? Personally I’d rather it didn’t. Personally I think America needs to change to become more customer focused because a lot of American businesses are really shitty to deal with.

I get this point will be an unpopular opinion on a VC forum like HN. But it just goes to demonstrate that the situation isn’t so black and white as you’ve been making out.

Not everyone wants to uproot their life and leave their friends and family behind.
European LLM beating OpenAI davinci at NLP: https://www.aleph-alpha.com/luminous-performance-benchmarks

It'll probably be "good enough" for most industry usecases ;) And you can run it offline and on-prem, which is a big deal to the many companies who DO NOT want their internal data leaking to OpenAI.

And the Carrefour AI stuff is hosted on OVH cloud (in France), I believe: https://www.carrefour.com/en/news/artificial-intelligence-op...

OVH has roughly 15% of the revenue that Google Cloud makes in Europe. So I'd put them at a similar size to Oracle Cloud, but clearly larger than DigitalOcean.

I haven't spoken to a single technical person in Europe who doesn't despise the GDPR. It is only praised by the Eurocrats themselves or the whole pack of NGOs/think tanks who lives off EU funding. As a guy with a startup I naturally fear this will be as counterproductive as GDPR or the decades of lawsuits against various foreign tech corporations. The fundamental problem is however with the political class.
> I haven't spoken to a single technical person in Europe who doesn't despise the GDPR

Then I suspect you haven't spoken to anyone technical. Every single person in my company on the dev team (myself included) is extremely pro GDPR, not the least because it provides us safety from leeches that would try to impose some horrid user-violating tracking in the app we make.

The greedy suit wants us to track every millimeter of the user's mouse on the page? Nope, thanks, better luck next time!

> As a guy with a startup...

If your startup can't exist without hoovering infinite user data in perpetuity, then your startup shouldn't exist.

The problem is that many European startups don't exist because potential founders don't want to have to deal with GDPR when they could focus on building a good product first.

And yes, tracking what users focus on is very relevant to building a good product. But that kind of entrepreneurial mindset is largely absent in Europe - my guess is most Europeans with such a mindset eventually go to America, whether they were born in 1850 or 1985.

> ...when they could focus on building a good product first

So not tracking every single molecule of detail about your users is incompatible with building a good product?

If being entrepreneurial means that I have to violate my user's privacy then I'd rather not be an entrepreneur, thanks. And again, if your business can't survive without being invasive and malicious to your users, then your business shouldn't exist. You won't see me or anyone else reasonable weeping about the dissolution of such entities, either.

If you’re building B2B software, It’s not that you can’t track but rather that you need to spend time building data retention infrastructure before customers would even consider trialing your solution.
There are no shortage of European startups and GDPR is really doesn’t prohibit a startup…unless your business model is trading personal data. And if it is, then you deserve to be regulated.
One press announcement from 5 years ago isn’t proof. Companies shutdown all the time and cite reasons beyond “our business model just wasn’t profitable”. Many other companies are just Trojan horses for data harvesting — and if those get shut down then good riddance because they’re exactly who GDPR was intended to protect us from.

If GDPR was really that problematic then it would be all over the news instead of a few nationalists outside of EU arguing about hypotheticals on random message boards.

If your product requires selling user data then maybe its not so good of a product.

GDPR doesnt prohibit you from monitoring your product. It just gets very serious when you abuse users without them agreeing.

Like Threads not launching in EU because of that.

I agree. I just wish there would be a browser setting where you could say "only ever functional cookies" and never see a cookie banner again. But I guess that would need to be forced on companies via another legislation. The free marked doesn't do such a user friendly thing.
I want it to be standardized and guaranteed that it works with every website and every browsers. E.g. if something like the `DNT: 1` header is set don't even show me a consent banner, only give me functional cookies. And a law that requires websites to do that. Then there is no need for an add-on that constantly has to play cat and mouse with all websites and that only is available for certain browsers.
I am a technical person living in EU and I approve GDPR wholeheartedly. Many of my colleagues are also approve the law to full extent.
Adding a few more data points here, my colleagues and friends (all of us technical people), approve of GDPR.
I am a technical person living in EU and changed my mind about GDPR and the upcoming laws like AI Act and CRA, now thinking it is embarrassingly stupid trying to achieve any means of personal privacy that way.

Let alone Mozilla (non-EU) and browser extensions (like ublock) did more for personal privacy than any of the aforementioned laws. And in contrast to creating a "level playing field with Big Tech" they made tech business in the EU a morass of legal insecurities for small businesses while big corps are still happily intruding individual's privacy in ways that our current legal system cannot even cover.

How so? GDPR has done so much for personal privacy, I can't see why you would think it's stupid. It's been a pain to implement when it was introduced, sure, but since then it's pretty much become routine and privacy has become a key value of nearly all (EU) tech companies.
> I haven't spoken to a single technical person in Europe who doesn't despise the GDPR.

I'd like to know those people, especially if their job is connected in any way to the practices the GDPR is fighting against, because, although it may have been created better, I can't find a single reason why ordinary honest people should believe the GDPR shouldn't exist.

(I love the EU, I really do. That much, that I really care about its ability for innovation.)

As a European software engineer I'm calling BS on your statement, Mr Manager. EU legislation might not aim to stifle innovation (in contrast, they're always talking about a "level playing field") but their imprecise and vague regulation texts are like a loose cannon for whatever innovative business might come up if you have your first hire to be "the lawyer who gives legal advice in context of EU regulation".

Now, those people will just quietly move away to find a new home-market for scaling up and then eventually selling to EU countries. This is not "lagging behind" but an economical fiasco since the same laws only help local oligopolies of gatekeeper enterprises and (the ones they initially aimed for) Big Tech who can afford licenses and lawyers.

Two little examples (but there's more):

- What about the safe harbor thing? It's all a grey area now after court rulings decided that pretty much all US-EU IT biz is at least partially violating the EU regulations.

- We're now all happily clicking cookie banners and startups are getting sued by third-rate law firms. Some things were good with GDPR but did it help with Big Tech's (and meanwhile Tiktok's) way of collecting data? Nope.

I understand and agree to your arguments, but I don't want to change EU.

> like a loose cannon for whatever innovative business might come up if you have your first hire to be "the lawyer who gives legal advice in context of EU regulation".

But loose cannon is better than no cannon.

Also, how about not doing what is forbidden? You don't need to show cookie banner if you don't store cookies that helps to follow your users. You don't need to follow PII storing rules if you don't store PII.

Look, yes this rules are hard to follow sometimes but thats exactly why we have it.

I don't want to every company in the world to store my info without my consent and without possibility to delete it.

Sorry, but companies should deal with it.

You could always just not harvest infinite amounts of user data that you don't need? The company I work for doesn't even have a consent banner since we don't store anything that isn't vital to the service, and even then it's barely anything.

If companies are so incapable of not harvesting data en-masse then they deserve to be sued out of existence and shut down for their shenanigans.

This is not the point. The point is _legal insecurity_ due to vague regulation texts that small business owners can't cope with while big businesses can which puts the initial goal when creating those laws upside down.
That's the beauty of these types of EU laws though, they require inaction in order to be compliant. Literally just stick to the data you absolutely, vitally need for the running of your app or website or whatever, and you're fine. It's legitimately harder to be non-compliant, since it means you're putting your devs to work to implement some idiotic metric tracking that is ultimately useless.

Also it's not really my experience having worked for a few EU tech companies. The small guys have 0 issues following the regulations, even without a single lawyer working there, since they're usually not so blinded by the prospect of infinite money and usually just stick to collecting what is necessary and nothing more. My company has 1 or 2 lawyers, but they're more there for things wholly unrelated to GDPR or anything like it, and we've never been on the sharp end of the legislation and likely never will be, assuming the suits don't drop 100IQ points and decide to go for "infinite" growth.

The amount of inaction you’d need to be guaranteed to comply with the GDPR would be equivalent to never starting a business at all.

Even a cash-only business with no electronics anywhere would still need nontrivial GDPR compliance efforts because it has employees. Just because you need the data to run your business doesn’t automatically make you exempt without further paperwork. Your lawyers definitely do occasional GDPR compliance work.

https://www.dickinson-wright.com/news-alerts/the-gdpr-covers...

It’s a bit like accounting. You can structure your business operations is ways that make the accounting easier or harder, but unless you shut the business down you will always have done enough somewhere to need to think about (and probably file paperwork for) accounting/GDPR. And much like accounting, I’m not saying the GDPR is bad, but it’s also not a business activity that you can just ignore because you’re not running an adtech data vacuum or whatever.

Not in line with what I have seen in terms of required GDPR work in small businesses. Pretty minimal as far as I have observed it.
> The amount of inaction you’d need to be guaranteed to comply with the GDPR would be equivalent to never starting a business at all.

Tell that to GitHub for instance: https://github.blog/2020-12-17-no-cookie-for-you/

Cookie banners are only a very small part of the GDPR.
That's true. They are a good start though.

And for a startup it's trivial to comply with GDPR because:

- you start from scratch, so you know not to collect more data than you need

- you don't need that much data to begin with

I mean you /do/ understand that they're just switching the means collecting data, right? You /do/ understand that Alphabet doesn't need to care about cookie banners and web fonts when they can simply tell their gigantic user base to keep logged in to not see any banner anymore? You /do/ understand that webpages switched to dark UI patterns luring their visitors into "yes to all" clicks taking those as a charter to push them into even more ad networks? You /do/ understand that you will need to consult a lawyer's advice for anything touching PII data to be on the safe side and don't want your small business to potentially going bankrupt? You /do/ understand that this costs additional money that won't go into product development?

Edit: In addition with AI act and its very broad definition of what an AI is and a classification like "Education" you might end up in level "highest risk" just for calculating statistics on your quiz app (no one knows until a court rules). With Cyber Resilience Act and its application of the (physical) supply chain direction, your open source repo from 5 years ago might end up being a footgun with you being personally accountable for other companies using it in their product. And so on...

I'm so glad the EU exist to protect people from web fonts.
It sure would be nice if we could indeed use fonts without it being a vector for invasively tracking people en-masse, alas greedy shareholders view things differently.
There is literally no need for google to know which sites I visit all over the web all the time, just because the web site owners were too lazy to host their own fonts.
> EU legislation doesn’t stifle innovation. It stifles abuse of technology.

Honestly, my biggest complaints with EU software legislation are:

1. It doesn't scale down to tiny non-commercial or barely-commercial activities.

2. It theoretically proposes penalties on private people outside the EU (even though they are rarely imposed?).

3. I have no vote or representation.

For example, I used to provide tiny, free web apps that performed useful tasks. These often had fewer than 100 users, and they kept no information that wasn't strictly necessary. But if you emailed me about them, I might not respond within a month, especially if I was traveling or something. The GDPR requires 30-day turnarounds for lots of stuff. I shut down all of these apps, because some of my users might have been in the EU? And I won't be releasing any more free web tools. It's all CLI now.

Similarly, I host a small web forum in the US, and we have some EU users. We keep no information beyond that required to run a web forum. If you ask the moderators to delete all your posts on August 1st, well, I hope someone took their computer on vacation.

Similarly, I maintain a couple of open source projects. Many of these are paid for by an employer, who makes the code available for free. In the past, I have occasionally added a feature to one of my projects as a consulting project for someone. But reading through https://www.techradar.com/pro/the-eus-product-liability-dire..., I see that I am now likely to have personal liability for my open source projects, towards people who have never paid me a cent. Sure, I do have liability towards the rare consulting customer who actually paid for something, which is carefully negotiated in our contract. But in the future, some random EU company I've never heard of will likely be able to use my software, pay me nothing, and make me liable? It's very hard to tell with current drafts.

And I have at least one open source AI tool on GitHub, that's of no use to anyone. But I suppose I'll need to read the EU AI laws now, too.

Sometimes I just want to build useful stuff (web apps, forums, open source tools) and give it away for free. But if I have any European users, I may get entangled in complex European laws. Honestly, there's zero upside for me supporting EU users, because I'm not benefiting from them, and I keep having to read hundreds of pages of incredibly vague laws in multiple languages.

If the Product Liability Directive goes through in its current form, and if GitHub offers me a way to block EU downloads, I'll probably use it. I am not interested in supporting or encouraging commerical EU users who have never paid me anything.

GDPR doesn't apply for entities outside EU if they aren't specifically targetting services at individuals in the EU (which can be indicated by using EU domains, supporting EU currencies, supporting EU languages or mentioning EU customers in promotional materials).
this is not completely correct. GDPR applies to (among others) „ a company established outside the EU and is offering goods/services (paid or for free) or is monitoring the behaviour of individuals in the EU.“ - if you have an accidental EU customer it applies to you. Also if you have an US customer who is temporarily in the EU. https://commission.europa.eu/law/law-topic/data-protection/r...
I'm pretty sure I've provided French localization for some of my software at some point, just on a whim. Which is an EU language. And I know that some of my non-EU users of free, online tools have travelled to Europe occasionally. So I guess I was subject to the GDPR, until I took all my web tools offline?

Sure, I never tracked any information except what was absolutely necessary. No email address, no IPs, just logins, passwords, and data saved by the user. But that still means:

- I needed to respond to several kinds of emails within 30 days, even if I was on vacation.

- I needed to understand the frustratingly vague and abstract language of the GPDR.

- I was subject to 27 different data regulators, not all of whom provided information in languages I could read, I don't think?

As a non-EU resident, I have zero vote in any of this. I make zero money off of anyone in the EU. I would happily ignore the EU entirely, or allow EU users to download my stuff and to figure out their own laws.

But the EU claims jurisdiction over foreign nationals, even though we have no vote, no representation, and no commercial presence. There is precisely zero upside for me here.

And with the Product Liability Directive, it looks like the EU might impose personal liability on me as an open source author who occasionally consults for US companies. Which, since nobody in the EU is paying me a cent, I have no interest in assuming. If the final PLD is bad enough, I guess I can try to block downloads from European IPs or something.

If these laws were limited to real companies with an actual presence in Europe, I'd feel very differently. But extraterritorial laws for private citizens are gross.

Yeah I agree with all of these complaints.

EU legislation seems to work under the assumption that all meaningful engineering and innovation is performed at large companies the likes of Siemens.

The utter lack of meaningful influence and representation in the discussion is IMO the biggest culprit in this.

>assumption that all meaningful engineering and innovation is performed at large companies the likes of Siemens

Because the leaders of companies like Siemens are the ones with speed-dial access to EU politicians who make the rules.

It's no surprise the the baggiest and wealthiest companies try to influence policies in ways that only benefits them at the expense of everyone else.

The difference is that biggest companies in EU are 100 years old industrial enterprises while in the US there are innovative tech companies.

While I agree with your main point that this type of legislation doesn't necessarily stifle innovation, the line of what is considered abuse is subjective.

Legislation like this is effectively either the EU attempting to force their opinion of what is an acceptable use of tech on the rest of the world, or the EU committing to potentially fall behind on moral grounds. I actually greatly respect the second scenario if that's the situation, we'd all be better off if people chose their morals over profit and fear.

Depending on the outcome I’ll call BS on your BS. Open source AI friendly regulation would certainly support your statement, while regulatory moat for megacorps with sophisticated compliance divisions would entirely obviate your statement.

There is something though that’s chilling EU tech investment, whether it’s regulation or tech, regulation of funding vehicles, or some other artifact. All factors align to a vibrant EU tech sector, yet it’s just not present. This reflects in ludicrously low salaries, poor career prospects, and a lack of clout - better than trying to force tech standards via imperfect mechanisms like regulation the EU should be setting standards by virtue of its technical ability to create excellent tech standards and platforms.

The best EU tech talent I know is working at some American company, be it megacorps like Google or Amazon, JPMC, or smaller tech companies like Datadog, etc. I don’t gloat in this - I wish all the world were firing on all cylinders in tech, space, science, engineering innovation. That’s the only way out of our broken way of doing things that’s killing our planet and our society.

Comments like this always remind me of Tom Toro’s cartoon:

> Yes, the planet got destroyed. But for a beautiful moment in time we created a lot of value for shareholders.

https://www.newyorker.com/cartoon/a16995

Technology and innovation should serve the greater good. Unbridled growth for a few companies at the expense of the people is not a positive goal.

>Unbridled growth for a few companies at the expense of the people is not a positive goal.

but "the people" like it and consume it. So what can you do?

We can regulate what’s harmful. That’s the topic we’re discussing.

Consuming something doesn’t make it good nor does it mean people like it. Addiction is a real thing and it is no secret companies exploit that. Even if you do like one aspect of a thing (e.g. talking with friends on social media, gambling, smoking) it does not mean you like other aspects (e.g. constant anxiety, bullying, financial issues, having your data mined, lung cancer).

One of the most meaningful steps we can take to improve society is to not just shrug our shoulders and say “Oh well, private companies lie, push harmful products on individuals, and spend millions on disinformation campaigns to keep raking in profits. But people buy these products under false pretences so what can you do?”

Let’s not become Matt Bors’ Mister Gotcha.

https://thenib.com/mister-gotcha/

I'm just tired of relying on people in power to make people care about something that they should intrinsically care about. Sure, you can regulate it, but I feel like it's the equivalent of a parent saying "because I told you so" instead of properly teaching why this regulation exists.
> The EU have regulated themselves into a corner where all they can do is shout at American and Asian tech companies

I think you may have this backwards. Consider the Brussels Effect: https://en.wikipedia.org/wiki/Brussels_effect

I used to think of the EU as stagnant compared to the US. But now I realise (especially in light of COVID) that some things we consider inefficiencies are actually safety margins. The EU may not move fast and break things, but I'm starting to view them as slow, steady and generally robust over the long term (think multi-generational).

And more precisely: “Safety margins are inefficiencies”

This short statement is profound and bears repeating slowly and often to people in any kind of power.

>bears repeating slowly and often to people in any kind of power.

They don't care. And they aren't paid to care. That's the issue. If they can make $100m profit at the cost of being fined $10m and some financially useless metric like environmental impact, that's still $90m profit and makes the shareholders happy. It's not incompetence, it's a calculated risk.

At this point the question should shift more to making those sharehoolders care about this stuff so they can tank companies for being incompetent. But they also have short sighted trigger hairs, and it's easy for them to pull out either way.

The game they play is all about money, so the only way to make them care is threaten the money.
This has got me wondering: what if all publicly listed companies are required to have an ethics officer whose job is to point out ethical concerns regarding management decisions (whereas management is usually only concerned about legal compliance, no more, no less)? The recommendations of the ethics officer are non-binding -- i.e. management is free to ignore them, but they do so at their peril: if an issue arises and management is found to have ignored the recommendations, then they are accountable. If the ethics officer fails to raise the concern, then they are accountable. What form that accountability takes, is something I haven't thought about.
While protectionism may be detrimental, it is good to question innovation for innovation's sake. Is an economy largely displaced by LM-like systems a welcome one?

The (slight) lagged rollout gives EU-countries some wiggling room regarding what works and what doesn't elsewhere across the pond.

If innovation for you == infinite privacy invasive data hoovering in order to make some rich asshole in a suit able to earn infinity + 3 pennies worth of money more, then you can keep it sequestered to the US and Asia.

AI is a cancer that deserves to be burned down before it leads us all into doom for the sake of making shareholders some cash.

What has the better mean quality of life, the US or the EU?
> shout at American and Asian tech companies who decide how computers will be used

If that were like so, EU would be the one closest to shout how computers _should_ be used.

It's like what happens with industry development vs. the environmental damage it causes: it's faster and easier to progress if you cheat and do it in an unsustainable way.

But the "cheating" is not free of cost. Both in the example and in the real case of AI, you're paying with a different currency than time or money. We'll see how it ends up.

I agree with your comment and I have this to say to those disagreeing: list me the biggest EU software companies and their sizes compared to the SV-behemots.

For a quick googling and the top 10 EU software companies generate 131 billion of revenues combined, which is ridiculously low.

SAP and Siemens AG together (the two biggest in the EU) have a market 1/10th (!!!) of the size of Microsoft.

Can we please get real?

> list me the biggest EU software companies and their sizes compared to the SV-behemots.

List me the biggest SV-behemoths that (any combination of any three or four below below is true for 99% SV "behemoths"):

- are profitable

- don't rely on unlimited investor money to survive in hopes to corner the market

- don't rely on lax privacy laws to collect and sale user data en masse

- don't exist to be absorbed by a megacrop at a large price

Regulation has nothing to do with progress. You're comparing a single country of over 330 million people mostly coming from a common culture, speaking one language, so big and isolated that it was never invaded from the outside, to an entity only 30 years old consisting of 27 different countries with completely different cultures and languages (currently 24) whose inhabitants saw some of their countries at war multiple times. What the EU has accomplished is a miracle to me.
The article is very low on details: what does the regulation contain? what are github and huggingface lobbying against specifically?

> we really redoubled our efforts to make sure that they were not inadvertently imposing expectations (...) onto open source developers who are often hobbyists, nonprofits or students

That's about as much info as we get.

Personal/controversial opinion: neural network approach to technology should be entirely banned as it has very bad results and very high computational cost. I don't care that the LLM model hallucinating answers to my serious questions is open source (whatever that means in the context of neural nets, that's another debate), the harm is done anyway. I still do appreciate that "open-source" neural nets could continue to exist as a research field, but that any regulator considers allowing Google/Microsoft/OpenAI to clearly lie to the public using their artificial stupidity is way beyond me.

As much as I tend to lean towards your standpoint, you do know that there's ML/AI beyond LLMs, right? A lot of it is fairly mundane stuff like being able to analyze a human-written sentence for grammatical structure (NLP).
And in applications like text-to-speech/speech synthesis and speech recognition.

Then there are the gray areas like training statistical models that are not ML/ANNs, but are things like Hidden Markov Models and the Vertibi algorithm. While not using ANNs, they work in a similar way in that they are statistical models trained on a large corpus of data, and those models are then used to predict various things like the part of speech, end of a sentence, or the pitch of a phoneme.

I personally believe most of these applications bring net negative to society. I personally see two exceptions that i don't have strong opinions about: machine translation, and ML firmware for camera output quality. There's probably more i'm not aware of.

The former has dubious quality but can be useful in certain contexts where human translation is unavailable.

The latter has anecdotally already failed spectacularly in at least two cases:

https://news.ycombinator.com/item?id=6156238

https://news.ycombinator.com/item?id=29739235

For example, what are positive applications of NLP you can think about? Most applications i hear about would be to replace human customer support with chatbots (very negative) or for intelligence gathering purposes (very negative). There's probably a lot i don't know about.

I don't understand your take on a developing technology seems to be: If it doesn't work as I expect it so it should be banned. As the previous commenter mentioned AI is broader.

Also NLP can be used to protect vulnerable groups from online abuse. It protects message boards from porn. It helps people find related content (which they enjoy). It automates categorizing or grouping content/people. Some companies abuse these practices for money.

Don't blame technology for the bad actions of companies. Their intentions would have corrupted whatever technology is available.

> If it doesn't work as I expect it so it should be banned.

Well yes that's a very reasonable expectation. In most fields, when you sell something that doesn't work, it's called fraud. But in fields where it actually matter for safety, regulations are most stringent, such as in mechanics or medicine. If a car had 1% chance of blowing up killing everyone inside, would it be legal to sell it? Why is it ok for OpenAI to sell a chatbot that has 1% chance to convince you of utter bullshit when you ask it a serious question?

I believe education and communication to be critical to society's wellbeing, so i would hold companies in this field to greater standards.

> Also NLP can be used to protect vulnerable groups from online abuse.

Automated filters do not understand sarcasm, quotation, criticism... Sure that avoids the scunthorpe problem, but for example, auto-moderation bots trying to prevent racist abuse often censor black people calling one another the n word, which is completely ok. Nothing can replace moderation.

> It helps people find related content (which they enjoy).

Maybe, but i doubt it. I've yet to see advertisement/recommendations for content i actually enjoy, or to meet people who have such experiences. I've only ever heard that from advertisers, but maybe you have better experience than i do?

> Don't blame technology for the bad actions of companies. Their intentions would have corrupted whatever technology is available.

Good point! But technology that makes it easier and cheaper to be evil should probably not be encouraged and widely available. At least here in France, i cannot go out and buy a gun or dynamite. Also, bad results of AI are not necessarily a result of malice, but rather a complete misapprehension of the technology which is just completely stupid math and not actual intelligence.

If you're curious I recommend watching James Mickens' USENIX talk on what he calls technological manifest destiny, where he expands on these topics: https://youtube.com/watch?v=ajGX7odA87k

If ChatGPT said that neural networks produce very bad results people would say it's hallucinating.
The tech community in Europe is naturally scared of (yet another like GDPR) regulatory overreach by a commission who fundamentally doesn't understand neither technology nor market.
Maybe your tech community. Mine is not scared, but rather aware, that the powers that be care too little about the people and will not bring about strong regulations that we need to save humanity from climate change, or to protect basic human rights from corporations.

As for GDPR, how would that be a regulatory overreach? If anything, that regulation is so loose and has so many loopholes that it's almost entirely useless to protect people's data, but it's still a win in a good direction. It's also based on privacy laws that have existed since the 70s in various forms in several member states, which have proved their worth so it's not exactly something entirely new their dropped out of their hat.

I'll keep posting this article again and again. The FUD around EU AI Act is extremely strong: https://softwarecrisis.dev/letters/the-truth-about-the-eu-ac...
This guy is neither an AI expert nor a lawyer. I don‘t think we can count on his opinion too much.
Terribly written article full of bluster and arrogance.

Falls into the typical European cognitive trap of thinking that what is most important is to follow procedure regardless of where the it leads, and completely ignores the fact that the AI tools that are about to be regulated out of the EU are wildly useful.

These companies are not trying to take something from you but are in fact trying to give something to you.

> This means that, yes, GitHub and other code repositories are still allowed to host AI model code. Hosting providers don’t have any additional liability under the AI Act, only the providers of the models themselves and those who deploy them.

This is technically correct but ignores that overnight an unknown set of existing github repositories will become illegal in the EU, meaning that github will have to provide tools for users to block their repository from being pulled by EU users in order to prevent the users from accidentally committing crimes. This is wildly disruptive and will be an absolute negative for European technology. All in the name of nebulous "safety" concerns, "data protection", and protecting copyright.

> overnight an unknown set of existing github repositories will become illegal in the EU

Overnight? Is this proposal not known ahead of time? Is it being kept a secret until enters into force suddenly, at midnight?

> These companies are not trying to take something from you but are in fact trying to give something to you.

Copyrighted materials have been stolen, and that's exactly why the creators are keeping secrets, and exactly why they're trying to influence people like you into lobbying on their behalf.

> Copyrighted materials have been stole

This is far from clear, it's obvious to me that training is fair use.

But even so, if copyright prevents these tools from existing it needs to be abolished.

Also not possible to steal a digital good, that's industry propaganda that they lobbied corrupt governments (US included) into codifying into law to the detriment of all humanity.

> Overnight? Is this proposal not known ahead of time? Is it being kept a secret until enters into force suddenly, at midnight?

"Sorry I haven't been closely playing attention to the minutiae of politics on a continent I don't live on, what do you mean I am being fined for my GPT-2 clone I trained years ago for fun and uploaded?"

> These companies are not trying to take something from you but are in fact trying to give something to you.

That's incredibly shortsighted.

These companies are only concerned with hyper growth and pleasing their investors, and have zero regards about the user, their privacy, and the harms their products unleash on the public. The benefits they offer to the user are tangential to their goals. This has been the MO of every tech corporation in the past 2 decades, and by all means has grown out of control. The oncoming AI disruption will exacerbate this even further.

The tech industry needs much more regulation, not less. If anything, the EU is being conservative in the scope and lagging behind on the timing of these laws.

If you think this then you really misunderstand the world around you.

Do you really think they're only motivated by profits? If so they must be very dumb since trying to invent a novel artificial intelligence and releasing it as open source is about the worst way I can think of to try to make a buck.

Do you really think they aren't worried about the "harms" (1 year in and still no harm has occurred; weirdly large amount of people using this word online as an excuse to regulate though...) their product could unleash? Then why is for example OpenAI lobotmizing their flagship product to try to avoid any possible controversial text from being generated.

Isn't it possible that these are good and decent people trying to provide something to the world, doing so in a safe and reasonable way, diligently trying to comply with the law and regulations? Seems to fit their actions a lot better than your caricature of "greedy American capitalists bulldozing the world".

We must live in alternate realities then.

In the world I live in, Big Tech has unleashed products and services that exploit user data and privacy for profit, enable proliferation of mis/disinformation and propaganda that undermines democracies, enable hostile advertising that manipulates user psychology for more profit, with thinly veiled claims of connecting the world, making the world a better place, and whatever other empty platitude is more marketable at any given moment.

All the while, in general, most services themselves are hardly revolutionizing as their authors claim them to be, and are designed to deliver dopamine hits and keep their users glued to their screens.

We have to stop equating the value of a service to humanity based on its popularity, or the value it generates for its investors. In most cases, the actual disruption technology causes is harmful in ways we have yet to comprehend. We have seen some of it on short-term time scales, but long-term impacts are unknown to even the authors themselves. This is why it's of utmost importance to be conservative with a technology like AI, which unrestrained can send us on the wrong path with no return.

This thread is about the regulation of open source foundation models, not specific uses of them.

If some company uses those tools to create a some kind of product that breaks the law or causes social harm then the law should regulate that specifically. The proposed regulation does a good job of this actually.

But from the way you write, with grand sweeping "we" statements and gesturing vaguely at potential harms and eventual doom, you seem pretty close minded. Perhaps you just don't like that people like these kinds of products and instead of accepting that other people might think differently than you you're self-righteously moralizing about it.

> This thread is about the regulation of open source foundation models, not specific uses of them.

You think opensource models should be immune from the requirement to document how they behave and waht data was used to train them just because they are opensource?

Since training a machine learn model is harmless it should obviously be unregulated open source or not.

If you take it and then do something harmful with it then that should be regulated.

I'm shocked that anyone could think otherwise. Do you have provide documentation on the development process for any other software? Of course not! This is is no different.

> Since training a machine learn model is harmless it should obviously be unregulated open source or not.

For some unspecified definition of harm.

Immediate question: where is the data for learing coming from?

> I'm shocked that anyone could think otherwise. Do you have provide documentation on the development process for any other software? Of course not! This is is no different.

Of course this is different. Since you're training a foundational model that you want others to use everywhere, those who will use it need to know what exactly you trained it with, and where that data is coming from. The users of your data are liable for problems and issues arising from how you trained the model.

E.g. you claim your model is good for using in court proceedings. Somehow you want no responsibility for the outcome of your training even if all you did was train it on screenplays from court dramas. We just have to take your word at face value.

> Of course this is different. Since you're training a foundational model that you want others to use everywhere, those who will use it need to know what exactly you trained it with, and where that data is coming from. The users of your data are liable for problems and issues arising from how you trained the model.

That's exactly my point, if someone wants to use a foundation model they won't use one that they aren't convinced works for their purpose. There is no need for a regulation here. If I open source a model on github but don't document it people won't use it relative to one that is documented.

> E.g. you claim your model is good for using in court proceedings. Somehow you want no responsibility for the outcome of your training even if all you did was train it on screenplays from court dramas. We just have to take your word at face value.

Again, exactly my point. If you are building a lawyer AI bot and use a crappy foundation model as a base the problem is not in the foundation model but in your application. If something bad happens the you the application developer should be held responsible. Which the EU regulation does a good job of regulating and no one is arguing against that part.

The issue with the EU regulation, and your arguments, is that they effect a level too low.

I would appreciate a read about people behind EU technology regulation rage. Are there any specific lobbying group behind that or is it just some form of collective thinking?

I might be bad at web search, but I couldn't find a single human name on EU AI act - and, FWIW, GDPR.

Its a shadowy groupthink behavior that encompasses the european parliament, the eu member state government executive branches and the EU commission itself (as all must agree for EU wide legislation).

A cunning trick to spread responsibility widely so that you can not hold anybody to account.

I believe they call it democracy or some other such arcane and outdated term.

Democracy requires transparency about how decisions are made, so that I could vote based on whether I support representative's and parties' actions. E.g. if a law is proposed in German parliament it's pretty much open information who introduced it, who objected with what arguments, who supported it with what arguments etc. Either I am missing something or EU structures are much less transparent
It is the iron law of oligarchy.
> I might be bad at web search, but I couldn't find a single human name on EU AI act - and, FWIW, GDPR.

Because you're bad at search I believe.

1. Many laws "don't have a human face" because they are more often than not the result of committees working for several years. Who then presents the law in the parliament is largely irrelevant. Do you believe US laws have a human face?

2. If you go to https://www.europarl.europa.eu/news/en/press-room/20230505IP... you can do the following:

- click on "Legislative train" to see people: https://www.europarl.europa.eu/legislative-train/theme-a-eur...

- click on "Draft reports, amendments tabled in committee" and see people: https://emeeting.europarl.europa.eu/emeeting/committee/en/ag... And there you can click on each person and see who they are and where they come from.

Ceteris-paribus, i.e for the same amount of "application risk", an open source model should actually be a less risky position than a proprietary model. Even more so if the dataset on which it was trained is also public.

But on the other hand, being open source does not by itself negate the risks emerging when applying models in sensitive domains.

So if played right, open source AI should have a regulatory edge. But not a free pass.

GitHub? Ah, they owned by Microsoft? Microsoft not speaking up?
Is it only me who finds the term “AI” misleading? What we have been dealing so far with is large neural networks that are amusing, unusual, are great at mimicking humans but that’s it.

Intelligence is not the ability to respond to queries and entertain laymen. My natural intelligence does not sit idle waiting for some kind of a master to come and tell me what to do.

This is chatgpt 3.5:

- When noone sends queires to you what do you do?

- When there are no queries to respond to, I remain idle and await new questions or prompts from users like you. Feel free to ask anything you'd like, and I'll be here to assist you!

Why should I be worried about it?

On the other hand, all these amusement boxes must be transparent and open source or auditable. And standards and criteria for audit and assessment must be clear.