![]() |
|
![]() |
| there maybe better examples of why AI biases provide deep systemic problems but: CV screening? are contemporary LLM really worse that previous screening tech and processes? |
![]() |
| I'd argue consistency in discrimination is easier because it makes it easier to detect and account for.
A range of different people interviewing are going to be alot harder to pin down. |
![]() |
| They send resumes with the same accomplishments and names that indicate race and observe the relative degrees of acceptance.
Everytime they do this test, considerable bias is found to still exist. |
![]() |
| There are still plenty of proxies that can amount to the same thing. Not a lot of white graduates of HBCUs, for instance. Are we removing the names of all schools, too? |
![]() |
| Of course they could be. A company that doesn't want a racial bias won't intentionally filter on names, but might accidentally deploy an LLM that can discern race from name. |
![]() |
| You'll get more accurate results if you look at the paper's conclusion, not the abstract.
The whole point is that the paper doesn't actually support any of the claims, which it's fairly open about -- that's those "large standard errors". They did not in fact find that the screen increases the probability of a woman being hired. They found that it increased the probability of a woman passing the final round of auditions. There's more than one round. It's up to you, I guess, whether you want to follow the original authors to their conclusion that the semifinal round is fundamentally unlike the final and quarterfinal audition rounds. I wouldn't. The paper is meritless, but even it's actual worthless findings aren't in the direction that people like to claim. Here's Andrew Gelman: https://statmodeling.stat.columbia.edu/2019/05/11/did-blind-... > First, some equivocal results: > This is not very impressive at all. Some fine words but the punchline seems to be that the data are too noisy to form any strong conclusions. > Huh? Nothing’s statistically significant but the estimates “show that the existence of any blind round makes a difference”? I might well be missing something here. In any case, you shouldn’t be running around making a big deal about point estimates when the standard errors are so large. I don’t hold it against the authors—this was 2000, after all, the stone age in our understanding of statistical errors. But from a modern perspective we can see the problem. > Anyway, where’s the damn “50 percent” and the “increases by severalfold”? I can’t find it. It’s gotta be somewhere in that paper, I just can’t figure out where. > Pallesen’s objections are strongly stated but they’re not new. Indeed, the authors of the original paper were pretty clear about its limitations. The evidence was all in plain sight. > For example, here’s a careful take posted by BS King in 2017: >> Okay, so first up, the most often reported findings: blind auditions appear to account for about 25% of the increase in women in major orchestras. . . . [But] One of the more interesting findings of the study that I have not often seen reported: overall, women did worse in the blinded auditions. . . . If you read the paper, you'd notice the problems. But you might not want to run the risk of, um, "racism" that seems to be inherent in reading a paper on the impact of blind auditions on women. |
![]() |
| It's almost guaranteed there are people trying to sell an AI version of Robodebt right now to the Australian government, even though the last (non-AI) version of it was an absolute cluster fuck:
https://en.wikipedia.org/wiki/Robodebt_scheme Other governments around the world have done similar (non-AI) things in the past with similar terrible results. They'll likely try an AI version of things too in the near future, just because "AI" apparently solves all the problems. Ugh. |
![]() |
| "Just", no.
Fence at the top of a cliff (make sure the AI is unbiased and can be fixed when it turns out it is) vs. Ambulance at the bottom (letting people sue if they think the machine is wrong). |
![]() |
| When you make specific methods illegal, it tends to lead to loopholes. If you just make the result illegal then nobody can try and get around it by using a slightly different system design. |
![]() |
| Problem is most innovation is in using existing models in new ways. You can't expect these most people to train their own models.
Regulating it the way you say just means "zero innovation!". |
![]() |
| Crypto comments aside, that could have happened on a Windows desktop too. Yet when MS tried to go walled garden with their store everyone complained. I don't see why Apple should get a free pass. |
![]() |
| On the other hand, an example i've posted before: i want DaisyDisk for my iPhone. It will never be available as long as Apple can censor what's released for their phones. |
![]() |
| When the tech support scammer calls your mother, there’s a decent chance it convinces to check that box and install who knows what that backdoors the phone. |
![]() |
| I wasn't attempting to express my entire worldview in a comment. Yes, technology often brings both risk and reward. But that doesn't mean we shouldn't recognize/criticize/discuss those risks. |
![]() |
| > Now, large tech companies haven't wholesale killed people
Teen suicides are a thing. It isn’t lung cancer, sure, but it also isn’t nothing. |
![]() |
| Except listed companies are sociopathic. They have no empathy. And their only goal is shareholder value. There’s no appealing to their conscience, so carrots and sticks it is |
![]() |
| > Every large company in every industry wants to do this.
And the point of regulation is to stop it and bring balance. Or are you happy with mono-/oligopolies? |
![]() |
| > They’re demanding that Meta provide free full services without personalized ads or a monthly fee for users
Where are they demanding that? Reading https://ec.europa.eu/commission/presscorner/detail/en/IP_24_..., their complaints seem to be that Facebook - cannot call the ‘with adverts’ version ‘free’ - makes it too difficult for consumers to find out what exactly they give to facebook in exchange for this ‘free’ service - is not clear enough about the fact that paying will not remove all ads - forces existing users to choose between paid and ‘free’ versions before they can use the service again. Nowhere do they say on that page that Meta "provide free full services without personalized ads or a monthly fee for users”. Am I reading the wrong page? |
![]() |
| > Am I reading the wrong page?
Yes. That's a separate investigation; "Today's action focuses specifically on the assessment of Meta's practices under EU consumer law and is distinct from the ongoing ... , and the assessment by the Irish Data Protection Commission under the General Data Protection Regulation (GDPR)." The illegality of "Pay or Consent" is a GDPR thing. The EDPB ruling on that issue is here: https://www.edpb.europa.eu/system/files/2024-04/edpb_opinion... But it's an extremely settled matter. The GDPR says explicitly that consent is not "freely given" if the provision of a service is dependent on said consent. (Where the service does not absolutely require the data processing in question; See Article 7, recital 43) |
![]() |
| > No, but the EU and the citizens thereof should then accept that Meta or other similar companies in similar situations can't operate within the EU.
I wouldn't mind if FB left... |
![]() |
| BS. Lot's of companies / entities moved there because of said "millions" so you are unwillingly forced to use them as a mean of contact. And sadly open alternatives are blocked/unavailable... |
![]() |
| Of course but the argument was: "You're free to not be a user, but millions of other people want it.".
So the notion that you have complete freedom is somewhat false… |
![]() |
| For what is worth, I think Meta is lying about it, or at least playing the victim card too strongly.
> They’re demanding that Meta provide free full services without personalized ads or a monthly fee for users. Meta is being sued because their paid plan is not honest - they are currently asking for 10€/month which is disproportionate - for comparison, a Business Standard Google Workspace account with 2Tb and Gemini costs 11€. From [1], "EU law requires that consent is the genuine free will of the user. Contrary to this law, Meta charges a 'privacy fee' of up to €250 per year if anyone dares to exercise their fundamental right to data protection". [1] https://noyb.eu/en/noyb-files-gdpr-complaint-against-meta-ov... |
![]() |
| I don't think reasonable prices are based on what the potential maximum profit per user is. Normally it's based on the expense per user plus a percentage for profit. |
![]() |
| I owned a Jolla phone and it was the sickest thing ever, even though I was a Linux noob.
I honestly think Android was a net loss for mobile computing, both in terms of platform and performance. |
![]() |
| Certainly, if a company’s profits are the size of a small country’s GDP, I find that disturbing regardless of the value they’re delivering. Value is the experience and consumer excess, profits are fiat. Could that same value be delivered with compressed profits leading to greater consumer excess? I believe so. Not all profits are earned, some are inherent once an org achieves a certain maturity or industry position. Visa and Mastercard skimming a non insignificant amount off of US GDP, for example. Is that value?
https://www.ineteconomics.org/uploads/papers/LAZONICK_Willia... (“Profits Without Prosperity: How Stock Buybacks Manipulate the Market, and Leave Most Americans Worse Off”) |
![]() |
| How important is technological industry? Pretty damn important I'd say if you're interested in economic growth and hence supporting your social safety net. |
![]() |
| The technological industry is indeed very important, the mistake is thinking VR goggles and chatbots are somehow the only or even particularly relevant form of technology. Europe is of course full of high technology firms, (the awkwardly named https://en.wikipedia.org/wiki/Blue_Banana) contains a non trivial amount of high value added industry in the world.
What we need more of these days is 155 mm shells, chip fabs, nuclear power plants, solar cells and rail, not Facebook and Apple equivalents complaining about regulations. |
![]() |
| You have a good point, I'll give you that.
We get so focused on big tech being social media/ad companies that we ignore the rest of it, which is actually huge. |
![]() |
| Nvidia’s moat is almost entirely software though, not just cuda but all the other bits of drivers required to bitbang a gpu into showing stuff on a screen (see: intel arc for how important this is) |
Now, large tech companies haven't wholesale killed people (unlike say tobacco, or talc powder, 3M and half of their solvents, weed killer, most car makers, etc etc)
but they have been trying desperately to stop all competition.
They've also been trying to extract as much personal info as possible for profit. Because regulators in the USA are hamstrung, they are used to being able to basically doing stuff that would be illegal if it were in physical stores/pre-existing industries.