I write about technology at theluddite.org

  • 10 Posts
  • 294 Comments
Joined 1 year ago
cake
Cake day: June 7th, 2023

help-circle

  • Totally agreed. I didn’t mean to say that it’s a failure if it doesn’t properly encapsulate all complexity, but that the inability to do so has implications for design. In this specific case (as in many cases), the error they’re making is that they don’t realize the root of the problem that they’re trying to solve lies in that tension.

    The platform and environment are something you can shape even without an established or physical community.

    Again, couldn’t agree more! The platform is actually extremely powerful and can easily change behavior in undesirable ways for users, which is actually the core thesis of that longer write up that I linked. That’s a big part of where ghosting comes from in the first place. My concern is that thinking you can just bolt a new thing onto the existing model is to repeat the original error.


  • This app fundamentally misunderstands the problem. Your friend sets you up on a date. Are you going to treat that person horribly. Of course not. Why? First and foremost, because you’re not a dick. Your date is a human being who, like you, is worthy and deserving of basic respect and decency. Second, because your mutual friendship holds you accountable. Relationships in communities have an overlapping structure that mutually impact each other. Accountability is an emergent property of that structure, not something that can be implemented by an app. When you meet people via an app, you strip both the humanity and the community, and with it goes the individual and community accountability.

    I’ve written about this tension before: As we use computers more and more to mediate human relationships, we’ll increasingly find that being human and doing human things is actually too complicated to be legible to computers, which need everything spelled out in mathematically precise detail. Human relationships, like dating, are particularly complicated, so to make them legible to computers, you necessarily lose some of the humanity.

    Companies that try to whack-a-mole patch the problems with that will find that their patches are going to suffer from the same problem: Their accountability structure is a flat shallow version of genuine human accountability, and will itself result in pathological behavior. The problem is recursive.


  • That would be a really fun project! It almost reads like the setup for a homework problem for a class on chaos and nonlinear dynamics. I bet that as the model increasingly takes into account other people’s (supposed?) preferences, you get qualitative breaks in behavior.

    Stuff like this is why I come back to postmodernists like Baudrillard and Debord time and time again. These kinds of second- (or Nth-) order “news” are an artifact of the media’s constant and ever-accelerating commodification of reality. They just pile on more and more and more until we struggle to find reality through the sheer weight of its representations.


  • Really liked this articulation that someone shared with me recently:

    here’s something you need to know about polls and the media: we pay for polls so we can can write stories about polls. We’re paying for a drumbeat to dance to. This isn’t to say polls are unscientific, or false, or misleading: they’re generally accurate, even if the content written around marginal noise tends to misrepresent them. It’s to remind you that when you’re reading about polls, you’re watching us hula hoop the ourobouros. Keep an eye out for poll guys boasting about their influence as much as their accuracy. That’s when you’ll know the rot has reached the root, not that there’s anything you can do about it.


  • Journalists actually have very weird and, I would argue, self-serving standards about linking. Let me copy paste from an email that I got from a journalist when I emailed them about relying on my work but not actually citing it:

    I didn’t link directly to your article because I wasn’t able to back up some of the claims made independently, which is pretty standard journalistic practice

    In my opinion, this is a clever way to legitimize passing off research as your own, which is definitely what they did, up to and including repeating some very minor errors that I made.

    I feel similarly about journalistic ethics for not paying sources. That’s a great way to make sure that all your sources are think tank funded people who are paid to have opinions that align with their funding, which is exactly what happens. I understand that paying people would introduce challenges, but that’s a normal challenge that the rest of us have to deal with every fucking time we hire someone. Journalists love to act like people coming forth claiming that they can do X or tell them about Y is some unique problem that they face, when in reality it’s just what every single hiring process exists to sort out.


  • Not directly to your question, but I dislike this NPR article very much.

    Mwandjalulu dreamed of becoming a carpenter or electrician as a child. And now he’s fulfilling that dream. But that also makes him an exception to the rule. While Gen Z — often described as people born between 1997 and 2012 — is on track to become the most educated generation, fewer young folks are opting for traditionally hands-on jobs in the skilled trade and technical industries.

    The entire article contains a buried classist assumption. Carpenters have just as much a reason to study theater, literature, or philosophy as, say, project managers at tech companies (those three examples are from PMs that I’ve worked with). Being educated and a carpenter are only in tension because of decisions that we’ve made, because having read Plato has as much in common with being a carpenter as it does with being a PM. Conversely, it would be fucking lit if our society had the most educated plumbers and carpenters in the world.

    NPR here is treating school as job training, which is, in my opinion, the root problem. Job training is definitely a part of school, but school and society writ large have a much deeper relationship: An educated public is necessary for a functioning democracy. 1 in 5 Americans is illiterate. If we want a functioning democracy, then we need to invest in everyone’s education for its own sake, rather than treat it as a distinguishing feature between lower classes and upper ones, and we need to treat blue collar workers as people who also might wish to be intellectually fulfilled, rather than as a monolithic class of people who have some innate desire to work with their hands and avoid book learning (though those kinds of people need also be welcomed).

    Occupations such as auto technician with aging workforces have the U.S. Chamber of Commerce warning of a “massive” shortage of skilled workers in 2023.

    This is your regular reminder that the Chamber of Commerce is a private entity that represents capital. Everything that they say should be taken with a grain of salt. There’s a massive shortage of skilled workers for the rates that businesses are willing to pay, which has been stagnant for decades as corporate profits have gone up. If you open literally any business and offer candidates enough money, you’ll have a line out the door to apply.


  • This is a frustrating piece. Anyone with even a passing knowledge of history knows that you can’t just report on what fascist movements say then fact check it (which is what WaPo is doing here). JD Vance doesn’t give a single shit about workers, and the facts don’t matter. It’s about aesthetics. The American fascist movement, like all such movements, is interested in appropriating the very real grievances of workers into a spectacle that serves power rather than challenges it. Walter Benjamin calls this the aestheticization of politics.

    Fascism attempts to organize the newly proletarianized masses without affecting the property structure which the masses strive to eliminate. Fascism sees its salvation in giving these masses not their right, but instead a chance to express themselves. The masses have a right to change property relations; Fascism seeks to give them an expression while preserving property. The logical result of Fascism is the introduction of aesthetics into political life.


  • This article is a mess. Brief summary of the argument:

    • AI relies on our collective data, therefore it should be collectively owned.
    • AI is going to transform our lives
    • AI has meant a lot of things over the years. Today it mostly means LLMs.
    • The problems with AI are actually problems with capitalism
    • Socialist AI could be democratically accountable, compensate people from whom they use data, etc.
    • Socialists have always held that technology should be liberatory, and we should view AI the same way
    • Some ideas for how to govern AI

    I think that this argument is sloppily made, but I’m going to read it generously for the purposes of this comment and focus on my single biggest disagreement: It misunderstands why LLMs are such a big deal under capitalism, because it misunderstands the interplay between technology and power. There is no such thing as a technological revolution. Revolutions happen within human institutions, and technologies change what is possible in the ongoing and continuous renegotiation of power within them. LLMs appear useful because we live under capitalism, and we think about technology within a capitalist framework. Their primary use case is to allow capitalists to exert more power over labor.

    The author compares LLMs to machines in a factory, but machines produce things, and LLMs produce language. Most jobs involve producing language as a necessary byproduct of human collaboration. As a result, LLMs allow capitalists to discipline labor because they can “do” some enormous percentage of most jobs, if you think about human collaboration in the same way that you think about factories. The problem is that human language is not a modular widget that you can make with a machine. You can’t automate away the communication within human collaboration.

    So, I think that author makes a dangerous category error when they compare LLMs to factory machines. That is how capitalists want us to think of LLMs because it allows them to wield them as a threat to push wages down. That is their primary use case. Once you remove the capitalist/labor power dynamic, then LLMs lose much of their appeal and become just another example of for profit companies mining public goods for private profit. They’re not a particularly special case, so I don’t think that it requires the special treatment in the way that the author lays out, but I agree that companies shouldn’t be allowed to do that.

    I have a lot of other problems with this article, which can be found in my previous writing, if that interests you:


  • Investment giant Goldman Sachs published a research paper

    Goldman Sachs researchers also say that

    It’s not a research paper; it’s a report. They’re not researchers; they’re analysts at a bank. This may seem like a nit-pick, but journalists need to (re-)learn to carefully distinguish between the thing that scientists do and corporate R&D, even though we sometimes use the word “research” for both. The AI hype in particular has been absolutely terrible for this. Companies have learned that putting out AI “research” that’s just them poking at their own product but dressed up in a science-lookin’ paper leads to an avalanche of free press from lazy credulous morons gorging themselves on the hype. I’ve written about this problem a lot. For example, in this post, which is about how Google wrote a so-called paper about how their LLM does compared to doctors, only for the press to uncritically repeat (and embellish on) the results all over the internet. Had anyone in the press actually fucking bothered to read the paper critically, they would’ve noticed that it’s actually junk science.




  • I know that this kind of actually critical perspective isn’t point of this article, but software always reflects the ideology of the power structure in which it was built. I actually covered something very similar in my most recent post, where I applied Philip Agre’s analysis of the so-called Internet Revolution to the AI hype, but you can find many similar analyses all over STS literature, or throughout just Agre’s work, which really ought to be required reading for anyone in software.

    edit to add some recommendations: If you think of yourself as a tech person, and don’t necessarily get or enjoy the humanities (for lack of a better word), I recommend starting here, where Agre discusses his own “critical awakening.”

    As an AI practitioner already well immersed in the literature, I had incorporated the field’s taste for technical formalization so thoroughly into my own cognitive style that I literally could not read the literatures of nontechnical fields at anything beyond a popular level. The problem was not exactly that I could not understand the vocabulary, but that I insisted on trying to read everything as a narration of the workings of a mechanism. By that time much philosophy and psychology had adopted intellectual styles similar to that of AI, and so it was possible to read much that was congenial – except that it reproduced the same technical schemata as the AI literature. I believe that this problem was not simply my own – that it is characteristic of AI in general (and, no doubt, other technical fields as well). T



  • I’ve now read several of these from wheresyoured.at, and I find them to be well-researched, well-written, very dramatic (if a little ranty), but ultimately stopping short of any structural or theoretical insight. It’s right and good to document the shady people inside these shady companies ruining things, but they are symptoms. They are people exploiting structural problems, not the root cause of our problems. The site’s perspective feels like that of someone who had a good career in tech that started before, say, 2014, and is angry at the people who are taking it too far, killing the party for everyone. I’m not saying that there’s anything inherently wrong with that perspective, but it’s certainly a very specific one, and one that I don’t particularly care for.

    Even “the rot economy,” which seems to be their big theoretical underpinning, has this problem. It puts at its center the agency of bad actors in venture capital becoming overly-obsessed with growth. I agree with the discussion about the fallout from that, but it’s just lacking in a theory beyond “there are some shitty people being shitty.”