• 0 Posts
  • 10 Comments
Joined 1 year ago
cake
Cake day: June 19th, 2023

help-circle


  • I doubt anyone you are talking to is opposed to all human rights, that sounds very much like a straw man statement. Reasonable people can disagree about whether any particular right should be protected by law.

    The reason is simple: any legally-protected right you have stands in direct opposition to some other right that I could have:

    • Your right to free speech is necessarily limited by my right to, among other things, freedom from slander/libel, right to a fair trial, right to free and fair elections, right to not be defrauded, etc.
    • Your right to bodily autonomy can conflict with my right to health and safety when there is a global pandemic spreading and you refuse vaccination.
    • Your property rights are curtailed by rules against environmental harm, discrimination, insider trading, etc.

    No right is ever meant to be or can be absolute, and not all good government policy is based on rights. Turning a policy argument into one about human rights is not generally going to win the other person over, it’s akin to calling someone a racist because of their position on affirmative action. There’s no rational discussion that can be had after that point.


  • I believe the answer is, unfortunately, no.

    Long answer: In the past, an ML researcher trying to do this would have used either manual labels (for example a dictionary of parts of speech for each word) or multiple sub-models trained to solve each sub-problem before combining into a full prediction model, and even then performance is not great.

    However, once the models grew to billions of parameters it turned out that none of this external linguistic knowledge is necessary and the model can learn it all on its own. But it takes billions to trillions of examples to learn all these weights, which means a double hit to the training time: each step is slower due to more parameters, and more steps are needed to train on the full dataset.

    None of these models are trainable without a cluster of GPUs, which massively parallelizes the training process.

    That doesn’t mean you can’t try, but my results training a small toy model from scratch for 20-30 hours on a consumer GPU have been underwhelming. You get some nearly-grammatical sentences but also a lot of garbage, repetition, and incoherence.


  • I don’t know if it helps, but this is not really a lie, and you shouldn’t feel bad about saying it. You have your own reason for not being able to do something you committed to. Someone else might have a different reason that is equally personal that they don’t want to share. “I forgot and I’m sorry” is a socially acceptable way to take responsibility without sharing specifics and potentially making someone else feel confusion or pity.

    You can still work on the “why wasn’t I able to do the thing I felt I needed to do” without worrying about “why wasn’t I honest about my reason”.

    Just my two cents though.




  • I have been around some of the tech elite you’re referring to, and I propose that the disconnect arises because Silicon Valley uniquely revolves around Scale (how many people you can reach) and Impact (how big a dent you can leave in the universe). It’s impossible to overstate how ingrained it is in the culture, and it is very explicit when you talk to folks at Bill & Melinda Gates Foundation for example: the ability to measure and prove the impact of your project is as important as the project itself.

    I admit to being a member of this culture, if not wealthy.

    To me, the types of art you mention - art galleries and live theater being good examples - are extremely limited in serving relatively small populations concentrated in city centers where there already is a lot of culture. The generation that created the Internet is, for better or worse, much more interested in bigger investments that can reach everyone on the planet and hopefully improve lives in some measurable and long lasting way.

    I’m sure the wealthy here in California contribute to the local arts community just like anywhere else. But there is no equivalent in the arts to curing polio worldwide or giving every child access to the Internet, so I don’t personally disagree with prioritizing these agendas in a coordinated way.