• 0 Posts
  • 50 Comments
Joined 2 years ago
cake
Cake day: July 8th, 2023

help-circle


  • Did you read the article, or the actual research paper? They present a mathematical proof that any hypothetical method of training an AI that produces an algorithm that performs better than random chance could also be used to solve a known intractible problem, which is impossible with all known current methods. This means that any algorithm we can produce that works by training an AI would run in exponential time or worse.

    The paper authors point out that this also has severe implications for current AI, too–since the current AI-by-learning method that underpins all LLMs is fundamentally NP-hard and can’t run in polynomial time, “the sample-and-time requirements grow non-polynomially (e.g. exponentially or worse) in n.” They present a thought experiment of an AI that handles a 15-minute conversation, assuming 60 words are spoken per minute (keep in mind the average is roughly 160). The resources this AI would require to process this would be 60*15 = 900. The authors then conclude:

    “Now the AI needs to learn to respond appropriately to conversations of this size (and not just to short prompts). Since resource requirements for AI-by-Learning grow exponentially or worse, let us take a simple exponential function O(2n ) as our proxy of the order of magnitude of resources needed as a function of n. 2^900 ∼ 10^270 is already unimaginably larger than the number of atoms in the universe (∼10^81 ). Imagine us sampling this super-astronomical space of possible situations using so-called ‘Big Data’. Even if we grant that billions of trillions (10 21 ) of relevant data samples could be generated (or scraped) and stored, then this is still but a miniscule proportion of the order of magnitude of samples needed to solve the learning problem for even moderate size n.”

    That’s why LLMs are a dead end.


  • When IT folks say devs don’t know about hardware, they’re usually talking about the forest-level overview in my experience. Stuff like how the software being developed integrates into an existing environment and how to optimize code to fit within the bounds of reality–it may be practical to dump a database directly into memory when it’s a 500 MB testing dataset on your local workstation, but it’s insane to do that with a 500+ GB database in production environment. Similarly, a program may run fine when it’s using a NVMe SSD, but lots of environments even today still depend on arrays of traditional electromechanical hard drives because they offer the most capacity per dollar, and aren’t as prone to suddenly tombstoning when it dies like flash media. Suddenly, once the program is in production, it turns out that same program’s making a bunch of random I/O calls that could be optimized into a more sequential request or batched together into a single transaction, and now it runs like dogshit and drags down every other VM, container, or service sharing that array with it. That’s not accounting for the real dumb shit I’ve read about, like “dev hard coded their local IP address and it breaks in production because of NAT” or “program crashes because it doesn’t account for network latency.”

    Game dev is unique because you’re explicitly targeting a single known platform (for consoles) or targeting for an extremely wide range of performance specs (for PC), and hitting an acceptable level of performance pre-release is (somewhat) mandatory, so this kind of mindfulness is drilled into devs much more heavily than business software dev is, especially in-house dev. Business development is almost entirely focused on “does it run without failing catastrophically” and almost everything else–performance, security, cleanliness, resource optimization–is given bare lip service at best.


  • Yeah, I won’t deny the quality has gone down, too. Marvel’s biggest mistake was thinking they could keep the gravy train rolling past endgame. They SHOULD have let it rest and given the creatives some time to cook and plan a new arc, but instead they pushed forward before they were ready and are paying dearly for it.

    It’s the same damn mistake they made with the star wars sequel trilogy–if they had sat on it for a year or two, hashed out a coherent overarching plot, and let it cook, we would’ve gotten something better than “Somehow, Palpatine returned.” Hell, if they needed something immediately, they could have brought in Timothy Zahn to adapt the Thrawn books. Instead they went off half-cocked and gave us a barely-coherent retread of the original trilogy.


  • Nah, there’s definitely an element of fatigue. I used to watch superhero movies pretty religiously, even renting movies I missed before watching the new avengers flick. I even went to see Infinity War day one, and it was such a shock that I remember sitting in the car in silence on the way home (though I did cue up Snow in Summer from the NieR soundtrack… IYKYK). After Endgame, though… It was like a switch flipped. I had just watched this big, amazing payoff film that celebrated nearly a decade of cinema, had highs and lows, I watched actors and characters I had followed for years giving their goodbyes… It was a big, emotional moment, and the feeling I had afterwards was like the end of Thanksgiving dinner where you’ve finished your slice of pie and are enjoying the warm and fuzzy feelings. In other words, I was full.

    So when Marvel kept producing more movies at the same pace as before, it was like the end of Thanksgiving dinner, except now the host is starting to bring out another pie and putting a slice in front of me, and now I’m side-eyeing it and trying to find a polite excuse to say no and go the fuck home.


  • Yeah, there are so many moments I wish I had a time machine so I could go back and yell at various people while shaking their shoulders.

    For the love of God, Barack, don’t make fun of Trump at the White House correspondent’s dinner, he’ll run for president to dismantle all you’ve built up in revenge and HE WILL WIN.

    Please, Ruth, I beg you to step down now while there’s still an opportunity for you to be replaced with another liberal justice. If you don’t, your legacy will be undone I’m under four years and it will herald the end of American democracy.

    Please, Barack, don’t let them steal a supreme court seat like this, you have to force the issue while there’s still time or else you will watch the heritage foundation gloat about the second American revolution against the left while a corrupt court anoints the president as above the law of the land.

    For the love of God, Biden, please run in 2016, I know you’re still grieving over the death of your son, but if you don’t you’ll be grieving over the death of your entire country.

    For the love of God, Hillary, please step aside and let Sanders be the candidate, I know you agreed with Obama that he would give you SoS in return for you running after him but the Republican propaganda machine has made you toxic.

    Barack, you can’t sweep this Russian interference under the rug, it’s too important to ignore, please!

    I beg you, Hillary, don’t ignore the rust belt, your numbers are weaker than they should be there and they are too important to lose, the literal future of democracy is at stake.

    For fuck’s sake, Comey, don’t reopen this stupid email investigation two weeks before the election, we both know there’s nothing on that fucking laptop. You need to shut down the trumpy faction before they leak its existence because they are trying to interfere with the election, and if Trump wins he will reward you with a pink slip while gleefully dragging the country to a dictatorship.

    This timeline could’ve been so easily avoided, if only one variable out of dozens was different. But here we are, with me wondering where I can even flee to in order to escape the coming dictatorship.



  • Hoo boy, it’s a toughie. On the one hand, Trump would still be around. He also wouldn’t be in as much legal peril as he is now (it’s likely there wouldn’t have been an appetite to prosecute him over the Stormy Daniels hush money payments, and the classified documents case would have never happened to begin with since he wouldn’t have had access). But he almost definitely WOULD have tried to pull off another insurrection similar to Jan 6th–he was foreshadowing that he wouldn’t accept the results if he lost even back in 2016, using the same language as he did in 2020 before he launched his coup attempt.

    The world where Trump doesn’t attempt a coup isn’t very interesting, at least for this thought experiment–he slinks off, continues shitposting about Hillary on Twitter, but likely doesn’t try to run again (or loses in the primary because he’s a sore loser). Everyone ignores his hush money payments in the interest of “statesmanship,” and at best he becomes a minor kingmaker in the party apparatus. MAGA withers on the vine, and we largely continue with the late Obama administration status quo.

    The world where he attempts a coup is much more interesting. The real question is, what would have changed after the failed insurrection attempt? It’s highly unlikely it would have succeeded or even gotten anywhere as close as it did, since a lot of the original plan relied on access to the levers of power (I.e. being able to withhold security to let the rioters overrun the Capitol). But how would everyone react to it long-term? In this timeline, Republicans genuinely distanced themselves from Trump and Jan 6th at first, likely out of shock over the realization that they were actually in danger and the very real fear that they could end up hurt or killed. But as the shock wore off, Republicans started shuffling back to MAGA as the propaganda machine did its work to downplay and normalize the failed coup, and they realized that their base saw Jan 6th as a good thing.

    In a theoretical timeline where Trump tries a coup in 2016, it depends on how far Trump gets before he fails. If he’s thwarted to the point where he doesn’t (or can’t) hold the rally that stormed the Capitol, then nothing really comes of it at all–it becomes a footnote in history that is only cared about by political historians, pub trivia enthusiasts, and people who like to talk about politics on the internet. If he gets to the point where he holds a rally, but the rally is prevented from interfering with the certification process (complete with provocative images of cops in riot gear swinging at MAGA rioters), it’s likely that this downplaying and normalization would have been ironically amplified by virtue of the coup attempt being less successful. Without the visceral fear of hiding from rioters, Republicans would have no reason to distance themselves from the attempt, and they would almost immediately start using it as fodder to attack the new Clinton administration. In short, the hypothetical coup attempt would become another Benghazi scandal for Clinton–something that she had little real involvement in and largely wasn’t her fault, but that she gets blamed for anyway. Trump, meanwhile, would remain largely in the same position as in 2015–the dominant force in the party.

    Aside from that, the court wouldn’t be as openly corrupt as it is now. It’d be filled by a moderate Clinton appointee if democrats have the 51 votes to abolish the filibuster for supreme court appointees (or held open by McConnell otherwise), and when RBG dies her replacement is decided by whoever wins the 2020 election. Roe v. Wade would still exist, the chevron deference would still be the law of the land, and we wouldn’t have the terrifying prospect of legally sanctioned presidential death squads.

    Overall, I think we would be largely in line with the status quo of 2014-2015. Not great, with a worrying trend towards fascism and an establishment largely too busy huffing their own farts to address the vast majority of problems facing us, but a LOT better than where we are right now.



  • For what it’s worth, I played the NES release of DQ1, and then a translation of the japan-only SNES release of DQ2 recently (I actually beat DQ2 last week) and I found DQ2 to be a much better game than DQ1 overall. DQ1 was… interesting, but it was very much a game that did not respect the player’s time in the least, to the point of expecting the player to fight literally hundreds of battles in order to grind up enough money and experience to afford the gear. The most charitable thing I can say about it is that the battle system was so rudimentary and so grindy that the gameplay felt more like it was focused on resource management–there was a tension in deciding whether you could afford to take another fight, or if you needed to return to town and spend money sleeping at an inn to heal (setting your grind back at least 1-2 fights with how piddly gold and XP drops were), optimizing efficiency in spending your MP to heal vs. the risk of dying to the next monster, etc.

    DQ2 meanwhile was a much more robust and much less grindy game–the simple addition of multiple party members and multiple enemies in a single battle meant that your gold and XP gains were multiplied over the first game. While it still demanded grinding, it was much more reasonable about it, and it felt much more like a “modern” JRPG like you’re used to seeing.





  • The problem is that there’s no incentive for employees to stay beyond a few years. Why spend months or years training someone if they leave after the second year?

    But then you have to question why employees aren’t loyal any longer, and that’s because pensions and benefits have eroded, and your pay doesn’t keep up as you stay longer at a company. Why stay at a company for 20, 30, or 40 years when you can come out way ahead financially by hopping jobs every 2-4 years?


  • OKAY, time for some clarification as a Seattle local:

    • This was NOT an isolated incident. The Cuff Complex, which was one of the bars that got raided, had been raided so many times in the past the owner had to put up a sign warning customers not to wear jockstraps because of the heavy enforcement (which ironically caused him to lose even more business because everyone was pissed at the owner for “policing bodies”)

    • Gay bars were being targeted disproportionately to straight bars. Remember, there are a LOT more straight bars than gay bars. Raiding 4 gay bars covers a sizable chunk of all the gay bars in Seattle, but raiding 14 straight barsis a relative drop in the bucket.

    • A gay cabaret club owner crunched the numbers and found his establishment was raided 1,550% more than the average liquor licensee. The owner of the Cuff also owns another gay bar and a regular straight bar. His two gay bars are frequently raided, while the straight bar has NEVER been raided.

    • The board that enforces liquor laws is the LCB. Two funny facts: First, the rule against lewd conduct was created by… The LCB, not the state legislature. Second, the LCB stands for the Liquor and Cannabis board, which means that they are already ignoring a law when it suits their purpose (the federal prohibition against cannabis).

    • Finally, after the gay community collectively tore the LCB a new asshole during a board meeting earlier this week, the LCB reversed course and basically said “ah shit we fucked up” and is suspending enforcement of its lewd conduct rules. I strongly recommend this Mastodon thread from someone who attended the meeting, it’s truly a thing of glory and demonstrates just how close the LCB was to getting slapped with a discrimination lawsuit: https://partyon.xyz/@nullagent/111851872885551640