Amazing. Where is this?
Amazing. Where is this?
deleted by creator
If you get just the right gguf model (read the description when you download them to get the right K-optimization or whatever it’s called) and actually use multithreading (llamacpp supports multithreading so in theory gpt4all should too), then it’s reasonably fast. I’ve achieved roughly half the speed of ChatGPT just on an 8 core amd fx with ddr3 ram. Even 20b models can be usably fast.
This probably isn’t very helpful but the best way I’ve found to make an ai write an entire book is still a lot of work. You have to make it write it in sections, pay attention to the prompts based on what’s happening and spend a lot of time copy pasting the good sentences into a better quality section and then use those blocks of text to create chapters. You’re basically plagiarizing a document using ai written documents rather than making the ai shit it out in 1 continuous stream.
If you could come up with a way to make an ai produce a document using only complete sentences from other ai generated documents, maybe you could achieve a higher level of automation and still yield similar quality. Because otherwise it’s just as difficult as writing a book yourself.
As for software, use llamacpp. It’s a cpu-only ai thingy that can utilize multiple cores. You probably aren’t getting an nvidia gpu running on any arm board unless you have a really long white neck beard and a degree in computer engineering. Download gguf compatible models for llamacpp on hugging face.
I thought I never used it until my right shift key stopped working. I then found out that I use that thing a lot actually.
Actually I got an nvidia card working on easy diffusion on Debian. The barrier for getting a text chat ai working with gpu acceleration is actually the fact that I don’t have the patience to deal with all that python venv nonsense so I use llamacpp. It runs in c++ which means no python dependencies to fuck you with at the cost of slower cpu-only generation.
Easy Diffusion just happens to be simple enough that I could actually figure out how to get it to work (it’s in python and needs a virtual environment) but it’s a different story for the text ais.
If you actually had the patience and knowledge to deal with all the python issues and/or had a distro that makes it easy (different distros deal with pip differently), I don’t doubt you’d be able to get Nvidia card acceleration working on some text chat ai.
ebay’s usps shipping may not be as fast as prime but it’s fast enough for me.
Are you fucking kidding me. I don’t even want to think about what mental gymnastics it took to come to that conclusion.
All the new marijuana hate junk science articles will stop coming along in such numbers after Ohio’s election. Just watch.
In my 30s here. I spent my 20s getting shit faced drunk almost every day. I can’t drink anymore. The hangovers are just too severe. I would rather be sober and deal with all the boringness that comes with it than get hungover. And that’s exactly what I’ve been doing.
Maybe you’re right. Trump is such an idiot he’ll be running independently even if he’s banned from half the states which will take votes from whatever other asshat they replace him with.
As much as I hate Trump, if you think he’s the worst the Republicans can come up with you’re dead wrong. Him getting the nomination means they won’t get someone who is both worse and might actually win. I wish they would stop trying to fuck things up and just let the dumpster fire take its course.
This is how it begins. Trump and his idiot sidekick fascist moron Mike Johnson will try to do a 1939 round 2 against all the gays, transgenders, stoners and while they’re at it the jews again because fuck people.
Oh, I’m sure they’ll charge a minimum of $2k/month even for the shittiest of the shithole office apartments. They’ll get their money don’t worry.
Some people give birth in their own homes like in medival times. I know people who have done it. In my opinion people shouldn’t be having kids if society is so broken you have to do stuff like this but to each their own.
We really are repeating the last century aren’t we. Instead of jews it’ll be gays and marijuana users. Canada sounds like a nice place.
They picked the worst possible dipshit they could have possibly picked. The next 30 years of living in America are going to be rough.
This is a good idea which is why it will never implemented
I don’t really subscribe to the whole if civilization collaspes there will be no technology in anyone’s lifetime again thing. You aren’t going to go back to ordering shit off amazon from your smartphone or anything. However the knowledge that things like refrigeration, radio transmission, internal combustion engines, water treatment and such are possible is going to drive people to eventually find out how to get it by any means necessary.
How quickly this happens is a question of whether the majority of people adopt a “technology is too dangerous/a sin against God” idealogy or not.