If i can figure it out I’ll be sure to post something lol.

So far, i found a python project that is supposed to enable RAG but i have yet to try it and after a reinstall of my linux pc to Popos, im having less than success getting ollama to run.

Me personally, i use my AMD 7700XT to run ollama on my main pc. Can be helpful for troubleshooting as the internet gets worse amd worse to search especially if i dont know what the issue is. Thats my main use case for it but id like to set up something with RAG and use it to help me with documentation if i have questions.

I don’t think its super worth it to use a VPS for an LLM if you already have a decrnt gpu that you can run it on. If yoy dont already have the hardware, plenty of older gpus can run the models pretty well. My 1070ti still kicks ass all these years later and you can find them for $100 bucks or less on ebay used. Ive used it for ollama as well and it does just fine.

Will it be super fast or a really big model? No, but if its for personal use, i dont see any benefit to paying a monthly subscription for it and like i said, works well enough for me.

Its also more secure and private to host it yourself if thats worth anything to you. Thats one of the biggest reasons i self host.

I was recently looking for something like this and couldn’t find what i was looking for, so thanks!

I tried umbrel and wasnt super impressed. It seemed like it would function alright for the small amount of things i was trying to do but broke shortly after installing. I set up pihole and i think jellyfin since i was just testing it out on an older laptop.

I’ve heard decent things about CasaOS but have not used it myself.

I have used discover and other similar apps like the Pop shop but man are they just not quite there yet imo.

I installed Pop!OS on my media pc recently and that gave me more problems than discover on my main pc running Fedora.

Both were good for finding apps but installing was kind of a pain. Usually it would crash, or not install at all, sometimes canceling would hang forever, etc.

Though this could be due to my internet being shit where i live atm so ymmv.

It has gotten easier the more I’ve used it amd I’m very stubborn so I’ll be here a while lol.

Unfortunately the only person i know that also uses Linux uses Gentoo so he’ll have to compile my question for a few days before he can answer it.

I enjoyed this video, im already subbed to him but i loved his take on Linux cause im kinda in the same boat. I wanna be here, but man I do wish it was a little easier sometimes.

What are you doing step-LAN?

Jellyfin was my go to as well. It was really nice to play with and finamp was as well. Once setup it was just as easy and nice to use as Spotify without all the ads and Spotify randomly playing songs after i finish a podcast episode.

If you dont need the drive to be fast and want best bang for your buck storage capacity, HDD is the way to go.

If you want speed and are ok with a higher price, SSD is best. Used enterprise HDD are usually a good value. Im in the US so not sure about where to purchase exactly.

Something to consider is if the drive you are storing the os and files on are the same, using am HDD will make it slower on start up.

Ah ok, thats pretty cool. I dont do much torrenting anymore cause my internet is not only limited but is kinda slow and unsteady.

Might check that out once im back in civilization with a decent connection. I miss gigabit speeds man.

Yea the real fun is always the set up when selfhosting. Then you look for the next project lol.

Im not familiar with gluetun, is that what you’re using to download tracks or something?

I personally really liked using jellyfin and finamp. Both were pretty great once i figured out how to set it up lol.

The issues i had were due to my lack of knowledge and trying to set things up to use it outside of my home network. Jellyfin itself was great as was finamp when i used them.

Oh so its not just me who thinks its gotten worse then. I was starting to go a little crazy man. It seems like its slowly gottwn worse over time. I wonder if its due to the amount of ai content messing up seo ratings or something

From what I’ve heard, most people that are for in office work like having the separation between work and home.

That being said, I think most folks want remote work or at least remote hybrid. It just makes more sense especially for me. I live far from my office (140 mile drive roundtrip), and working 3 days a week from home has been a god send.

Well now im very jealous lol. Good for you man, thats a banger deal.

88 x 8TB drives? 704 TB of storage?

You got a whole damn data center lol. Good stuff dude. Was this off of ebay or direct from a company? I’m curious to know the total cost.

I know 3 different people that are on the spectrum and while they do experience life differently and face different and or unique challenges, yes, absolutely you can live a normal fulfilling life.

Like with any mental health condition, it can make things that are everyday or normal for most folks more difficult so its important to not only seek guidance from a mental health professional but also have a good support structure. People you can count on to help you when you need it.

Everyone is a little different of course so finding the right fit for each can be kinda hard but all 3 people i know are happy, healthy, and are living a good life.

Everyone is weird anyways. I know plenty of neruotypical people that do weird stuff. Humans are weird by nature so what “normal” is to one person might be “weird” to another.

Fair point. My company keeps drives that get taken out of servers for office use. After that theyre recycled.

Damn thats cool! My work doesnt let me take drives old drives. Though we dont use sas drives so that might be why.

I certainly dont mind used drives for mass storage. I was planning to do some kinda raid anyways.

I haven’t gotten any kind of nas setup yet. Trying to avoid buying too much lol but good to know other folks are using sas drives too.