I’m self hosting on an old laptop, and I’m a convert for life. Self-hosting is amazing. Looking for other people’s weirdest examples of what they’re doing as inspiration.
My example, I recently set up a grammar script, where I have a couple 8b LLMs and an html landing page. I upload a doc and it corrects grammar and highlights changes it made, or just proofreads and I make changes manually. I can upload a novel before bed, and have suggestions based on specific writing styles in the morning. All local, perfectly suited for my own work.
I think this is a great response. I’m not sure what happened to “if you haven’t got anything nice to say, don’t say anything at all.” I absolutely agree on the purity test thing and I think the functioning solution you have created is absolutely awesome and has inspired me to try something similar. Rather than comment on the result and cool thing that was achieved, they chose to focus on some irrelevant detail because apparently it’s too hard to just say something is cool.
If you have a write up of your setup I’d love to read it. Don’t let the zealots drag you down bud.