I’ve been running birdnetpi on a raspberry pi 3 for years. It runs very well on this modest hardware. I also run birdnet-go in a docker container and use my reolink security cameras for the RSTP audio feed to that instance.

There are all sorts of AI/ML models available that can run on smaller hardware. But they are usually very specific and not general purpose, like the LLMs.

I hope I didn’t come off as complaining about degoog. I’m definitely not. degoog is awesome.

Thanks for the advice about the proxies. I’ll be looking into that as I continue to work on keeping prying eyes off our internet usage. I suspect this will be a never ending struggle for the rest of my life.

It seems that both google and reddit block requests coming from my VPN provider(PIA). I may have to set up my own VPN server using Azure or AWS if things keep going this way.

Thanks for this! I included degoog in my arr stack and it works great! I was surprised by the language support when I pointed my gluetun container to an an Italian exit node. But it’s very well documented and the language environment variable was easy to set. Nice!

Getting this working within minutes of reading this post felt like opening an unexpected present. I love it.

Thanks for this. I’m definitely dropping ollama now. No wonder GGUF models always gave me issues.

I might even dump open webui for llama.cpp’s webui