If you were running a LLM locally on android through llama.cpp for use as a private personal assistant. What model would you use?

Thanks for any recommendations in advance.

  • Tinkerer@lemmy.ca
    17·
    2 days ago

    I have pocketpal setup on my pixel with graphene os and its pretty awesome. I agree that AI is inherently bad considering the environmental impact and the amount of data that is illegally needed to train AI.

    That being said pocketpal is openaoirce and is great. https://github.com/a-ghorbani/pocketpal-ai