Skip to content

Conversation

@I-I-IT
Copy link
Contributor

@I-I-IT I-I-IT commented Jul 26, 2025

List of changes proposed in this PR:

This updates information to be up to date. Furthermore, now phone AI clients are also recommended.

Copy link
Member

@jonaharagon jonaharagon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this edge gallery image should be changed to something better, and more importantly did we discuss these apps? I haven't heard of them 👀

I see https://discuss.privacyguides.net/t/update-on-ai-chat-tools/29496

@github-project-automation github-project-automation bot moved this from Unreviewed to Needs Changes in PR Review Status Jul 29, 2025
@jonaharagon jonaharagon changed the title Updates in AI chat + add mobile clients update!: Add Edge Gallery and PocketPal AI Jul 29, 2025
@I-I-IT
Copy link
Contributor Author

I-I-IT commented Jul 30, 2025

I couldn't find an Edge Gallery logo in their Github repo unfortunately. I had to take a screenshot.

I personally tested those apps, but if you have other propositions, feel free to add.

@jonaharagon jonaharagon added the pr:missing discussion PRs which add recommendations which have not yet been discussed label Jul 31, 2025
@privacyguides-bot
Copy link
Collaborator

This pull request has been mentioned on Privacy Guides Community. There might be relevant details there:

https://discuss.privacyguides.net/t/update-on-ai-chat-tools/29496/1

@GorujoCY
Copy link

GorujoCY commented Sep 6, 2025

I do not object to this
I’m aware of pocketpal, great app, allows any local model to be downloaded within the limits of system memory from > huggingface (does not check. you’ll have to do your won due dilligence) I’ll check the PR we could explain what models are possible to use based on the amount of system memory
Edit: I did not realize pocketpal was on iOS, good to know!
do I have permission to improve upon your PR? @I-I-IT

</details>
</div>

## PocketPal AI (Mobile)
Copy link

@GorujoCY GorujoCY Sep 6, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Specify how to calculate what parameter should be used on your phone for the local model to not feel sluggish on pocketpal since pocketpal allows running local models from hugging face and there are bigger parameter ones listed there
eg.
12GB RAM smartphones could adequately run around a 3B parameter local AI model (commonly found on android devices now) (with overhead), the more ram the higher the parameter it can run (it is commonly calculated by parameters in B * 2(FP16) * 2(Overhead))
8GB of RAM commonly found in newer iPhones can run at least 2B models

for more clarity see https://developer.nvidia.com/blog/gpu-memory-essentials-for-ai-performance/

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nowadays most local models run with quantization. I can run a 8B model on my Pixel 9. So I would say perhaps RAM needed =parameter size + 3.

The 3 is amount of RAM likely used by the OS and other apps.

Hugging Face has a RAM calculator BTW, so we could point that out.

@redoomed1 redoomed1 added the c:software self-hosted/decentralized software and related topics label Sep 7, 2025
dngray pushed a commit to I-I-IT/privacyguides.org that referenced this pull request Nov 18, 2025
@github-actions
Copy link

github-actions bot commented Nov 18, 2025

Your preview is ready!

Name Link
🔨 Latest commit b6d9515
😎 Preview https://pr3083.unreviewed.privacyguides.dev/en/

Please note that this preview was built from an untrusted source, so it was not granted access to all mkdocs-material features. Maintainers should ensure this PR has been reviewed locally with a full build before merging.

@I-I-IT
Copy link
Contributor Author

I-I-IT commented Nov 18, 2025

Thanks for fixing the images issue. I am going to update edge gallery now that they have a proper logo to download

@privacyguides-bot please build a preview!!

@I-I-IT
Copy link
Contributor Author

I-I-IT commented Nov 18, 2025

@dngray what is the process for dark mode logos?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

c:software self-hosted/decentralized software and related topics pr:missing discussion PRs which add recommendations which have not yet been discussed

Projects

Status: Needs Changes

Development

Successfully merging this pull request may close these issues.

7 participants