You'd be the one controlling the off-switch and the physical storage devices for the data. I'd think that this fact takes most of the potential creep out. What am I not seeing here?

> You'd be the one controlling the off-switch and the physical storage devices for the data

Based on what? The CPU is a physical storage device on my PC but it still can phone home and has backdoors.

Is there any reason to think Nvidia isn't collecting my data?

If you're on linux just monitor and block any traffic to random addresses.

If you're on Windows, what makes you think they are not already?

The Intel backdoor is at the Kernel. OS has nothing to do with it.

> what makes you think they are not already

That is the point

> But it sounds kinda creepy don't you think?

is the bash history command creepy?

Is your browsers history command creepy?

Yes to both?

But those also don't try to reinterpret what I wrote.

it is all local so, no?

It generates responses locally, but does your data stay local? It's fine if you only ever use it on a device that you leave offline 100% of the time, but otherwise I'd pay close attention to what it's doing. Nvidia doesn't have a great track record when it comes to privacy (for example: https://news.ycombinator.com/item?id=12884762).

The source is available, minus the installer. You could always use the base repo after verifying it:

https://github.com/NVIDIA/trt-llm-rag-windows

if it's 100% local then fine.