Does the Chrome extension invade my privacy?

No, it does not. The Chrome extension only changes your default search engine— it has no other permissions. You can verify that during the install when it lists its requirements.