You can I guess if that vote by someone in your instance or maybe via the ActivityPub protocol.

Though points do not matter in Lemmy. There’s no algorithm so it does not have a effect nor are there karmas in Lemmy. Let it go bro.