Every vote matters....welllllll.
For the Presidential election, yes, it's the Electoral College that really decides the vote. Read the history of the Presidential elections of Andrew Jackson if you want to see the Electoral College at work at the lowest, along with some very nasty campaigning.. Still,the recent history of the EC is that it has generally tracked very well to the popular vote in each state.
For lesser positions, from Congress to your Alderman, popular vote is still the decider. That's where your votes do count.