4GB RAM installed, 2GB showing?

I guess Windows XP has this limit, I know BUT does the 4GB RAM still count in games. I mean, I bought 2 more GB because I want to play Gta IV Multiplayer better. 4GB wont affect Windows XP but will it affect the games at least? This might be a dumb question.. idk