If my video card is too close to the case, would it damage it?

Just keep it free from dust, and since you stay under the recommended max temps you'll be perfectly fine.