I do that too!I like comparing the movie to the book and telling people who haven't read the book what the differences are.
The one thing that really bugs me about the movies is Harry's eyes. They're supposed to be green. I know it's such a little detail, but the books remind of that fact so much. And it's so easy to fix. If the actor didn't want to wear contacts, CG would fix it easily.