If you use your fingers to point when you compare things you're really just throwing around criticism. You should never need to point fingers when you're just comparing things. If you're pointing and picking and being mean, that's criticism.
If you're having trouble not giving out criticism, just think about how you would react if someone criticized you. You'd feel an embarrassed heat (ひ) rise throughout your body. That heat will cover your whole face.