The readings are both kun'yomi readings, combined. For 人 you'll just have to remember this. With 柄 that's the reading you learned anyways, so that makes things easier. Just keep it consistent!
Don’t judge people’s personalities by their appearance like you’d judge a book by its cover.