I put the double A batteries that we bought today in the cupboard.
A door shelf is a shelf with a door on it. What kinds of shelves do you know of that have doors on them? How about cupboards?
These readings are the ones you learned with the kanji.