The most easy solution for this would be if you could not only have a guest list who is allowed to go inside but also a list with people who are allowed to drop/pick up items.
Or maybe even to have one room with a list of ppl who can have full access to this room, so you could have stuff not to...