A few drops every now and then is nothing to get too worried about. You're polluting a little bit but shouldn't do any harm to the engine as long as your keep an eye on the level.
That said, I'd still do what Benibiker recommended - pull the tray and see where the leak is coming from. It may be a symptom of something bad. And nobody likes a polluter.