UPDATE：
After driving for a while to reproduce the noise which can only be heard at idle, I restart the engine, the noise is gone. Someone said it was VVEL knocking, there is a TSB for it to update ECU/ECM, but that was for 2008 model. Mine is 2011 with 3000 miles.
