VM endpoint is using a static queue to accept the message. It is make sense the queue can still accept the message even the consumer is shutdown.
Yeah the queues is alive. You can purge the queues manually using JMX etc.
We could also consider an enhancement so you can specify that the queue should be purged when a consumer is stopped. Mind that it will then discard all the messages, even for other consumers.