That is interesting - as we are still in beta I have not yet enabled persistent caching of the templates and they should therefore be cleared with each change.
You can see this in /web/index.php where I pass debug = true to the Twig parser:
You can safely delete the cache without negative side effects - it will just regenerate… although as I say, I am confused as to why it isn’t doing that anyway.