You can see what we do in our Apache conf here: https://github.com/xibosignage/xibo-cms/blob/develop/docker/etc/apache2/conf.d/cms.conf
You would need to configure it with your library location too, so that it can access those files.
It is a good thing to get enabled as it will reduce load on the server and deliver files more quickly!