This might be very obscure but if you specify the following:
And the keys in both locations are identical then only one location's keys will be removed. In my test this has been the last location's keys.
If you run puppet apply two times then both locations keys will be removed. If you alter the keys to have different names then all keys will get removed simultaneously.