That, or leakage from the lights. The delay could, in part, be related to temperatuse changes...or a 'borderline' fault that is very close to the trip level of the GFI.

I think it's time to get a megger and do some serious testing.