So long as the circuit remains de-energized at the source, I see no problem. I would cut the wires out of the panel just to be sure no one re-connects them at a future date. Or, at least, identify the wires in the panel with an attached note detailing where the other end of the circuit is.
