At present-day data rates it doesn't take much to disrupt the signal quite significantly and bring down the speed.

Have you called BT and had them check your ISDN connection?