Nah, not paranoid. Sounds like your fuel pump is on the way out, OR there is a problem with the wiring. Some corrosion along the way will reduce the voltage available to the fuel pump, so it will run more slowly.
If'n it were me, I'd check the voltage at the pump while the pump is engaged...