Molecular vibration can influence exciton transfer via either a local (intramolecular) Holstein or a nonlocal (intermolecular) Peierls mode. We show that a strong vibronic coupling to a nonlocal mode dramatically speeds up the transfer by opening an additional transfer channel. This Peierls channel is rooted in the formation of a conical intersection of the excitonic potential energy surfaces. For increasing Peierls coupling, the electronically coherent transfer for weak coupling turns into an incoherent transfer of a localized exciton through the intersection for strong coupling. The interpretation in terms of a conical intersection intuitively explains recent experiments of ultrafast energy transfer in photosynthetic and photovoltaic molecular systems.