I've always wanted to try traveling by train. The trip to NY was fun ... the return trip not so much. Since freight trains have priority over Amtrak, it seemed that we were stopping every hour or so to let a freight train pass.
That’s because freights make money, and they own the rail line. Amtrak leases the use for almost nothing.
It’s actually pretty common for smaller companies to lease rail use from larger ones, and they almost always have to yield right of way to the owner company.
Empathy for your experience, but at least you know why, if that helps.