Is it too late to start collecting every set?

At some point in my life I want to have a master collection (every card of every set) but seeing the prices that some packs/cards go from way back, I'm thinking its impossible, since the prices only go up from here. Is it still possible to get there from now?

Also, if you have any, what are some good ways/tips to start on this dream?