Bitcoin surpassed the $100,000 mark late Wednesday night, setting a new all-time high during a persistent rally.