One of the major reasons for the increase in super crunching is Moore’s Law, Kryder’s Law and their relatives. Processing power, Bandwidth and Storage keep increasing exponentially, while their costs keep decreasing (Chris Anderson discusses other implications in Free: Why $0.00 is the Future of Business). These trends are making it easier, cheaper and more efficient to super crunch. More and better data are available online every day because of the increasing ease of both collection and transmission.
Conclusion: Expect to see more super crunching in the future. This is just the beginning.