April 20, 2019

The more voluminous data is, and the faster it is transmitted, the faster we can be sent over a cliff.

Sir, Robin Wigglesworth writes: “The amount of digital data around the world is unimaginably vast. As more of our social and economic activity migrates online, the quantity and quality is going to increase exponentially. The potential is mind-boggling”,“Big Data’s power to illuminate leaves public sector in the shadows” April 20.

In April 2003, when as an Executive Director of the World Bank I formally commented on its strategic plan I wrote: "Nowadays, when information is just too voluminous and fast to handle, market or authorities have decided to delegate the evaluation of it into the hands of much fewer players such as the credit rating agencies. This will, almost by definition, introduce systemic risks in the market"

And it sure happened. The AAA rated securities backed with mortgage to the subprime sector in the US, send us straight into the 2007/08 crisis. 

In other words it is not just a question of data availability, in real time, but also on how we respond to it. It might behoove us all, to take a long time to digest it, before we react to it.

For example, and I quote from a BBC report: “On the 26 of September 1983, in the early hours of the morning, the Soviet Union's early-warning systems detected an incoming missile strike from the United States. Computer readouts suggested several missiles had been launched. The protocol for the Soviet military would have been to retaliate with a nuclear attack of its own. But duty officer Stanislav Petrov - whose job it was to register apparent enemy missile launches - decided not to report them to his superiors, and instead dismissed them as a false alarm. This was a breach of his instructions, a dereliction of duty. The safe thing to do would have been to pass the responsibility on, to refer up. But his decision may have saved the world.”

Sir, so what delay factor do we need to introduce before we respond to any real time data? I have no idea. You tell me.

@PerKurowski