LessThunk.com

DAILY COMMENTARY

 

The Cool Stuff Only Happens at Scale – audio

LessThunk: A bit technical, but stating the obvious — big data does not mean you can stop thinking, otherwise black swans (extreme events) kill you.

 

Cool Stuff Only Happens at Scale Distributed computing frameworks like
Hadoop and Spark have enabled processing of “big data” sets — but that’s
not enough for modeling surprise/rare “black swan” or complex events. Just
think of scenarios in disaster planning (earthquakes, terrorist attacks,
financial system collapse); biology (including disease); urban planning
(cities, transportation, energy power grids); military defense … and
other complex systems where unknown behaviors and properties can emerge.
They can’t be modeled based on (by definition impossible) limited data.
And parallelization for this is hard. But what if companies and
governments *could* answer these seemingly impossible questions — through
simulations? Especially ones where we can directly merge in knowledge and
cues from the real world (sensors, sensors everywhere)? CEO of Improbable
Herman Narula and Stanford University professor-in-residence at a16z Vijay
Pande discuss this and more with Chris Dixon in this episode of the a16z
Podcast. And as Herman says, “the cool stuff only happens at scale”.

https://soundcloud.com/a16z/distributed-computing-simulation


Categorised as: interesting

Posted by: Kramer

Comments are disabled on this post


Comments are closed.



Disclaimers – All content here is NOT presented as investment advice; LessThunk is NOT endorsing any website or specific investment by displaying external links.

We may or may-not (coincidentally) hold some quantity of stock or other investment related to any given post, no endorsement is implied in any sense.

css.php