Categories
Education Google Innovation Network Reading Technology

Latest read: The Signal and the Noise

The Signal and the Noise: Why So Many Predictions Fail – But Some Don’t by Nate Silver is another great book that completely absorbed my attention. This book offers in sights to many audiences. From weather forecasts, the Wall Street financial crisis in 2007, playing poker to even understanding and identifying signal relationships regarding the attacks on Pearl Harbor and New York on 9/11.
The Signal and the NoiseThe Signal and the Noise offers readers Silver’s insights on Bayesian thinking. Actually the book applies Bayesian in all the books lessons.

He nudges us to remember this when applying predictions in our own professions. Actually Nate’s study of predictions affects just about everything we do in life.

The strongest lesson for me is about understanding data-driven models can lead to tragic outcomes. He warns us about noisy data and Big Data that can set off false readings with horrific consequences. This alone makes this book a pretty important read.

Silver’s chapter on baseball and references to Michael Lewis‘s bestseller

Categories
Education Innovation Reading Technology

Reading Nate Silver’s The Signal and the Noise

Wow just started reading The Signal and the Noise: Why So Many Predictions Fail – But Some Don’t and see it carries the strong reputation as a though provoking book about prediction.
The Signal and the NoiseHe continues to look at data including out of sample data to provide greater context to long held assumptions to credit default swaps that strangled Wall Street and the housing bubble.

Even in defining why the US depression following the wall street collapse was worse than projected, his appeal of Too Big To Fail proves he has a good foundation from Andrew Ross Sorkin’s great book.

The second chapter of The Signal and the Noise focuses on pro baseball. Its another look at America’s game from a geek’s perspective. He acknowledges the impact of Moneyball by Michael Lewis. Lewis is a respected writer for all things wall street and metrics.

Now lets see how risk takers in Higher Education can improve a campus by understanding and absorbing these lessons….just pushing into chapter three.

Categories
Cloud Education Google Internet2 Network Reading Technology WiscNet

Latest read: Reliability Assurance of Big Data in the Cloud: Cost-Effective Replication-Based Storage

While focused on the task of generating data for astrophysics Reliability Assurance of Big Data in the Cloud is a worthy read when focused around designing cloud service contacts.
Reliability Assurance of Big Data in the CloudThe work of authors Yang, Li and Yuan surround capturing big data reliability, and measuring disk storage solutions including from noted cloud vendors.

Their work at Centre for Astrophysics and Supercomputing at Swinburne University of Technology focused on reducing cloud-based storage cost and energy consumption methods.

They also share the impact of multiple replication-based data storage approaches based upon Proactive Replica Checking for Reliability (PRCR). That was very interesting in their research data gathering.

I found Reliability Assurance of Big Data in the Cloud also supports moving data into the cloud across advanced research networks including Internet2.

Processing raw data inside the data center impacts network models (based upon available bandwidth) in their work. Their research gathers and stores 8 minute segments of telescope data that generates 236GB of raw data. By no means in the petabyte stage (yet) but it still sets a solid understanding of contractual demands on big data cloud storage.

My interest peaked around impacts developing knowledgeable contracts for cloud services. Their background regarding data gathering and processing should influence procurement contract language. This is even more applicable when applied to petabyte data sets and the SLAs regarding data reliability requirements. Never leave money on the table when scaling to the petabyte range. Must read for purchasing agents and corporate (and university) CPSMs.

Categories
Cyberinfrastructure Design Education Google Innovation Internet2 Network OpenSource Reading Technology Vietnam War

The Vietnam War: Unstructured data reporting and counterinsurgency

After reading No Sure Victory: Measuring U.S. Army Effectiveness and Progress in the Vietnam War I could not help but think about the consequences failed data reporting by MACV can serve a historical lesson for re-implementing or adjusting campus data reporting systems.

data reporting during Vietnam War
Data report tickets used by MACV in the early stages of The Vietnam War

Key stakeholders on campus should easily state their reasons for data collection and reporting. No Sure Victory benefits campus units by revealing an early, dare I say Big Data approach to unstructured data reporting and delivering actionable data.

Today we immediately understand Google’s Compute Engine or an Amazon Elastic MapReduce cloud for this demand.

Universities can thrive with diverse reporting teams. Working with Institutional Research and striving to improve enrollment and retention efforts are key goals. Yet important roles are filled with student workers. Here unstructured data often fragments over mismanagement. Many ad hoc Microsoft Excel documents are created without data governance and become silo’d from the campus data warehouse. Key stakeholders on any campus including CIOs, IR Directors, Research staff, Program Directors, campus data reporter writers and student workers. Even seasoned campus data report writers are not leveraged to streamline actionable data insights.

No Sure Victory brings to light a tragic failed data reporting implementation by Secretary of Defense Robert McNamara in addressing a war in Vietnam. The was his reputation as one of The Wiz Kids, the World War II Statistical Control unit that analyzed operational and logistical data to manage war.

Categories
Education Innovation Reading Technology Vietnam War

Latest read: No Sure Victory

In many ways my desire to understand the US failure in Vietnam has been a long difficult road. No Sure Victory: Measuring U.S. Army Effectiveness and Progress in the Vietnam War by Gregory Daddis answers many long held questions.
no sure victoryAfter digesting so many resources in books, documentaries and listening to interviews with veterans, politicians and social leaders during the long duration of the war.

I believe No Sure Victory reveals strong indicators regarding our failure in Vietnam. The focus is the failure of MACV to gather and process data against an established set of Key Performance Indicators (KPIs) over the long duration of this war.

Daddis documents McNamara’s injection of data gathering (metrics) when LBJ increased America’s commitment to South Vietnam. McNamara’s experience as one of The Wiz Kids seemed to set the stage in his role as Secretary of Defense. Yet our enemy was determined and battle tested. America was fighting a larger, strategic cold war with an emerging China and the established Soviet Union in both Europe and Asia.

Daddis sheds light throughout No Sure Victory not only on the lack of White House direction but how MACV leadership could not adapt to fighting a war of counterinsurgency. The impact of this television war confused the government, media and our country. At the same time Daddis points to key failures in not understanding the full affect of the French Indo-China war regarding counterinsurgency. This lack of understanding established a crippling third leg the US consistently fought to balance against the cold war political spectrum.