Categories
Design Education Innovation Network Reading Technology

Latest read: Too Big to Know

Too Big to Know: Rethinking Knowledge Now That the Facts Aren’t the Facts, Experts Are Everywhere, and the Smartest Person in the Room Is the Room by David Weinberger is an amazing look at how vast amounts of knowledge in our digital world has changed our ability to not only comprehend data, but how data and the internet rewire how our brain’s process information.
Too Big to KnowIn a way this book is about networks of knowledge stored in databases and in people. So what happens to all the knowledge and expertise we now confront? Outside of it being somewhat accessible on the net, the large amounts of data are forcing us to reimagine data infrastructure.

This is pushing development of large “big data” solutions that will have the ability to process and dashboard results that are more easily “digestable” for larger and larger groups of people across the spectrum.

Weinberger confirms that there is so much data, information & knowledge today for the first time in our collective history that no single person can process it all. And that is not always a good thing. He stated “We see all too clearly how impotent facts are in the face of firmly held beliefs. We have access to more facts than ever before, so we can see more convincingly than ever before that facts are not doing the job we hired them for.”

And at the same time accounting for human nature – access to more data will only reinforce the worse as illustrated by Cass Sunstein: “Studies have shown that when people speak only with those with whom they agree, they not only become more convinced of their own views, they tend to adopt more extreme versions of those views.” And now you know the rest of the story.

Too Big to Know reveals in chapter eight how we are managed today. In the past we learned about Jack Welch of GE. He was the final, top decision maker. But today with wikis, blogs and mobile technology GE’s strategic plans are made from the bottom up: “The CEO of General Electric could be entirely off the grid, but still GE’s engineers, product managers, and marketing folks are out on the Net, exploring and trying out the ideas that affect their branch of the larger decision tree.” This is the ‘wikipedia’ approach. This is also something Weinberger acknowledges in Don Tapscott’s work Wikinomics.

Finally, I could not agree more with Weinberger’s example (Chapter five) regarding a marketplace of echoes. He describes the impact of David Halberstam‘s award winning book The Best and the Brightest. (my review here) Halberstam attempted to explain how the Kennedy White House, full of highly educated, dedicated men (McGeorge Bundy, George Ball, Chester Bowles, Robert McNamara) could have failed so badly in Vietnam. Their efforts are now very distant, recalled most often as an analogy to our country’s worst mistake. But Halberstam’s question remains deeply unsettling: How did the best and the brightest get us into the ‘hell’ of Vietnam? If these men, so well educated and worldly, erred so badly, how can we trust the advice of lesser men?

No better lesson on diversity than our failure in Vietnam. This is a very good book.

Categories
Cyberinfrastructure Design Education Google Innovation Internet2 Network OpenSource Reading Technology Vietnam War

The Vietnam War: Unstructured data reporting and counterinsurgency

After reading No Sure Victory: Measuring U.S. Army Effectiveness and Progress in the Vietnam War I could not help but think about the consequences failed data reporting by MACV can serve a historical lesson for re-implementing or adjusting campus data reporting systems.

data reporting during Vietnam War
Data report tickets used by MACV in the early stages of The Vietnam War

Key stakeholders on campus should easily state their reasons for data collection and reporting. No Sure Victory benefits campus units by revealing an early, dare I say Big Data approach to unstructured data reporting and delivering actionable data.

Today we immediately understand Google’s Compute Engine or an Amazon Elastic MapReduce cloud for this demand.

Universities can thrive with diverse reporting teams. Working with Institutional Research and striving to improve enrollment and retention efforts are key goals. Yet important roles are filled with student workers. Here unstructured data often fragments over mismanagement. Many ad hoc Microsoft Excel documents are created without data governance and become silo’d from the campus data warehouse. Key stakeholders on any campus including CIOs, IR Directors, Research staff, Program Directors, campus data reporter writers and student workers. Even seasoned campus data report writers are not leveraged to streamline actionable data insights.

No Sure Victory brings to light a tragic failed data reporting implementation by Secretary of Defense Robert McNamara in addressing a war in Vietnam. The was his reputation as one of The Wiz Kids, the World War II Statistical Control unit that analyzed operational and logistical data to manage war.

Categories
Design Education Innovation Network Reading Technology

Latest read: The Data Science Handbook

The recent pre-release of The Data Science Handbook is a fast, easy read. There is nothing better in business today than the still exploding market of data science. While some marketing statements indicate many are trying data science, here are the voices of recognized data science leaders. I have read my share of data science and big data books as well but like the direction of this pre-release.

The Data Science Handbook Pre-ReleaseMaturing technologies like Hadoop and even MapReduce prove yesterday was the time for every organization, business unit and non-profit to understand how data science is fundamentally changing the game.

Data Science hits your data sweet spot due to the ability of large systems to process your data in real-time. Notice how Microsoft is acquiring data science companies?

Data Science was just in its early stages not more than 10 years ago. Yahoo and Google helped move this forward. Even “legacy” companies like Sears Holdings understands the impact of MapReduce and Hadoop, they are well outside Silicon Valley. Just wait until some great advancements for public health are established by non-profits as a result of implement data science to forecast their business.

There is a great deal of excitement as the full release publication date inches closer. Cannot wait to see this book ship.

Categories
Cloud Cyberinfrastructure Design Education Innovation Network Reading Technology

Latest read: Numbers Rule Your World

I have enjoyed Kaiser Fung‘s blog JunkCharts for some time. He provides insight regarding data visualizations. His book Numbers Rule Your World: The Hidden Influence of Probabilities and Statistics on Everything You Do reveals how statistics and data mining find insights too good to pass up. Numbers make good stories even more compelling.

Numbers Rule Your WorldKaiser Fung takes an excellent approach to confirming that data analysis is now key to improving outcomes and discovering insights.

Fung outlines the use of big data analysis to solve five problems:

1. Fast Passes/Slow Merges: managing traffic patterns by the Minnesota DOT. This chapter reveals how frustrating statisticians can become when confronting politicians who ignore data.

2. Bagged Spinach/Bad Score tracked a deadly E. coli outbreak that caused three deaths across 23 states.

3. Item Bank/Risk Pool is a fascinating chapter about Florida insurance policies. Hurricane seasons come and go and yet an established city mayor and established businessman could not maintain an ongoing insurance business even with years of experience in state government. I found this chapter interesting to discover how the state games the insurance system say for say….Hurricane Wilma. For Higher Education this chapter also reveals Admissions related stories that are most interesting when compared to hospital billing. Fung also brings into focus the Golden Rule lawsuit that successfully charged discrimination against minority applicants in the insurance industry.

Categories
Design Education Innovation Milwaukee Technology

Tableau 8.2 for OS X

Tableau will ship their 8.2 update supporting OS X on June 19 with a big release party in San Francisco. The emerging BI tool is getting a great UI on a great computer.Tableau for OS X

Tableau for OS X