Category Archives: Cyberinfrastructure

The Vietnam War: Unstructured data reporting and counterinsurgency

After reading No Sure Victory: Measuring U.S. Army Effectiveness and Progress in the Vietnam War I could not help but think about the consequences failed data reporting by MACV can serve a historical lesson for re-implementing or adjusting campus data reporting systems.

data reporting during Vietnam War

Data report tickets used by MACV in the early stages of The Vietnam War

Key stakeholders on campus should easily state their reasons for data collection and reporting. No Sure Victory benefits campus units by revealing an early, dare I say Big Data approach to unstructured data reporting and delivering actionable data.

Today we immediately understand Google’s Compute Engine or an Amazon Elastic MapReduce cloud for this demand.

Universities can thrive with diverse reporting teams. Working with Institutional Research and striving to improve enrollment and retention efforts are key goals. Yet important roles are filled with student workers. Here unstructured data often fragments over mismanagement. Many ad hoc Microsoft Excel documents are created without data governance and become silo’d from the campus data warehouse. Key stakeholders on any campus including CIOs, IR Directors, Research staff, Program Directors, campus data reporter writers and student workers. Even seasoned campus data report writers are not leveraged to streamline actionable data insights.

No Sure Victory brings to light a tragic failed data reporting implementation by Secretary of Defense Robert McNamara in addressing a war in Vietnam. The was his reputation as one of The Wiz Kids, the World War II Statistical Control unit that analyzed operational and logistical data to manage war.

Continue reading

Latest read: Online Payments Risk Management

Online Payments Risk Management is certainly a hot topic. The 2013 holiday data breach at Target and more recently, a new large data breach at Home Depot the need for organizations to understand Online Payments Risk Management is more important today truly than ever before.
online payments risk managementI think there is no better way than for companies and payment card providers to step back and acknowledge many “security” measures are not effective today in combating cyber crime.

Ohad Samet’s book is a great introduction to payment risk management from multiple angles and can be a good base document to build upon in bringing PCI compliance efforts to online payment websites.

It may even be interesting to see how Samet positions of Loss over Fraud.  The implications can be rather surprising.

Samet has organized this book into logical sections regarding approaches and the use of analytics to optimize tracking losses while also addressing the role of the organization and the people implementing secure transactions.  Regardless of its 2013 publication, section 3 on Tools and Methods provides solid, industry tested solutions that should be reviewed annually.

That said its time to roll up your sleeves and begin protecting consumers.

Latest read: Numbers Rule Your World

I have enjoyed Kaiser Fung‘s blog JunkCharts for some time. He provides insight regarding data visualizations. His book Numbers Rule Your World: The Hidden Influence of Probabilities and Statistics on Everything You Do reveals how statistics and data mining find insights too good to pass up. Numbers make good stories even more compelling.

Numbers Rule Your WorldKaiser Fung takes an excellent approach to confirming that data analysis is now key to improving outcomes and discovering insights.

Fung outlines the use of big data analysis to solve five problems:

1. Fast Passes/Slow Merges: managing traffic patterns by the Minnesota DOT. This chapter reveals how frustrating statisticians can become when confronting politicians who ignore data.

2. Bagged Spinach/Bad Score tracked a deadly E. coli outbreak that caused three deaths across 23 states.

3. Item Bank/Risk Pool is a fascinating chapter about Florida insurance policies. Hurricane seasons come and go and yet an established city mayor and established businessman could not maintain an ongoing insurance business even with years of experience in state government. I found this chapter interesting to discover how the state games the insurance system say for say….Hurricane Wilma. For Higher Education this chapter also reveals Admissions related stories that are most interesting when compared to hospital billing. Fung also brings into focus the Golden Rule lawsuit that successfully charged discrimination against minority applicants in the insurance industry.
Continue reading

Latest read: The Art of Capacity Planning

The impact of cloud computing on O’Reilly’s 2008 Art of Capacity Planning has shifted quite a bit to say the least. Its still a great resource and well worth the read for any web administrator, manager or director.

The Art of Capacity PlanningMy interest in revisiting is remembering Chapter 4: Predicting Trends. This touches two important factors today: cloud and procurement.

While in 2008 it was possible to ramp up a cloud, today a very high capacity cloud can be deployed in less than 10 minutes.

At the time of the book’s publication (2008) AWS pricing looked competitive. Yet today those prices are considered somewhat excessively high.

The Art of Capacity Planning now is all looking at cloud solutions by Google Cloud and Microsoft Azure has kept Amazon’s EC2 busy in releasing new services and even more aggressive pricing models. Under AWS users get free access to CentOS, LAMP stack, Git and WordPress.

But the Art of Capacity Planning touches on the very important component of Procurement. Procurement and Cloud contract solutions taught by UCLA has been very beneficial to my cloud projects.
Continue reading

Latest read: The Changing Role of the CIO

We live in a world of constant change in IT. O’Reilly’s The Changing Role of the CIO provides a foundation regarding Big Data for any IT team and every manager, executive or board member. Today if your not embracing change your getting run over by it whether you know it or not.

The Changing Role of the CIO From the corporate boardroom to the campus research lab we indeed are undergoing a fundamental paradigm shift in our digital lives.

Without a doubt it is also an educational shift. Questions of Excel cubesets in a world of unstructured big data analytics will be a much needed training opportunity not for your IT team but actually or your entire workforce.

The Changing Role of the CIO is about the opportunities to engage your IT team over data. Today data is fueling actionable analytics not just vanity metrics. The IT team needs to embrace the idea that data is the new oil.

After leading your organization to a cloud solution that eliminates in-house, legacy enterprise systems you never can look back. Helping my organization migrate to a CMS public cloud that reduced just one enterprise service $400,000 annually resulted in our senior leadership never looking at me the same way. You gain a seat at the table.

And due to the nature of the mobile beast, The Changing Role of the CIO shows its now easier than ever to measure quality engagements in real time with your customers. The future of data, how it can be measured, immediately reported within your office or from the other side of world is a game changer.

Latest read: Big Data at Work

Big Data at Work is a good book for reviewing tested analytics case studies by Tom Davenport. As I began reading this I found myself reading an update to Tom Davenport‘s great analytics book Competing on Analytics that I read in 2008 which IMHO really set the standard. Big Data at Work is the follow up with tested business cases.

It seemed like an eternity that analytics are now realized as a critical business strategy for universities. Peter Drucker said it best: if you cannot measure it, you cannot manage it.

While much shorter than his Competing on Analytics, Big Data at Work is a must read. In Higher Education alone the Big Data at Work case studies by Davenport can serve as near perfect blueprints in the dynamic world of campus networks and services migrating to cloud.

Davenport needs to convince nobody that Big Data is a growing field, yet even in 2014 the number of colleges offering degrees in Big data science is not yet up to speed. More importantly he shares how traditional Business Intelligence is struggling to adjust to the analytics and big data era.

For as much as Big Data at Work contributes to the requirements in both technology and IT professionals, his suggestions that management stands in the way of more game changers outside of Silicon Valley. Yes Hadoop and MapReduce have forever empowered LInkedIn, Google, Yahoo and other startups. Healthcare, banking and insurance are markets who have already embraced and are excited about the abilities of big data for their customers.

Davenport is pretty upfront about what is needed: colleges have not fully embraced Big Data. Their mistake is assuming Big Data is a Computer Science degree. A good chapter of this book reflects on the inability of management to adopt Big Data for today’s competitive market. Is it surprising to see only a hand full of college programs sending grads to the likes of Google? More and more companies are looking to regional campus partnerships for Hadoop big data efforts. Yet many of those colleges still have no existing undergraduate or masters-level degrees in Big Data.