Thoughts on the data ecosystem

The Flex.io Blog

Governments have made a lot of data available in the last few years. In the U.S. alone, Data.gov hosts over 140,000 data sets, and many other cities and states have launched open data initiatives as well. However, a critical problem often arises when people actually try to find the specific data relevant to their needs. Governments often don't tell people where to get the data. It doesn't...

Data is big these days. And in more than just one sense of the word. Massive amounts of data are being collected through the expansion of technology, like mobile phones, social media, and the Internet of Things (IoT)--all as the field of data science surges in popularity. Being a data scientist was even crowned “the sexiest job of the 21st century”, adding it to the list...

Like Doctor Dolittle's famed pushmi-pullyu, enterprise data projects have a serious agility problem. A recent story comes to mind. I was on a call with prospective customer to request data feeds for an analytics project.  We had performed a successful trial project, the business case was approved by management and everyone was happy. At last, we were ready to go into production. We simply needed data feeds for...

It's a story as old as time. It's a story of evolution, a story of freedom.  And it's a story of stuffing a genie back into its bottle. Yes, I speak of the ancient enterprise battle royale:  Productivity vs. Control. These battles are constantly happening throughout the enterprise, usually with very good intentions.  But, like so many good intentions, they often pave the road to, um...