Data First (Part 2): The Spec Is In The Data 

If you’re getting ready to start a new integration, application, or analysis project, you’re probably doing all kinds of requirements gathering. Unfortunately, unless you’re considering data first, the copy books are probably wrong, the state diagrams are probably incomplete, and the business processes are probably too simplistic. These problems are extremely prevalent in data-centric projects. Traditionally, you use a data last method—you build up the specification a priori, and only…

The Nexus of Big Data: Context

  Big data has a big problem. You know that data lake you recently started filling? Its data ecosystem is already well on its way to a catastrophic tipping point. Has a platform vendor convinced you to dive in with visions of a serene data-lake-side cabin in the woods? They probably forgot to mention how many horror stories have the same setting. Don’t hold a grudge. Vendors were just responding…

Data First: Never Trust A Dashboard

A friend of mine recently asked me for advice on interviewing a data scientist. We had a fairly lengthy discussion on the topic, but I didn’t feel like I really provided any insight. What I should have said is: “Ask them what they think of dashboards.” Summary tools like dashboards are great. They make it easy for us to consume and extract meaning from large amounts of data. They are…