A great discussion of the reality of data lakes, data warehouses and how the future is distributed.

I’m picking some points from the discussion, but I have really liked what is said here.  The participants approach the topics with great practicality devoid of the overly rosy sales discussions.

  • The data lake is not a full data integration, it’s just one level of refinement.
  • The data warehouse is not the center anymore, the future is distributed. The amount of data outside the data warehouse is bigger than what’s stored inside.
  • Most companies have accidental data architectures. Now they need to remodel their data architectures looking for synergies between different systems.
  • The data warehouse, the data lakes, and analytics; all of it needs DataOps.

https://www.eckerson.com/articles/daniel-graham-data-lakes-vs-data-warehouses

#DataLake #DataWarehouse #Analytics #BigData

Meshing into the future…

I wanted to start this blog as a way to combat the formula obsessed, corporate zealots that infect most workplaces.  Those who declare that this is the way we have always done it or hand out large leviathans of consultant created fluff as their own ideas.

I think success comes from listening to your colleagues and meshing your ideas of success and useful technologies for a better future.  If someone can use Excel to create a better retention model than your best data scientists, let’s hear it out and move forward.  Let the marketplace of ideas rule and mesh ourselves into the best that we can be rather than close ourselves off to the unknown or less polished.

I may not be alone.

https://www.linkedin.com/pulse/meshing-why-trends-predictions-out-window-dilan-rajasingham/

#Analytics #BigData