A great discussion of the reality of data lakes, data warehouses and how the future is distributed.

I’m picking some points from the discussion, but I have really liked what is said here.  The participants approach the topics with great practicality devoid of the overly rosy sales discussions.

  • The data lake is not a full data integration, it’s just one level of refinement.
  • The data warehouse is not the center anymore, the future is distributed. The amount of data outside the data warehouse is bigger than what’s stored inside.
  • Most companies have accidental data architectures. Now they need to remodel their data architectures looking for synergies between different systems.
  • The data warehouse, the data lakes, and analytics; all of it needs DataOps.

https://www.eckerson.com/articles/daniel-graham-data-lakes-vs-data-warehouses

#DataLake #DataWarehouse #Analytics #BigData

Decentralized AI and the rise of the edge

Watch for some of these new models to drive growth.

“Over the next year we will see new businesses forming to compete for the ideal “edge” solution – whether it’s through browsers, such as Brave; Apple’s use of differential privacy; set-top boxes and home gateways, such as the Databox platform (with which one of us Hamed Haddadi is involved); or personal microservers, such as Hub-of-All-Things (of which the author Irene Ng is the creator).”

https://www.wired.co.uk/article/decentralised-artificial-intelligence

#AI

Meshing into the future…

I wanted to start this blog as a way to combat the formula obsessed, corporate zealots that infect most workplaces.  Those who declare that this is the way we have always done it or hand out large leviathans of consultant created fluff as their own ideas.

I think success comes from listening to your colleagues and meshing your ideas of success and useful technologies for a better future.  If someone can use Excel to create a better retention model than your best data scientists, let’s hear it out and move forward.  Let the marketplace of ideas rule and mesh ourselves into the best that we can be rather than close ourselves off to the unknown or less polished.

I may not be alone.

https://www.linkedin.com/pulse/meshing-why-trends-predictions-out-window-dilan-rajasingham/

#Analytics #BigData