While Data Lakes have allowed us to generate analytics on a scale that was hitherto impossible, they have also brought with them many challenges, particularly in relation to the ownership, quality and understanding of data. In the financial services context, there has been the additional challenge of establishing and maintaining ‘Chinese walls’ to keep data visible only to people who should see it.
Data Meshes promise to solve some of these problems, moving away from the inherent challenges of data management in centralised lakes and warehouses. But with current open-source tooling, how easy is it *really* to head towards a Data Mesh?
In this talk, Andrew Carr will explore what challenges you’re likely to face, but also what’s feasible to achieve now while the tooling catches up with this new paradigm.
This talk is part of the Open Source in Fintech Event Series organised in partnership by Scott Logic and FINOS. As soon as it is safe to do so, we will host live events again. If you're not already a member, please join one of our groups to be the first to know when new events are scheduled:
Edinburgh – http://bit.ly/eosfm
London – http://bit.ly/losfm
Bristol – http://bit.ly/bosfm