Create data lineage across different data technologies

• Open source

• Data

GDPR, data lineage, impact assessment, and security scans are only a few situations where proper metadata handling can turn a month-long project into a simple query.

The talk is about the hidden gold stored in metadata: starting by defining use cases, we'll then focus on point solutions making metadata accessible for a precise technology. But companies' data efforts are rarely limited to a single tech, therefore we'll discuss how to design a system that collects, merges, and makes available metadata coming from different tools. Finally, we'll show an Open Source tool, the Aiven metadata parser, that can help harvest and query the metadata from a variety of different Open Source technologies.

If you want to programmatically keep control over your dynamic data assets, this session is for you!

Related resources

• Use Aiven's metadata parser to understand how your data flows