Modern data pipelines are more complex than traditional data warehousing pipelines. They must support a multiplicity of data sources, data types, and use cases; they must be designed and deployed in an agile manner; they must support batch, mini-batch, and streaming data flows, and, they must meet service level agreements for data quality, availability, and consistency.
Many organizations are turning to data catalogs to support modern data pipelines. Data catalogs can automate the tagging and organization of ingested content and derived data sets, harmonize data flowing through multiple new and existing pipelines, support data curation processes, and enable business users to explore content for analysis.
Join the webinar, hosted by Bloor Research and Collibra, to explore the role of data catalogs in managing modern data pipelines along with supplemental services.
Over the last few month’s our local (South African) DAMA chapter has been running a number of sessions discussing data modelling. Even in these days of “unstructured data” it seems that data modelling is needed more than ever. Why do[…]Read more...