How to integrate with modern data tools?

[davidgasquez]

Would be awesome to have default integrations with dbt (e.g. Datadex).

[davidgasquez]

Thinking about this a bit different now.

Datadex (dbt, Dagster, DuckDB) is the project that collects and massages the raw data. As a final step, it produces the Frictionless packages among other materializations.

Each organization/community will have their own Datadex or Data Portals from which they collect and publish datasets.

[davidgasquez]

This is not a great question as it is too generic. My current view is:

• Each community will have its project (Datadex style) that produces their desired artifacts. These artifacts should integrate the learnings and tools of the "Modern Data Stack" if that helps the community.
• Those artifacts conform to certain standards (datapackage.json).
• There is a service that understant these standards / protocols and serve as a registry.

These are all ortogonal to each other and not all projects will have them all.

So, 3 big problems:

• Generating Open Data
• Packaging Open Data
• Distributing Open Data