What is a data pipeline?
LINKS
- CIFL post: WTF is a data pipeline?
We refer to a "data pipeline" as a combination of:
- Raw data feeds (from Google Analytics or other APIs)
- A data warehouse (we prefer BigQuery)
- SQL data models (written in dbt) that run the necessarily analysis in your warehouse
- Data visualizations, that read the modeled data in your warehouse
The pipeline encompasses this entire ecosystem, from raw data through to visualizations.