Data Features
Pipelines
Monitor BigQuery jobs, scheduled queries, and recurring queries. View run history, success rates, and execution details.
What Pipelines discovers
Datavine auto-discovers pipeline activity from BigQuery by reading job history and table metadata. It surfaces: BigQuery jobs, scheduled queries, recurring queries detected by pattern, and recently modified tables.
Required permissions
Full pipeline monitoring (run history, success rates, job IDs) requires bigquery.jobs.list permission. Without it, Datavine falls back to table metadata.
bash
# Grant the required permission
gcloud projects add-iam-policy-binding YOUR_PROJECT \
--member="serviceAccount:datavine-reader@YOUR_PROJECT.iam.gserviceaccount.com" \
--role="roles/bigquery.metadataViewer"Reading the pipeline view
Each pipeline card shows: status (running/success/failed), type, schedule (if applicable), last run time, success rate, and average duration. Click any pipeline to see its full run history, query SQL, and destination table details.