Pipeline Explorer
Follow six data pipelines from source to warehouse. Pull back to see their structure, then zoom in to read individual steps. Payments has a validation issue; Inventory has a slow lookup. Select either step to investigate and leave a note.
Daily pipeline snapshot6 pipelines · 30 steps · illustrative data
Detail ready- Source
- Validate
- Enrich
- Aggregate
- Publish
Payments validation needs review; Inventory enrichment is delayed. All other steps are healthy. The complete snapshot is also available in the table below.
Source●
- Output rows
- 24,816
- Batch latency
- 42 ms
- Fields
- 12
Validate●
- Fields
- 12
- Batch latency
- 70 ms
- Output rows
- 24,808
Source●
- Output rows
- 6,320
- Batch latency
- 59 ms
- Fields
- 12
Validate●
- Fields
- 12
- Batch latency
- 87 ms
- Output rows
- 6,309
Drag to pan · scroll or pinch to zoom. Focus the chart for + / − and Alt + arrow controls.
0 of 30 steps in viewSilhouettes → shapes → summaries → full detail
Trace and select all 73 connections
Illustrative metric wiring, not execution or record provenance. Containment adds no dependency. Selecting a connection traces only declared transfers of that metric.
Enter an owner to navigate its interfaces; Escape returns to the owner.
Select a connection to inspect its declared dependencies.
| ID | Source | Part / port | Target | Part / port | Evidence / attachment |
|---|---|---|---|---|---|
| step-0 | rows / out | step-1 | rows / in | Illustrative; unknown /exact geometry | |
| step-0 | latency / out | step-1 | latency / in | Illustrative; unknown /exact geometry | |
| step-0 | fields / out | step-1 | fields / in | Illustrative; unknown /exact geometry | |
| step-1 | rows / out | step-2 | rows / in | Illustrative; unknown /exact geometry | |
| step-1 | latency / out | step-2 | latency / in | Illustrative; unknown /exact geometry | |
| step-1 | fields / out | step-2 | fields / in | Illustrative; unknown /exact geometry | |
| step-2 | rows / out | step-3 | rows / in | Illustrative; unknown /exact geometry | |
| step-2 | latency / out | step-3 | latency / in | Illustrative; unknown /exact geometry | |
| step-2 | fields / out | step-3 | fields / in | Illustrative; unknown /exact geometry | |
| step-3 | rows / out | step-4 | rows / in | Illustrative; unknown /exact geometry | |
| step-3 | latency / out | step-4 | latency / in | Illustrative; unknown /exact geometry | |
| step-3 | fields / out | step-4 | fields / in | Illustrative; unknown /exact geometry | |
| step-5 | rows / out | step-6 | rows / in | Illustrative; unknown /exact geometry | |
| step-5 | latency / out | step-6 | latency / in | Illustrative; unknown /exact geometry | |
| step-5 | fields / out | step-6 | fields / in | Illustrative; unknown /exact geometry | |
| step-6 | rows / out | step-7 | rows / in | Illustrative; unknown /exact geometry | |
| step-6 | latency / out | step-7 | latency / in | Illustrative; unknown /exact geometry | |
| step-6 | fields / out | step-7 | fields / in | Illustrative; unknown /exact geometry | |
| step-7 | rows / out | step-8 | rows / in | Illustrative; unknown /exact geometry | |
| step-7 | latency / out | step-8 | latency / in | Illustrative; unknown /exact geometry | |
| step-7 | fields / out | step-8 | fields / in | Illustrative; unknown /exact geometry | |
| step-8 | rows / out | step-9 | rows / in | Illustrative; unknown /exact geometry | |
| step-8 | latency / out | step-9 | latency / in | Illustrative; unknown /exact geometry | |
| step-8 | fields / out | step-9 | fields / in | Illustrative; unknown /exact geometry | |
| step-10 | rows / out | step-11 | rows / in | Illustrative; unknown /exact geometry | |
| step-10 | latency / out | step-11 | latency / in | Illustrative; unknown /exact geometry | |
| step-10 | fields / out | step-11 | fields / in | Illustrative; unknown /exact geometry | |
| step-11 | rows / out | step-12 | rows / in | Illustrative; unknown /exact geometry | |
| step-11 | latency / out | step-12 | latency / in | Illustrative; unknown /exact geometry | |
| step-11 | fields / out | step-12 | fields / in | Illustrative; unknown /exact geometry | |
| step-12 | rows / out | step-13 | rows / in | Illustrative; unknown /exact geometry | |
| step-12 | latency / out | step-13 | latency / in | Illustrative; unknown /exact geometry | |
| step-12 | fields / out | step-13 | fields / in | Illustrative; unknown /exact geometry | |
| step-13 | rows / out | step-14 | rows / in | Illustrative; unknown /exact geometry | |
| step-13 | latency / out | step-14 | latency / in | Illustrative; unknown /exact geometry | |
| step-13 | fields / out | step-14 | fields / in | Illustrative; unknown /exact geometry | |
| step-15 | rows / out | step-16 | rows / in | Illustrative; unknown /exact geometry | |
| step-15 | latency / out | step-16 | latency / in | Illustrative; unknown /exact geometry | |
| step-15 | fields / out | step-16 | fields / in | Illustrative; unknown /exact geometry | |
| step-16 | rows / out | step-17 | rows / in | Illustrative; unknown /exact geometry | |
| step-16 | latency / out | step-17 | latency / in | Illustrative; unknown /exact geometry | |
| step-16 | fields / out | step-17 | fields / in | Illustrative; unknown /exact geometry | |
| step-17 | rows / out | step-18 | rows / in | Illustrative; unknown /exact geometry | |
| step-17 | latency / out | step-18 | latency / in | Illustrative; unknown /exact geometry | |
| step-17 | fields / out | step-18 | fields / in | Illustrative; unknown /exact geometry | |
| step-18 | rows / out | step-19 | rows / in | Illustrative; unknown /exact geometry | |
| step-18 | latency / out | step-19 | latency / in | Illustrative; unknown /exact geometry | |
| step-18 | fields / out | step-19 | fields / in | Illustrative; unknown /exact geometry | |
| step-20 | rows / out | step-21 | rows / in | Illustrative; unknown /exact geometry | |
| step-20 | latency / out | step-21 | latency / in | Illustrative; unknown /exact geometry | |
| step-20 | fields / out | step-21 | fields / in | Illustrative; unknown /exact geometry | |
| step-21 | rows / out | step-22 | rows / in | Illustrative; unknown /exact geometry | |
| step-21 | latency / out | step-22 | latency / in | Illustrative; unknown /exact geometry | |
| step-21 | fields / out | step-22 | fields / in | Illustrative; unknown /exact geometry | |
| step-22 | rows / out | step-23 | rows / in | Illustrative; unknown /exact geometry | |
| step-22 | latency / out | step-23 | latency / in | Illustrative; unknown /exact geometry | |
| step-22 | fields / out | step-23 | fields / in | Illustrative; unknown /exact geometry | |
| step-23 | rows / out | step-24 | rows / in | Illustrative; unknown /exact geometry | |
| step-23 | latency / out | step-24 | latency / in | Illustrative; unknown /exact geometry | |
| step-23 | fields / out | step-24 | fields / in | Illustrative; unknown /exact geometry | |
| step-25 | rows / out | step-26 | rows / in | Illustrative; unknown /exact geometry | |
| step-25 | latency / out | step-26 | latency / in | Illustrative; unknown /exact geometry | |
| step-25 | fields / out | step-26 | fields / in | Illustrative; unknown /exact geometry | |
| step-26 | rows / out | step-27 | rows / in | Illustrative; unknown /exact geometry | |
| step-26 | latency / out | step-27 | latency / in | Illustrative; unknown /exact geometry | |
| step-26 | fields / out | step-27 | fields / in | Illustrative; unknown /exact geometry | |
| step-27 | rows / out | step-28 | rows / in | Illustrative; unknown /exact geometry | |
| step-27 | latency / out | step-28 | latency / in | Illustrative; unknown /exact geometry | |
| step-27 | fields / out | step-28 | fields / in | Illustrative; unknown /exact geometry | |
| step-28 | rows / out | step-29 | rows / in | Illustrative; unknown /exact geometry | |
| step-28 | latency / out | step-29 | latency / in | Illustrative; unknown /exact geometry | |
| step-28 | fields / out | step-29 | fields / in | Illustrative; unknown /exact geometry | |
| step-0 | rows / out | step-1 | rows / in | Illustrative; unknown /exact geometry |
Existing record nodes
These illustrative records keep their original node IDs. They need no synthetic field or port conversion.
Camera settings
Fit, Focus step and Reset respect these bounds and locks.
Read all 30 steps as a table
| Pipeline | Stage | Status | Output rows | Fields | Batch latency |
|---|---|---|---|---|---|
| Orders | Source | Healthy | 24,816 | 12 | 42 ms |
| Orders | Validate | Healthy | 24,808 | 12 | 70 ms |
| Orders | Enrich | Healthy | 24,808 | 16 | 98 ms |
| Orders | Aggregate | Healthy | 15,380 | 6 | 126 ms |
| Orders | Publish | Healthy | 15,380 | 6 | 154 ms |
| Customers | Source | Healthy | 6,320 | 12 | 59 ms |
| Customers | Validate | Healthy | 6,309 | 12 | 87 ms |
| Customers | Enrich | Healthy | 6,309 | 16 | 115 ms |
| Customers | Aggregate | Healthy | 3,911 | 6 | 143 ms |
| Customers | Publish | Healthy | 3,911 | 6 | 171 ms |
| Payments | Source | Healthy | 18,364 | 12 | 76 ms |
| Payments | Validate | Review | 18,268 | 12 | 104 ms |
| Payments | Enrich | Healthy | 18,268 | 16 | 132 ms |
| Payments | Aggregate | Healthy | 11,326 | 6 | 160 ms |
| Payments | Publish | Healthy | 11,326 | 6 | 188 ms |
| Inventory | Source | Healthy | 9,840 | 12 | 93 ms |
| Inventory | Validate | Healthy | 9,823 | 12 | 121 ms |
| Inventory | Enrich | Delayed | 9,823 | 16 | 980 ms |
| Inventory | Aggregate | Healthy | 6,090 | 6 | 177 ms |
| Inventory | Publish | Healthy | 6,090 | 6 | 205 ms |
| Shipments | Source | Healthy | 4,386 | 12 | 110 ms |
| Shipments | Validate | Healthy | 4,366 | 12 | 138 ms |
| Shipments | Enrich | Healthy | 4,366 | 16 | 166 ms |
| Shipments | Aggregate | Healthy | 2,706 | 6 | 194 ms |
| Shipments | Publish | Healthy | 2,706 | 6 | 222 ms |
| Events | Source | Healthy | 76,820 | 12 | 127 ms |
| Events | Validate | Healthy | 76,797 | 12 | 155 ms |
| Events | Enrich | Healthy | 76,797 | 16 | 183 ms |
| Events | Aggregate | Healthy | 47,614 | 6 | 211 ms |
| Events | Publish | Healthy | 47,614 | 6 | 239 ms |
A map, at any scale
Start with Fit to see all six pipelines. Zoom in around your pointer, drag to explore, or select any step and use Focus step. The minimap follows the same visible window.
Detail when it helps
At a distance, text gives way to silhouettes and skeletons. Summaries appear as cards grow; full detail returns when movement settles. A focused editor keeps its detail.
Keep your place
A selected card stays mounted. Notes also live outside the virtualized cards, so they survive a trip across the graph. They are local to this page and are cleared on reload.
For a smaller introduction to parts, ports and parallel wiring, try theCompositional DAGs example.
This is an illustrative snapshot, not a live monitoring service. The Full Code view includes the data, layout, cards, minimap and styles. See thecustom-layout guide for the optionalsemiotic/network/zoom API, camera constraints and projected-size hooks.