List Pipelines

Overview

Retrieve a list of all pipelines associated with the authenticated customer. Each pipeline includes its jobs and current status.

Authentication

This endpoint requires authentication. The customer_id is extracted from the authentication token.

Example

List All Pipelines

GET /platform/pipelines

Response (200 OK):

[
  {
    "id": 1,
    "pipeline_id": "1b33ad2f_33d3_4837_9eeb_83c82c8b909d",
    "customer_id": "acme_corp",
    "user_id": "[email protected]",
    "name": "Orders Data Pipeline",
    "description": "Daily extraction of orders data from PostgreSQL",
    "cron": "0 6 * * *",
    "last_status": "SUCCESS",
    "jobs": [
      {
        "id": 1,
        "job_id": "1b33ad2f_33d3_4837_9eeb_83c82c8b909d_0",
        "job_status": "SUCCESS",
        "input": {
          "connector": "jdbc",
          "plugin": "postgresql",
          "table_name": "orders"
        },
        "output": {
          "plugin": "dadosfera_snowflake",
          "raw": {
            "table_name": "orders",
            "table_schema": "RAW_DATA"
          }
        }
      }
    ]
  },
  {
    "id": 2,
    "pipeline_id": "a9f82c14_7e21_4b5a_8c9d_12345abcdef0",
    "customer_id": "acme_corp",
    "user_id": "[email protected]",
    "name": "HubSpot Contacts Pipeline",
    "description": "Sync contacts from HubSpot",
    "cron": "0 */6 * * *",
    "last_status": "CREATED",
    "jobs": [
      {
        "id": 2,
        "job_id": "a9f82c14_7e21_4b5a_8c9d_12345abcdef0_0",
        "job_status": "PENDING",
        "input": {
          "connector": "singer",
          "plugin": "hubspot",
          "table_name": "contacts"
        },
        "output": {
          "plugin": "dadosfera_snowflake",
          "raw": {
            "table_name": "hubspot_contacts",
            "table_schema": "RAW_DATA"
          }
        }
      }
    ]
  }
]

Response Structure

Pipeline Object

Field	Type	Description
`id`	integer	Internal database ID
`pipeline_id`	string	Unique pipeline identifier
`customer_id`	string	Customer identifier
`user_id`	string	User who created the pipeline
`name`	string	Pipeline display name
`description`	string	Pipeline description
`cron`	string	Cron schedule expression (null for manual)
`last_status`	string	Last execution status
`jobs`	array	List of jobs in the pipeline

Job Object

Field	Type	Description
`id`	integer	Internal database ID
`job_id`	string	Unique job identifier
`job_status`	string	Current job status
`input`	object	Job input configuration
`output`	object	Job output configuration
`memory_allocated_mb`	integer	Memory allocation (if set)

Pipeline Status Values

Status	Description
`PENDING`	Pipeline created, waiting for first execution
`CREATED`	Pipeline ready for execution
`RUNNING`	Pipeline currently executing
`SUCCESS`	Last execution completed successfully
`FAILED`	Last execution failed

Error Responses

500 Internal Server Error

{
  "msg": "There was an error retrieving the pipelines.",
  "error": "Database connection error"
}

Notes

Returns an empty array [] if no pipelines exist for the customer
Pipelines are returned with their associated jobs using eager loading
For detailed information about a specific pipeline, use GET /platform/pipeline/:pipelineId