Drupal is a registered trademark of Dries Buytaert
cms 2.1.3 — Update released for Drupal core (2.1.3)! drupal 10.5.11 — Update released for Drupal core (10.5.11)! drupal 11.3.11 — Update released for Drupal core (11.3.11)! drupal 11.2.13 — Update released for Drupal core (11.2.13)! drupal 10.6.10 — Update released for Drupal core (10.6.10)! cms 2.1.2 — Update released for Drupal core (2.1.2)! drupal 11.1.10 — Update released for Drupal core (11.1.10)! drupal 10.5.10 — Update released for Drupal core (10.5.10)! drupal 10.4.10 — Update released for Drupal core (10.4.10)! drupal 11.2.12 — Update released for Drupal core (11.2.12)! drupal 11.3.10 — Update released for Drupal core (11.3.10)! drupal 10.6.9 — Update released for Drupal core (10.6.9)! drupal 10.6.8 — Update released for Drupal core (10.6.8)! drupal 11.3.9 — Update released for Drupal core (11.3.9)! drupal 11.3.8 — Update released for Drupal core (11.3.8)! drupal 11.3.7 — Update released for Drupal core (11.3.7)! drupal 11.2.11 — Update released for Drupal core (11.2.11)! drupal 10.6.7 — Update released for Drupal core (10.6.7)! drupal 10.5.9 — Update released for Drupal core (10.5.9)! cms 2.1.1 — Update released for Drupal core (2.1.1)!
← All modules

data_pipelines

26 sites Security covered
View on drupal.org

Overview

Provides the ability to ingest, validate, transform and index (ElasticSearch) arbitrary datasets.

Features

  • Give content editors a place to update datasets
  • Support for CSV and JSON files
  • Support for CSV and JSON URLs
  • Developers can declare a pipeline which is a series of transforms and validation rules
  • Data is then transformed, validated and output to a destination
  • Default output destinations include JSON and CSV files

Configuration/Installation

  • Download and install the module like normal
  • Follow the readme to define a pipeline in YML
  • Visit /admin/content/datasets to add and manage datasets

Requirements

Requires the following modules:

Ecosystem

Destination plugins

https://www.drupal.org/project/data_pipelines_elasticsearch
https://www.drupal.org/project/data_pipelines_opensearch

Source plugins

https://www.drupal.org/project/data_pipelines_sftp

Known problems

Please use the issue queue to report issues.

Activity

Total releases
3
First release
Mar 2025
Latest release
1 year ago
Release cadence
6 days
Stability
67% stable

Release Timeline

Releases

Version Type Release date
2.2.0 Stable Mar 19, 2025
2.1.0 Stable Mar 17, 2025
2.x-dev Dev Mar 7, 2025