Drupal is a registered trademark of Dries Buytaert
drupal 11.3.7 Update released for Drupal core (11.3.7)! drupal 11.2.11 Update released for Drupal core (11.2.11)! drupal 10.6.7 Update released for Drupal core (10.6.7)! drupal 10.5.9 Update released for Drupal core (10.5.9)! cms 2.1.1 Update released for Drupal core (2.1.1)! drupal 11.3.6 Update released for Drupal core (11.3.6)! drupal 10.6.6 Update released for Drupal core (10.6.6)! cms 2.1.0 Update released for Drupal core (2.1.0)! bootstrap 8.x-3.40 Minor update available for theme bootstrap (8.x-3.40). menu_link_attributes 8.x-1.7 Minor update available for module menu_link_attributes (8.x-1.7). eca 3.1.1 Minor update available for module eca (3.1.1). layout_paragraphs 2.1.3 Minor update available for module layout_paragraphs (2.1.3). ai 1.3.3 Minor update available for module ai (1.3.3). ai 1.2.14 Minor update available for module ai (1.2.14). node_revision_delete 2.0.3 Minor update available for module node_revision_delete (2.0.3). moderated_content_bulk_publish 2.0.52 Minor update available for module moderated_content_bulk_publish (2.0.52). klaro 3.0.10 Minor update available for module klaro (3.0.10). klaro 3.0.9 Minor update available for module klaro (3.0.9). layout_paragraphs 2.1.2 Minor update available for module layout_paragraphs (2.1.2). geofield_map 11.1.8 Minor update available for module geofield_map (11.1.8).

data_pipelines

24 sites Security covered
View on drupal.org

Overview

Provides the ability to ingest, validate, transform and index (ElasticSearch) arbitrary datasets.

Features

  • Give content editors a place to update datasets
  • Support for CSV and JSON files
  • Support for CSV and JSON URLs
  • Developers can declare a pipeline which is a series of transforms and validation rules
  • Data is then transformed, validated and output to a destination
  • Default output destinations include JSON and CSV files

Configuration/Installation

  • Download and install the module like normal
  • Follow the readme to define a pipeline in YML
  • Visit /admin/content/datasets to add and manage datasets

Requirements

Requires the following modules:

Ecosystem

Destination plugins

https://www.drupal.org/project/data_pipelines_elasticsearch
https://www.drupal.org/project/data_pipelines_opensearch

Source plugins

https://www.drupal.org/project/data_pipelines_sftp

Known problems

Please use the issue queue to report issues.

Activity

Total releases
3
First release
Mar 2025
Latest release
1 year ago
Release cadence
6 days
Stability
67% stable

Release Timeline

Releases

Version Type Release date
2.2.0 Stable Mar 19, 2025
2.1.0 Stable Mar 17, 2025
2.x-dev Dev Mar 7, 2025