Terraform Module for Remote Executor Deployment on AWS ECS

Organizations using Terraform for infrastructure management need a Terraform-based alternative to the CloudFormation templates provided for deploying DataHub's Remote Executor on AWS ECS. The official documentation primarily references CloudFormation templates, which are not compatible with Terraform-based infrastructure workflows.

You Might Be Asking:

• Is there an official Terraform module for deploying the Remote Executor?
• Can I convert the CloudFormation templates to Terraform myself?
• Are the Terraform modules maintained and compatible with the latest Remote Executor versions?

DataHub provides an official, maintained Terraform module for Remote Executor deployment:

Official Terraform Module: - Repository: datahub-terraform-modules - Supports both Fargate and EC2 launch types - Kept up to date with Remote Executor changes - Recommended for production use

Usage Example:

module "remote_executor" {
  source = "github.com/acryldata/datahub-terraform-modules//remote-ingestion-executor"

  # Basic configuration
  cluster_name     = "datahub-executor-cluster"
  vpc_id          = var.vpc_id
  subnet_ids      = var.private_subnet_ids

  # Executor configuration
  datahub_gms_url = "https://your-datahub-instance.acryl.io"
  executor_id     = "remote-executor-1"

  # Resource allocation
  task_cpu        = "1024"
  task_memory     = "2048"

  # Launch type: "FARGATE" or "EC2"
  launch_type     = "FARGATE"
}

• Use the official module rather than converting CloudFormation templates manually to ensure compatibility
• The Terraform module is maintained by the Acryl Data team
• For customizations, fork the repository rather than modifying the module directly
• Ensure your AWS credentials have appropriate permissions for ECS, IAM, and networking resources

• Remote Executor Terraform Module
• Remote Executor Documentation

• 5620