Cloud.Service.AWS.Kinesis.Firehose.Delivery.Stream

Cloud.Service.AWS.Kinesis.Firehose.Delivery.Stream
Cloud.Service.AWS.Kinesis.Firehose.Delivery.Stream
JSON Example
{
    "arn": "string",
    "destination": "string",
    "destination_id": "string",
    "elasticsearch_configuration": [
        {
            "buffering_interval": 0,
            "buffering_size": 0,
            "cloudwatch_logging_options": [
                {
                    "enabled": false,
                    "log_group_name": "string",
                    "log_stream_name": "string"
                }
            ],
            "domain_arn": "string",
            "index_name": "string",
            "index_rotation_period": "string",
            "processing_configuration": [
                {
                    "enabled": false,
                    "processors": [
                        {
                            "parameters": [
                                {
                                    "parameter_name": "string",
                                    "parameter_value": "string"
                                }
                            ],
                            "type": "string"
                        }
                    ]
                }
            ],
            "retry_duration": 0,
            "role_arn": "string",
            "s3_backup_mode": "string",
            "type_name": "string"
        }
    ],
    "extended_s3_configuration": [
        {
            "bucket_arn": "string",
            "buffer_interval": 0,
            "buffer_size": 0,
            "cloudwatch_logging_options": [
                {
                    "enabled": false,
                    "log_group_name": "string",
                    "log_stream_name": "string"
                }
            ],
            "compression_format": "string",
            "data_format_conversion_configuration": [
                {
                    "enabled": false,
                    "input_format_configuration": [
                        {
                            "deserializer": [
                                {
                                    "hive_json_ser_de": [
                                        {
                                            "timestamp_formats": [
                                                "string"
                                            ]
                                        }
                                    ],
                                    "open_x_json_ser_de": [
                                        {
                                            "case_insensitive": false,
                                            "convert_dots_in_json_keys_to_underscores": false
                                        }
                                    ]
                                }
                            ]
                        }
                    ],
                    "output_format_configuration": [
                        {
                            "serializer": [
                                {
                                    "orc_ser_de": [
                                        {
                                            "block_size_bytes": 0,
                                            "bloom_filter_columns": [
                                                "string"
                                            ],
                                            "bloom_filter_false_positive_probability": "number",
                                            "compression": "string",
                                            "dictionary_key_threshold": "number",
                                            "enable_padding": false,
                                            "format_version": "string",
                                            "padding_tolerance": "number",
                                            "row_index_stride": 0,
                                            "stripe_size_bytes": 0
                                        }
                                    ],
                                    "parquet_ser_de": [
                                        {
                                            "block_size_bytes": 0,
                                            "compression": "string",
                                            "enable_dictionary_compression": false,
                                            "max_padding_bytes": 0,
                                            "page_size_bytes": 0,
                                            "writer_version": "string"
                                        }
                                    ]
                                }
                            ]
                        }
                    ],
                    "schema_configuration": [
                        {
                            "catalog_id": "string",
                            "database_name": "string",
                            "region": "string",
                            "role_arn": "string",
                            "table_name": "string",
                            "version_id": "string"
                        }
                    ]
                }
            ],
            "kms_key_arn": "string",
            "prefix": "string",
            "processing_configuration": [
                {
                    "enabled": false,
                    "processors": [
                        {
                            "parameters": [
                                {
                                    "parameter_name": "string",
                                    "parameter_value": "string"
                                }
                            ],
                            "type": "string"
                        }
                    ]
                }
            ],
            "role_arn": "string",
            "s3_backup_configuration": [
                {
                    "bucket_arn": "string",
                    "buffer_interval": 0,
                    "buffer_size": 0,
                    "cloudwatch_logging_options": [
                        {
                            "enabled": false,
                            "log_group_name": "string",
                            "log_stream_name": "string"
                        }
                    ],
                    "compression_format": "string",
                    "kms_key_arn": "string",
                    "prefix": "string",
                    "role_arn": "string"
                }
            ],
            "s3_backup_mode": "string"
        }
    ],
    "kinesis_source_configuration": [
        {
            "kinesis_stream_arn": "string",
            "role_arn": "string"
        }
    ],
    "name": "string",
    "provider": "string",
    "provider_region": "string",
    "redshift_configuration": [
        {
            "cloudwatch_logging_options": [
                {
                    "enabled": false,
                    "log_group_name": "string",
                    "log_stream_name": "string"
                }
            ],
            "cluster_jdbcurl": "string",
            "copy_options": "string",
            "data_table_columns": "string",
            "data_table_name": "string",
            "password": "string",
            "processing_configuration": [
                {
                    "enabled": false,
                    "processors": [
                        {
                            "parameters": [
                                {
                                    "parameter_name": "string",
                                    "parameter_value": "string"
                                }
                            ],
                            "type": "string"
                        }
                    ]
                }
            ],
            "retry_duration": 0,
            "role_arn": "string",
            "s3_backup_configuration": [
                {
                    "bucket_arn": "string",
                    "buffer_interval": 0,
                    "buffer_size": 0,
                    "cloudwatch_logging_options": [
                        {
                            "enabled": false,
                            "log_group_name": "string",
                            "log_stream_name": "string"
                        }
                    ],
                    "compression_format": "string",
                    "kms_key_arn": "string",
                    "prefix": "string",
                    "role_arn": "string"
                }
            ],
            "s3_backup_mode": "string",
            "username": "string"
        }
    ],
    "s3_configuration": [
        {
            "bucket_arn": "string",
            "buffer_interval": 0,
            "buffer_size": 0,
            "cloudwatch_logging_options": [
                {
                    "enabled": false,
                    "log_group_name": "string",
                    "log_stream_name": "string"
                }
            ],
            "compression_format": "string",
            "kms_key_arn": "string",
            "prefix": "string",
            "role_arn": "string"
        }
    ],
    "splunk_configuration": [
        {
            "cloudwatch_logging_options": [
                {
                    "enabled": false,
                    "log_group_name": "string",
                    "log_stream_name": "string"
                }
            ],
            "hec_acknowledgment_timeout": 0,
            "hec_endpoint": "string",
            "hec_endpoint_type": "string",
            "hec_token": "string",
            "processing_configuration": [
                {
                    "enabled": false,
                    "processors": [
                        {
                            "parameters": [
                                {
                                    "parameter_name": "string",
                                    "parameter_value": "string"
                                }
                            ],
                            "type": "string"
                        }
                    ]
                }
            ],
            "retry_duration": 0,
            "s3_backup_mode": "string"
        }
    ],
    "version_id": "string"
}
string
arn
Optional

The Amazon Resource Name (ARN) assigned by AWS to the stream.

string
destination
Required

(Required) Where the data is delivered: s3 (deprecated in favor of extended_s3), extended_s3, redshift, elasticsearch, and splunk.

string
destination_id
Optional

Unique identifier of the destination of the delivery stream.

array of object
elasticsearch_configuration
Optional

Settings for AWS Elasticsearch (ES) indexing.

array of object
extended_s3_configuration
Optional

Enhanced settings for extended S3 destinations.

array of object
kinesis_source_configuration
Optional

Settings for the Kinesis stream that is the source of the Firehose delivery stream.

string
name
Required

(Required) Name of the stream.

string
provider
Required

(Required) The name of the AWS cloud account to use for this resource

string
provider_region
Required

(Required) Target cloud region, such as us-east-1. Must be within the provider cloud account.

array of object
redshift_configuration
Optional

Settings for Amazon Redshift destinations.

array of object
s3_configuration
Optional

Settings for S3 destinations. (Deprecated in favor of extended_s3_configuration unless the destination is redshift.)

array of object
splunk_configuration
Optional

Settings for Splunk destinations.

string
version_id
Optional

Table version for the output data schema. Default is LATEST.