Amazon Kinesis Firehose Setup

Prerequisites

Tool or access	Purpose	Verify
Bash and Python 3	Run bundled setup and validation helpers	bash --version && python3 --version
Required product/platform access	Inspect or configure the selected target	Complete the documented preflight
Credential files for live modes	Keep secrets out of chat	Verify paths only

Workflow Overview

┌───────────┐   ┌───────────────┐   ┌───────────────┐   ┌─────────────────┐
│ Preflight │ → │ Render/review │ → │ Apply/handoff │ → │ Validate evidence │
└───────────┘   └───────────────┘   └───────────────┘   └─────────────────┘

When to Activate

• Send AWS Firehose data to Splunk.
• Preview and review the splunk amazon kinesis firehose setup workflow before any live apply phase.
• Diagnose failed prerequisites, generated assets, configuration, or validation evidence.

Scope

Follow the documented read-only or render-first path whenever it is available. This skill does not imply permission to mutate live systems. Require explicit apply flags, protected credentials, and operator review for state changes.

Examples

Inspect the supported setup modes before selecting one:

bash skills/splunk-amazon-kinesis-firehose-setup/scripts/setup.sh --help

Expected output: usage, supported modes, and required arguments are displayed without changing the target environment.

Inspect validation modes before running completion checks:

bash skills/splunk-amazon-kinesis-firehose-setup/scripts/validate.sh --help

Expected output: offline, live, and completion options are displayed when the skill supports them; help exits without mutation.

Troubleshooting

Issue	Cause	Resolution
Preflight fails	A required tool or access path is missing	Resolve it before rendering or applying
Rendered assets are incomplete	Required non-secret inputs are absent	Complete intake and render again
Apply is blocked	Review, credentials, or explicit acceptance is missing	Use the documented handoff
Validation is incomplete	Live evidence is unavailable	Record the gap and keep completion open

Render-first workflow for Amazon Kinesis Firehose delivery into Splunk HEC. The skill emits HEC handoffs, Firehose destination settings, IAM and backup stubs, delivery metric checks, validation SPL, and readiness evidence. It does not create HEC tokens, AWS resources, or Splunk indexes directly.

Workflow

bash skills/splunk-amazon-kinesis-firehose-setup/scripts/setup.sh --render \
  --index aws --hec-token-name aws_firehose_hec --source-profile cloudtrail \
  --s3-backup-bucket s3://example-firehose-backup --use-ack true

Review rendered firehose-destination-settings.json.template, iam-policy.stub.json, and install-commands.sh, then delegate HEC token work to splunk-hec-service-setup and AWS resource creation to the AWS owner.

Execute

Preview the executable Splunk-side plan:

bash skills/splunk-amazon-kinesis-firehose-setup/scripts/setup.sh --all \
  --platform enterprise --token-file /path/to/hec-token-file --dry-run --json

Apply the Splunk-side HEC/index setup and run local validation:

bash skills/splunk-amazon-kinesis-firehose-setup/scripts/setup.sh --all \
  --platform enterprise --token-file /path/to/hec-token-file

Use --platform cloud --write-token-file /path/to/output-token-file for the Cloud HEC token workflow. AWS Firehose delivery-stream creation remains an AWS owner handoff from the rendered templates.

bash skills/splunk-amazon-kinesis-firehose-setup/scripts/validate.sh \
  --rendered-dir splunk-amazon-kinesis-firehose-rendered --live

See reference.md for the strict Firehose source/sourcetype matching contract.