bin: generate YAML configuration from CLI options

[edsiper]

Problem

Fluent Bit command-line pipelines cannot currently be exported as reusable YAML configuration. Reconstructing configurations by hand is error-prone, especially with repeated inputs, filters, outputs, and scoped plugin properties.

Changes

• add -G / --generate-config to emit YAML to stdout and exit
• preserve service settings, customs, repeated pipeline components, scoped properties, tags, matches, external plugins, and stream processor tasks
• quote YAML keys and values and escape control characters
• reject command-line state that cannot be represented portably (--config, --workdir, and startup trace options)
• add runtime-shell and Python integration coverage, including executing a generated pipeline

Example

fluent-bit -i tail -p path=/var/log/app.log -o stdout -G

pipeline:
  inputs:
    - "name": "tail"
      "path": "/var/log/app.log"
  outputs:
    - "name": "stdout"

Verification

• cmake --build build -j8 --target fluent-bit-bin
• ctest --test-dir build -R "^generate_config.sh$" --output-on-failure
• tests/integration/.venv/bin/python -m pytest tests/integration/scenarios/cli_config_generation/tests/test_cli_config_generation.py -q
• VALGRIND=1 VALGRIND_STRICT=1 tests/integration/.venv/bin/python -m pytest tests/integration/scenarios/cli_config_generation/tests/test_cli_config_generation.py -q
• GITHUB_EVENT_NAME=pull_request GITHUB_BASE_REF=master .venv/bin/python .github/scripts/commit_prefix_check.py

Compatibility

-Y remains unchanged as the hot-reload option. The new short option is -G. Existing runtime behavior is unchanged unless generation is explicitly requested.

[coderabbitai]

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

• Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}