Skip to content

DomainTools CCF 3.0.1: sessionID/top params, rate limit - #15151

Merged
v-atulyadav merged 2 commits into
Azure:masterfrom
RamboV:DomaintoolsCCF2
Sep 18, 2026
Merged

v-atulyadav merged 2 commits into
Azure:masterfrom
RamboV:DomaintoolsCCF2

Conversation

@RamboV

Copy link
Copy Markdown
Contributor

Change(s):

  • Bumped DomainTools CCF solution to 3.0.1 and updated Solutions/DomainTools CCF/ReleaseNotes.md.
  • Added sessionID and an optional top parameter in:
    • Solutions/DomainTools CCF/Data Connectors/DomainToolsFeedsLogs_ccf/DomainToolsFeedsLogs_connectorDefinition.json
    • Solutions/DomainTools CCF/Data Connectors/DomainToolsFeedsLogs_ccf/DomainToolsFeedsLogs_PollerConfig.json
    • Solutions/DomainTools CCF/Package/mainTemplate.json
  • Exposed only customer-configurable parameters: API Key, Feed Types, Session ID, Query Window in Minutes, and optional Top.
  • Kept connector-controlled parameters (after, before, fromBeginning) internal; after is no longer passed to the API.
  • Reduced rateLimitQPS to 1 and added rateLimitConfig to enforce DomainTools' 2 requests/minute limit with 429/Retry-After handling.
  • Switched feed requests/responses to NDJSON (Accept: application/x-ndjson, response.format: jsonl) for efficient streaming.
  • Repackaged Solutions/DomainTools CCF/Package/3.0.1.zip with the updated mainTemplate.json and createUiDefinition.json.

Reason for Change(s):

  • Align the connector with DomainTools real-time feed session semantics and the latest CCF RestApiPoller connection rules.
  • Avoid DomainTools API rate-limit errors by throttling to 2 requests/minute and respecting Retry-After headers.
  • Reduce ingestion overhead for high-volume domain feeds by consuming NDJSON line streams.
  • Simplify the user onboarding experience by hiding internal polling parameters and showing only the required user inputs.
  • Move to version 3.0.1.

Version Updated:

  • Yes. Updated to 3.0.1. The solution package version was bumped to 3.0.1 in Solutions/DomainTools CCF/SolutionMetadata.json, Solutions/DomainTools CCF/Data/Solution_DomainTools.json, and the package.

Testing Completed:

  • Yes.

Checked that the validations are passing and have addressed any issues that are present:

  • Yes.

@RamboV

Copy link
Copy Markdown
Contributor Author

Screenshots with successful deployment

Screenshot from 2026-09-17 20-05-51 Screenshot from 2026-09-17 20-08-32 Screenshot from 2026-09-17 20-08-53 Screenshot from 2026-09-17 20-26-50

@v-atulyadav
v-atulyadav requested a lite review from Copilot September 18, 2026 04:23

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note

Copilot was unable to run its full agentic suite in this review.

Pull request overview

Updates the DomainTools CCF solution to v3.0.1, adding session-based polling inputs and NDJSON streaming support while adjusting connector throttling behavior to better align with DomainTools API limits.

Changes:

  • Bumped solution/package versioning and updated release notes to 3.0.1.
  • Added customer-configurable parameters (feedTypes, sessionID, queryWindowInMin, optional top) and introduced per-feed conditional deployment.
  • Switched feed responses to NDJSON (jsonl) and added 429/Retry-After-aware rate limit handling.

Reviewed changes

Copilot reviewed 6 out of 7 changed files in this pull request and generated 7 comments.

Show a summary per file
File Description
Solutions/DomainTools CCF/ReleaseNotes.md Documents the 3.0.1 changes (new params, NDJSON, rate limiting).
Solutions/DomainTools CCF/Package/mainTemplate.json Bumps version, adds new parameters/UI wiring, per-feed connector conditions, NDJSON response format, and rate limit config.
Solutions/DomainTools CCF/Package/createUiDefinition.json Updates a user-facing description string for an analytic item.
Solutions/DomainTools CCF/Data/Solution_DomainTools.json Bumps solution version to 3.0.1.
Solutions/DomainTools CCF/Data Connectors/DomainToolsFeedsLogs_ccf/DomainToolsFeedsLogs_connectorDefinition.json Exposes new customer-configurable parameters in the connector UI step.
Solutions/DomainTools CCF/Data Connectors/DomainToolsFeedsLogs_ccf/DomainToolsFeedsLogs_PollerConfig.json Adds per-feed conditions, NDJSON response format, and 429-aware rate limit config.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread Solutions/DomainTools CCF/Package/mainTemplate.json
Comment thread Solutions/DomainTools CCF/Package/mainTemplate.json
Comment thread Solutions/DomainTools CCF/Package/mainTemplate.json
Comment thread Solutions/DomainTools CCF/Package/mainTemplate.json
Comment thread Solutions/DomainTools CCF/Package/createUiDefinition.json
@RamboV

Copy link
Copy Markdown
Contributor Author

Hi v-atulyadav,

Please review and merge.
Thanks

@v-maheshbh

Copy link
Copy Markdown
Contributor

Hi Rambatla Venkat Rao (@RamboV)

Please add the latest version at the top of the Release Notes and keep the comments concise.

Thanks!

@RamboV

Copy link
Copy Markdown
Contributor Author

Hi v-maheshbh (@v-maheshbh),

I have updated the Release Notes. Please review.
Thanks.

@v-atulyadav
v-atulyadav merged commit 14f5d1a into Azure:master Sep 18, 2026
33 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants