Skip to content

feat(docs): Multiple datasets#2228

Open
valekjo wants to merge 30 commits intomasterfrom
feature/multiple-datasets
Open

feat(docs): Multiple datasets#2228
valekjo wants to merge 30 commits intomasterfrom
feature/multiple-datasets

Conversation

@valekjo
Copy link
Member

@valekjo valekjo commented Feb 5, 2026

The feature is now supported in both SDKs and API docs is out - we can finally publish the respective section in docs :)

@github-actions github-actions bot added this to the 133rd sprint - Console team milestone Feb 5, 2026
@github-actions github-actions bot added the t-console Issues with this label are in the ownership of the console team. label Feb 5, 2026
@apify-service-account
Copy link

Preview for this PR was built for commit 93a1efe and is ready at https://pr-2228.preview.docs.apify.com!

@apify-service-account
Copy link

Preview for this PR was built for commit 29d954f and is ready at https://pr-2228.preview.docs.apify.com!

@apify-service-account
Copy link

Preview for this PR was built for commit 9bd61b87 and is ready at https://pr-2228.preview.docs.apify.com!

@apify-service-account
Copy link

Preview for this PR was built for commit dbf37acf and is ready at https://pr-2228.preview.docs.apify.com!

@apify-service-account
Copy link

Preview for this PR was built for commit da0b5f0f and is ready at https://pr-2228.preview.docs.apify.com!

@apify-service-account
Copy link

Preview for this PR was built for commit 97effaca and is ready at https://pr-2228.preview.docs.apify.com!

@apify-service-account
Copy link

Preview for this PR was built for commit 652317c4 and is ready at https://pr-2228.preview.docs.apify.com!

@valekjo valekjo force-pushed the feature/multiple-datasets branch from 652317c to 97effac Compare March 5, 2026 08:58
@apify-service-account
Copy link

Preview for this PR was built for commit 97effaca and is ready at https://pr-2228.preview.docs.apify.com!

@danpoletaev danpoletaev force-pushed the feature/multiple-datasets branch from 97effac to bf23549 Compare March 6, 2026 21:56
@apify-service-account
Copy link

Preview for this PR was built for commit bf23549c and is ready at https://pr-2228.preview.docs.apify.com!

@metalwarrior665 metalwarrior665 force-pushed the feature/multiple-datasets branch from bf23549 to 97effac Compare March 7, 2026 00:02
@apify-service-account
Copy link

Preview for this PR was built for commit 97effaca and is ready at https://pr-2228.preview.docs.apify.com!

@apify-service-account
Copy link

Preview for this PR was built for commit c0dd0c4b and is ready at https://pr-2228.preview.docs.apify.com!

@valekjo valekjo requested a review from janbuchar March 12, 2026 08:49
@valekjo valekjo requested a review from TC-MO March 12, 2026 14:20
@apify-service-account
Copy link

Preview for this PR was built for commit 1b23702d and is ready at https://pr-2228.preview.docs.apify.com!

@TC-MO
Copy link
Contributor

TC-MO commented Mar 12, 2026

@valekjo no worries! A lot of those can be now caught using our review skill for Claude-code (we might enhance them to be agent agnostic, but for now it's Claude-centric)

@TC-MO
Copy link
Contributor

TC-MO commented Mar 12, 2026

I'll make another pass that focus more on the doc itself later today instead of low-hanging fruits

- Update the documentation to clarify the use of multiple datasets in Actors, including definitions, requirements, and access methods
- Update explanations of aliases versus named datasets and billing implications
Copy link

@jgagne jgagne left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks great. Consider the edits in the commit(s) from this review.

@valekjo valekjo requested a review from jgagne March 13, 2026 15:37
**Requirements:**

- The `datasets` object must contain the `default` alias
- The `datasets` and `dataset` objects are mutually exclusive (use one or the other)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It'd be great to link the actor.json reference from here so that the reader can understand the difference between dataset and datasets better.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you mean the reference from docs or the publicly available schema files?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The reference in the docs


### Environment variable

Access the environment variable directly without the SDK:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe elaborate a bit what this will do (give you a dataset ID)

Comment on lines +102 to +111
"products": {
"type": "string",
"title": "Products",
"template": "{{storages.datasets.default.apiUrl}}/items"
},
"categories": {
"type": "string",
"title": "Categories",
"template": "{{storages.datasets.categories.apiUrl}}/items"
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So... what does this (mainly the template field) actually do?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That should be clear from the output schema docs. Basically, this will show a dropdown (or tabs) in the Actor run Output tab, with "Products" and "Categories", and if the datasets also have some views defined, the users can switch between those too.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bold of you to assume that the reader saw and understood that 🙂 Maybe you could add a link to the "How templates work" section?

Copy link
Contributor

@TC-MO TC-MO left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Second pass done focusing more on the document itself instead of low-hanging fruits.

valekjo and others added 9 commits March 18, 2026 12:14
…chema/multiple_datasets.md

Co-authored-by: Michał Olender <92638966+TC-MO@users.noreply.github.com>
…chema/multiple_datasets.md

Co-authored-by: Michał Olender <92638966+TC-MO@users.noreply.github.com>
…chema/multiple_datasets.md

Co-authored-by: Michał Olender <92638966+TC-MO@users.noreply.github.com>
…chema/multiple_datasets.md

Co-authored-by: Michał Olender <92638966+TC-MO@users.noreply.github.com>
…chema/multiple_datasets.md

Co-authored-by: Michał Olender <92638966+TC-MO@users.noreply.github.com>
…chema/multiple_datasets.md

Co-authored-by: Michał Olender <92638966+TC-MO@users.noreply.github.com>
…chema/multiple_datasets.md

Co-authored-by: Michał Olender <92638966+TC-MO@users.noreply.github.com>
…chema/multiple_datasets.md

Co-authored-by: Michał Olender <92638966+TC-MO@users.noreply.github.com>
@apify-service-account
Copy link

Preview for this PR was built for commit cb2a3bee and is ready at https://pr-2228.preview.docs.apify.com!

valekjo and others added 3 commits March 18, 2026 12:24
…chema/multiple_datasets.md

Co-authored-by: Michał Olender <92638966+TC-MO@users.noreply.github.com>
…chema/multiple_datasets.md

Co-authored-by: Michał Olender <92638966+TC-MO@users.noreply.github.com>
@apify-service-account
Copy link

Preview for this PR was built for commit aa4dae67 and is ready at https://pr-2228.preview.docs.apify.com!

@apify-service-account
Copy link

Preview for this PR was built for commit d6381bc4 and is ready at https://pr-2228.preview.docs.apify.com!

@valekjo valekjo requested review from TC-MO and janbuchar March 18, 2026 11:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

t-console Issues with this label are in the ownership of the console team.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants