trainingsample v0.3.0 for performance improvement on huge datasets#2848
Merged
Conversation
Owner
Author
|
the improved tsr build brings total wall clock time on huge (2 million samples) datasets down from 4 hours to about 1 hour across 4x H200 and even better performance on gaming CPU class systems (eg. RTX 6000 Pro, RTX 5090, 4090) thanks to higher clock rates and boost freq |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request updates the required version range for the
trainingsampledependency from>=0.2.18to>=0.3.0,<0.4.0and adjusts the related test to match this new requirement.Dependency updates:
trainingsampledependency insetup.pyto require versions>=0.3.0and<0.4.0instead of the previous>=0.2.18.Test updates:
tests/test_setup_platform_dependencies.pyto check for the newtrainingsampleversion range and ensure the old version requirement is not present.