Skip to content

Use DataprocCommandRunner to run "pip install" - #187

Merged
dborowitz merged 4 commits into
mainfrom
dp-pip-with-output
Oct 23, 2026
Merged

dborowitz merged 4 commits into
mainfrom
dp-pip-with-output

Conversation

@tim-u

@tim-u tim-u commented May 7, 2026

Copy link
Copy Markdown
Contributor

No description provided.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors the dpip magic to use a remote command runner for package installation, utilizing pyarrow to decode the resulting output stream. The changes include a modularization of the dpip method and updated unit tests. Feedback focuses on improving code maintainability by replacing magic strings with constants, simplifying string joining logic, and reducing code duplication in the test suite.

Comment thread google/cloud/dataproc_magics/magics.py Outdated
Comment thread google/cloud/dataproc_magics/magics.py Outdated
Comment thread google/cloud/dataproc_magics/magics.py Outdated
Comment thread tests/unit/dataproc_magics/test_magics.py Outdated
# Conflicts:
#	google/cloud/managed_spark_magics/magics.py
#	tests/unit/managed_spark_magics/test_magics.py
@dborowitz
dborowitz merged commit 4c12a13 into main Oct 23, 2026
12 checks passed
@dborowitz
dborowitz deleted the dp-pip-with-output branch October 23, 2026 18:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants