Repository navigation
fix(deps): lower ipython requirement to >=7.34.0 for Colab Enterprise - #209
Merged
Merged
Conversation
Colab and Colab Enterprise runtimes pre-install ipython==7.34.0 (the final 7.x release) to satisfy google-colab's kernel integration constraints. Requiring ipython>=8.0 in extras_require["interactive"] forced pip to upgrade IPython on Colab Enterprise runtimes when installing google-cloud-spark-connect[interactive], conflicting with google-colab's pinned dependencies and risking kernel incompatibility across restarts. Nothing in google.cloud.managed_spark_connect or google.cloud.managed_spark_magics depends on IPython 8+ features: - Interactive shell integration (_ipython.py, session.py, environment.py) and the %%sparksql / %load_spark_connect_session magics only use long-stable APIs available in IPython 7.34.0 (get_ipython, IPython.display, Magics decorators, extension_manager, magics_manager, post_run_cell events, _showtraceback, and traitlets.config.Configurable). - All sibling [interactive] dependencies (anywidget, colabsqlviz, ipywidgets, jupyter_DynamicPip, sqlparse) already support IPython 7.34.0. Lower the floor in setup.py to ipython>=7.34.0 so installing the [interactive] extra on Colab Enterprise preserves the runtime's existing IPython 7.34.0 installation.
tim-u
approved these changes
Oct 22, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Colab and Colab Enterprise runtimes pre-install
ipython==7.34.0(the final7.xrelease) to satisfygoogle-colab's custom kernel integration constraints. Requiringipython>=8.0inextras_require["interactive"]forcedpipto upgrade IPython when installinggoogle-cloud-spark-connect[interactive]on Colab Enterprise runtimes, conflicting withgoogle-colab's pinned dependencies and risking kernel incompatibility across restarts.Nothing in
google.cloud.managed_spark_connectorgoogle.cloud.managed_spark_magicsdepends on IPython 8+ features:_ipython.py,session.py,environment.py) and the%%sparksql/%load_spark_connect_sessionmagics only use long-stable APIs already present in IPython7.34.0(get_ipython,IPython.display,Magicsdecorators,extension_manager,magics_manager,post_run_cellevents,_showtraceback, andtraitlets.config.Configurable).[interactive]dependencies (anywidget,colabsqlviz,ipywidgets,jupyter_DynamicPip,sqlparse) already supportipython==7.34.0.This PR lowers the floor in
setup.pytoipython>=7.34.0so installing the[interactive]extra on Colab Enterprise preserves the runtime's existingipython==7.34.0installation.Verification
Recorded interactive notebook demo: 23-cell notebook executed end-to-end against a Managed Spark Serverless session in a venv starting with
ipython==7.34.0:1. Live
pip installpreservesipython==7.34.02.
%%sparksqlinteractivecolabsqlvizwidget rendering3. DataFrame rich HTML table rendering (
_repr_html_)4.
%dpipruntime package installation and Spark UDF execution5. Concise PySpark error formatting in
%%sparksql6.
%config GoogleSparkConnectShellruntime toggles