sparkmagic

What's Changed

• Added support for http adapter config by @venu1412 in https://github.com/jupyter-incubator/sparkmagic/pull/820
• fixed the typo in http session adapter config exception by @venu1412 in https://github.com/jupyter-incubator/sparkmagic/pull/824
• Update readme with Ilum as new compatible implementation by @thijs-s in https://github.com/jupyter-incubator/sparkmagic/pull/826
• Add ability to have default config options for spark by @c2zwdjnlcg in https://github.com/jupyter-incubator/sparkmagic/pull/830
• Fix example config json by @c2zwdjnlcg in https://github.com/jupyter-incubator/sparkmagic/pull/832
• Add support for application/json mime type in statement output by @Strunevskiy in https://github.com/jupyter-incubator/sparkmagic/pull/835
• Fix formatting issue by @Strunevskiy in https://github.com/jupyter-incubator/sparkmagic/pull/836
• Fix for notebook version 7+ by @c2zwdjnlcg in https://github.com/jupyter-incubator/sparkmagic/pull/831
• fix: run CI on pull_request to run on forks by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/837
• build(deps): bump tornado from 6.2 to 6.3.3 by @dependabot in https://github.com/jupyter-incubator/sparkmagic/pull/829
• build(deps): bump requests from 2.28.1 to 2.31.0 by @dependabot in https://github.com/jupyter-incubator/sparkmagic/pull/815
• build(deps): bump pygments from 2.14.0 to 2.15.0 by @dependabot in https://github.com/jupyter-incubator/sparkmagic/pull/822
• build(deps): bump certifi from 2022.12.7 to 2023.7.22 by @dependabot in https://github.com/jupyter-incubator/sparkmagic/pull/823
• build(deps): bump cryptography from 39.0.1 to 41.0.3 by @dependabot in https://github.com/jupyter-incubator/sparkmagic/pull/828
• fix: pin Docker.jupyter to notebook 6.x.x by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/839
• chore: prep for v0.21.0 release by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/840

New Contributors

• @venu1412 made their first contribution in https://github.com/jupyter-incubator/sparkmagic/pull/820
• @thijs-s made their first contribution in https://github.com/jupyter-incubator/sparkmagic/pull/826
• @c2zwdjnlcg made their first contribution in https://github.com/jupyter-incubator/sparkmagic/pull/830
• @Strunevskiy made their first contribution in https://github.com/jupyter-incubator/sparkmagic/pull/835

Full Changelog: https://github.com/jupyter-incubator/sparkmagic/compare/0.20.5...0.21.0

What's Changed

• build(deps): bump ipython from 8.7.0 to 8.10.0 by @dependabot in https://github.com/jupyter-incubator/sparkmagic/pull/807
• fix: pin pandas<2.0.0 by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/812
• build(deps): bump cryptography from 38.0.4 to 39.0.1 by @dependabot in https://github.com/jupyter-incubator/sparkmagic/pull/805
• fix: Display HTML for IPython.display.display_html by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/813

New Contributors

• @dependabot made their first contribution in https://github.com/jupyter-incubator/sparkmagic/pull/807

Full Changelog: https://github.com/jupyter-incubator/sparkmagic/compare/0.20.4...0.20.5

What's Changed

• dataframe_parser: use pre tag for table data by @utkarshgupta137 in https://github.com/jupyter-incubator/sparkmagic/pull/763
• Fix GCP GPG Key Error in Docker Build by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/801

Full Changelog: https://github.com/jupyter-incubator/sparkmagic/compare/0.20.3...0.20.4

What's Changed

• fix: package install in 0.20.2 release by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/799

Full Changelog: https://github.com/jupyter-incubator/sparkmagic/compare/0.20.2...0.20.3

What's Changed

• chore: upgrade gh action deps by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/792
• feat: add ci to verify docker build is reliable by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/793
• feat: run tests and docker ci daily by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/794
• refactor: use requirements.txt for install_requires by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/795
• Add CI support for Python 3.10 by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/757
• feat: support ipywidgets>8 by passing tuples to dropdown instead of dict by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/797
• Add Poetry for Local Development by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/798

Full Changelog: https://github.com/jupyter-incubator/sparkmagic/compare/0.20.1...0.20.2

What's Changed

• Add a link to Lighter project by @pdambrauskas in https://github.com/jupyter-incubator/sparkmagic/pull/784
• Change import paths for dataerror by @GaspardBT in https://github.com/jupyter-incubator/sparkmagic/pull/775

New Contributors

• @pdambrauskas made their first contribution in https://github.com/jupyter-incubator/sparkmagic/pull/784

Full Changelog: https://github.com/jupyter-incubator/sparkmagic/compare/0.20.0...0.20.1

Supporting async kernel execution in ipykernel>=6 required significant changes to critical path code. Please make an issue if you see errors after upgrading!

What's Changed

• Drop Support for Python 3.6 by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/755
• Simplify and Speed up Docker Images by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/756
• Re-format All Code with black. Require black in CI by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/758
• Support IPython 8 by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/759
• Support ipykernel >= 6 by @devstein in https://github.com/jupyter-incubator/sparkmagic/pull/737

Full Changelog: https://github.com/jupyter-incubator/sparkmagic/compare/0.19.2...0.20.0

What's Changed

• Add comma to setup file by @GaspardBT in https://github.com/jupyter-incubator/sparkmagic/pull/734
• Correct missing syntax in Pyspark example notebook by @crickford in https://github.com/jupyter-incubator/sparkmagic/pull/753
• Add ipython<8 to hdijupyterutils by @utkarshgupta137 in https://github.com/jupyter-incubator/sparkmagic/pull/754

New Contributors

• @GaspardBT made their first contribution in https://github.com/jupyter-incubator/sparkmagic/pull/734
• @crickford made their first contribution in https://github.com/jupyter-incubator/sparkmagic/pull/753
• @utkarshgupta137 made their first contribution in https://github.com/jupyter-incubator/sparkmagic/pull/754

Full Changelog: https://github.com/jupyter-incubator/sparkmagic/compare/0.19.1...0.19.2

See the changelog

See the changelog

See the changelog

See the changelog

See the changelog

See CHANGELOG