kserve

What's Changed

• Make storage initializer image configurable by @yuzisun in https://github.com/kserve/kserve/pull/3145
• chore: Add design doc template links to feature request template by @ckadner in https://github.com/kserve/kserve/pull/3155
• Increase pytest workers for kourier e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/3151
• Upgrade istio Api and migrate to v1beta1 Api version by @sivanantha321 in https://github.com/kserve/kserve/pull/3150
• Unpack archive files for hdfs by @sivanantha321 in https://github.com/kserve/kserve/pull/3093
• Removing update op from pod-mutator webhook by @rachitchauhan43 in https://github.com/kserve/kserve/pull/3163
• Fix quick install script by @dtrifiro in https://github.com/kserve/kserve/pull/3164
• Fix self-signed-ca installation by @sivanantha321 in https://github.com/kserve/kserve/pull/3165
• Generate client-go for StorageContainer CR by @sivanantha321 in https://github.com/kserve/kserve/pull/3152
• Add S3_VERIFY_SSL to storage.py for S3 by @Jooho in https://github.com/kserve/kserve/pull/3172
• Allow disabling creation of the HPA in raw deployment mode by @andyi2it in https://github.com/kserve/kserve/pull/3086
• Restrict workflow concurrency by @vignesh-murugani2i in https://github.com/kserve/kserve/pull/3167
• Refractor v1 vs. v2 endpoint unit tests in kserve/test/test_server.py… by @guohaoyu110 in https://github.com/kserve/kserve/pull/3158
• Fix runtime not found for triton due to wrong default protocolVersion by @sivanantha321 in https://github.com/kserve/kserve/pull/3177
• Make ModelServer to stop correctly when using more than 1 worker by @andyi2it in https://github.com/kserve/kserve/pull/3174
• Added custom request timeout for inferencegraph. by @andyi2it in https://github.com/kserve/kserve/pull/3173
• Fix serving runtime webhook cert namespace for kubeflow installation by @sivanantha321 in https://github.com/kserve/kserve/pull/3188
• Add go security scan for PRs and set it up to run on a regular schedule by @sivanantha321 in https://github.com/kserve/kserve/pull/3170
• RawDeployment support for Inference Graph by @bmopuri in https://github.com/kserve/kserve/pull/3194
• Revert "RawDeployment support for Inference Graph" by @rachitchauhan43 in https://github.com/kserve/kserve/pull/3198
• Verify codegen in CI by @sivanantha321 in https://github.com/kserve/kserve/pull/3189
• Fix knative config-defaults values overrided by kserve by @sivanantha321 in https://github.com/kserve/kserve/pull/3130
• Fix qpext metrics port by @yuzisun in https://github.com/kserve/kserve/pull/3209
• docs: fix some typos by @daixiang0 in https://github.com/kserve/kserve/pull/3214
• chore: Add new PR reviewers and approvers by @ckadner in https://github.com/kserve/kserve/pull/3213
• Added async with postprocess method. by @andyi2it in https://github.com/kserve/kserve/pull/3204
• Remove the redundant python lint check in CI environment by @nilakshi104 in https://github.com/kserve/kserve/pull/3184
• Move pmml worker validation to runtime by @sivanantha321 in https://github.com/kserve/kserve/pull/3182
• Bump torchserve version to 0.9.0 by @gavrishp in https://github.com/kserve/kserve/pull/3217
• CVE-2023-44487 - qpext by @spolti in https://github.com/kserve/kserve/pull/3203
• Allow ray >=2.7,<3 by @ddelange in https://github.com/kserve/kserve/pull/3075
• Fix lightgbm model input conversion when input is list of lists by @sivanantha321 in https://github.com/kserve/kserve/pull/3226
• CVE-2023-44487 by @spolti in https://github.com/kserve/kserve/pull/3202
• Sanitize a command line argument in agent by @israel-hdez in https://github.com/kserve/kserve/pull/3245
• Validation added for ensuring same model format has same priority for runtime by @andyi2it in https://github.com/kserve/kserve/pull/3181
• Fix: Unexpected Panic in Inference graph when it fails to create http request by @HAO2167 in https://github.com/kserve/kserve/pull/3079
• Add default clusterstoragecontainer cr into resources by @homily707 in https://github.com/kserve/kserve/pull/3219
• Support verify variable with storage-config json style (fix-3263) by @Jooho in https://github.com/kserve/kserve/pull/3267
• Update qpext docs on image patch by @sivanantha321 in https://github.com/kserve/kserve/pull/3266
• Added 3.11 support for paddle in workflow. by @andyi2it in https://github.com/kserve/kserve/pull/3246
• Torchserve grpc v2 by @andyi2it in https://github.com/kserve/kserve/pull/3247
• Bump istio version to 1.19.4 by @sivanantha321 in https://github.com/kserve/kserve/pull/3258
• image_patch_dev.sh: set pipefail by @dtrifiro in https://github.com/kserve/kserve/pull/3274
• s3 storage initializer: only set environment variables if variables are set in storage secret json by @dtrifiro in https://github.com/kserve/kserve/pull/3259
• feat: CA bundle mount options for storage initializer by @Jooho in https://github.com/kserve/kserve/pull/3250
• Fix tensorflow e2e test fails due to OOM error by @sivanantha321 in https://github.com/kserve/kserve/pull/3293
• Update Istio-Dex docs by @sivanantha321 in https://github.com/kserve/kserve/pull/3260
• chore: Upgrade Go to v1.21 by @terrytangyuan in https://github.com/kserve/kserve/pull/3296
• fix: Properly handle the creation and closure of success file in DownloadModel() by @terrytangyuan in https://github.com/kserve/kserve/pull/3295
• Updated ray to 2.8.0 and removed detached flag to avoid deprecation error in future by @andyi2it in https://github.com/kserve/kserve/pull/3272
• fix: Surface errors when writing graphHandler response by @terrytangyuan in https://github.com/kserve/kserve/pull/3308
• Fix qpext hangs during shutdown by @sivanantha321 in https://github.com/kserve/kserve/pull/3268
• chore: Upgrade to XGBoost v2.0.2. Fixes #3310 by @terrytangyuan in https://github.com/kserve/kserve/pull/3309
• fix: Check if HPA has the same scaleTargetRef and behavior by @terrytangyuan in https://github.com/kserve/kserve/pull/3294
• Updated quick_install script to temporarily fix 0.11.2 release install by @andyi2it in https://github.com/kserve/kserve/pull/3311
• Remove deprecated protobuf packages by @sivanantha321 in https://github.com/kserve/kserve/pull/3328
• Add health check for controller manager by @sivanantha321 in https://github.com/kserve/kserve/pull/3289
• Introduce retry on resource conflict by @sivanantha321 in https://github.com/kserve/kserve/pull/3240
• Updated Kserve version file path in pyproject.toml. by @andyi2it in https://github.com/kserve/kserve/pull/3225
• docs: Add link to OpenShift Container Platform instructions by @terrytangyuan in https://github.com/kserve/kserve/pull/3322
• Fix inference request fails when sending with less number of features than the total model features on lightgbm by @sivanantha321 in https://github.com/kserve/kserve/pull/3313
• Add a CI_USE_ISVC_HOST for testing with the ISVC hostname by @israel-hdez in https://github.com/kserve/kserve/pull/3324
• Upgraded poetry version to 1.7.1 by @andyi2it in https://github.com/kserve/kserve/pull/3271
• ci: publish helm chart to ghcr by @davidspek in https://github.com/kserve/kserve/pull/3319
• Fix raw deployment service points to predictor container port instead of transformer container port in transformer collocation by @sivanantha321 in https://github.com/kserve/kserve/pull/3318
• Upgrade cloudevent to v2 by @homily707 in https://github.com/kserve/kserve/pull/3255
• Restrict storage uri to predictor only in collocation of transformer and predictor by @sivanantha321 in https://github.com/kserve/kserve/pull/3280
• Add support for modelcars by @rhuss in https://github.com/kserve/kserve/pull/3110
• Add regex support for propagating IG headers by @sivanantha321 in https://github.com/kserve/kserve/pull/3178
• chore: Prepare v0.12.0-rc0 release by @terrytangyuan in https://github.com/kserve/kserve/pull/3325
• docs: Corrections and edits on release process document by @terrytangyuan in https://github.com/kserve/kserve/pull/3326
• build: Switch to use kustomize in kubectl to simplify build process. Fixes #3314 by @terrytangyuan in https://github.com/kserve/kserve/pull/3315
• feat: Expose defaults for several batcher handler parameters by @terrytangyuan in https://github.com/kserve/kserve/pull/3301
• fix: Properly close resources and handle errors in agent and storage. Fixes #3323 by @terrytangyuan in https://github.com/kserve/kserve/pull/3321
• Add model arguments to API and update BERT inference example by @yuzisun in https://github.com/kserve/kserve/pull/3332
• chore: Update generated APIs and check generated manifests by @terrytangyuan in https://github.com/kserve/kserve/pull/3335
• Update python model serving runtime API docstring by @yuzisun in https://github.com/kserve/kserve/pull/3338
• Handles s3 download for object name starts with folder name. by @andyi2it in https://github.com/kserve/kserve/pull/3205
• chore: Remove unused timeout annotation and flag in batcher by @terrytangyuan in https://github.com/kserve/kserve/pull/3341
• ci: Automate release process by @terrytangyuan in https://github.com/kserve/kserve/pull/3345
• fixes critical vulnerabilities on ray by @spolti in https://github.com/kserve/kserve/pull/3285
• chore: Bump versions to prepare v0.12.0-rc1 release by @terrytangyuan in https://github.com/kserve/kserve/pull/3352
• Change version for helm charts in README by @gawsoftpl in https://github.com/kserve/kserve/pull/3353
• Fixes CVE-2023-48795 by @spolti in https://github.com/kserve/kserve/pull/3354
• Fix Stack-based Buffer Overflow on protobuf by @spolti in https://github.com/kserve/kserve/pull/3358
• Update knative-serving by @spolti in https://github.com/kserve/kserve/pull/3362
• Fixes vulnerabilities on the otelhttp dependency by @spolti in https://github.com/kserve/kserve/pull/3361
• Change the default value for enableDirectPvcVolumeMount to true by @Jooho in https://github.com/kserve/kserve/pull/3371
• feat: Automatically generate Helm Chart docs. Fixes #3356 by @terrytangyuan in https://github.com/kserve/kserve/pull/3363
• Modified script for include all kserve poetry projects. by @andyi2it in https://github.com/kserve/kserve/pull/3350
• RawDeployment support for Inference Graph by @bmopuri in https://github.com/kserve/kserve/pull/3199
• Add compatibility for Istio CNI plugin by @israel-hdez in https://github.com/kserve/kserve/pull/3316
• Pass missing infer parameters during conversion by @sivanantha321 in https://github.com/kserve/kserve/pull/3368
• feat: Support S3 transfer acceleration by @terrytangyuan in https://github.com/kserve/kserve/pull/3305
• Implement HuggingFace model server by @yuzisun in https://github.com/kserve/kserve/pull/3334
• fix: Add missing volume mount to transformer container when using modelcars by @rhuss in https://github.com/kserve/kserve/pull/3384
• align cloudevents/sdk-go dependency by @spolti in https://github.com/kserve/kserve/pull/3387
• Update google-cloud-storage dependecy to >=2.3.0,<3.0.0 and ray dependency to >=2.8.1, <3.0.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/3389
• Adding script for setting up Telepresence for local development by @rhuss in https://github.com/kserve/kserve/pull/3104
• Fix v2 model ready url in kserve client by @sivanantha321 in https://github.com/kserve/kserve/pull/3403
• chore: Remove unused version update script for Python SDK by @terrytangyuan in https://github.com/kserve/kserve/pull/3394
• Fix no space left error in CI environment by @sivanantha321 in https://github.com/kserve/kserve/pull/3411
• Add exception handler for model server and Add ability to specify custom handler by @sivanantha321 in https://github.com/kserve/kserve/pull/3405
• Streamline python release update script to scan multi-depth by @andyi2it in https://github.com/kserve/kserve/pull/3351
• feat: Add HuggingFace runtime out-of-the-box support by @terrytangyuan in https://github.com/kserve/kserve/pull/3395
• docs: Update link to Slack instructions by @terrytangyuan in https://github.com/kserve/kserve/pull/3421
• Fix no space left error on huggingface docker publisher workflow by @sivanantha321 in https://github.com/kserve/kserve/pull/3431
• Fix parameters value type conversion by pydantic by @sivanantha321 in https://github.com/kserve/kserve/pull/3430
• Fix Raw Logger E2E by @israel-hdez in https://github.com/kserve/kserve/pull/3434
• Go vulnerability fixes by @sivanantha321 in https://github.com/kserve/kserve/pull/3442
• Reduce E2Es dependency on CI environment by @israel-hdez in https://github.com/kserve/kserve/pull/3435
• Implement support for vllm as alternative backend by @gavrishp in https://github.com/kserve/kserve/pull/3415
• Expose qpext aggregate metrics port on container by @sivanantha321 in https://github.com/kserve/kserve/pull/3291
• Python vulnerability fixes by @sivanantha321 in https://github.com/kserve/kserve/pull/3441
• Fix dup metrics aggr port by @yuzisun in https://github.com/kserve/kserve/pull/3447
• feat: Allow to disable ingress creation for raw deployment mode by @terrytangyuan in https://github.com/kserve/kserve/pull/3436
• build: Skip already downloaded Istio in quick_install.sh by @terrytangyuan in https://github.com/kserve/kserve/pull/3364
• fix: HuggingFace predictor should not be recognized as multi-model server by @terrytangyuan in https://github.com/kserve/kserve/pull/3449
• Fix: bugs for huggingface runtime template by @yuzisun in https://github.com/kserve/kserve/pull/3448
• Fix: Add padding and truncation in huggingface tokenizer by @kevinmingtarja in https://github.com/kserve/kserve/pull/3450
• Fix: vllm backend does not work with model_dir for huggingface runtime by @yuzisun in https://github.com/kserve/kserve/pull/3456
• Fix azure workload identity federation by excluding azure client secret by @robbertvdg in https://github.com/kserve/kserve/pull/3390
• Publish v0.12.0 release by @sivanantha321 in https://github.com/kserve/kserve/pull/3458
• Change certificate to ca_bundle in json style of s3 storageSecret by @Jooho in https://github.com/kserve/kserve/pull/3463
• fix: Add 'model_version' to InferResponse in python library by @ajstewart in https://github.com/kserve/kserve/pull/3466

New Contributors

• @dtrifiro made their first contribution in https://github.com/kserve/kserve/pull/3164
• @Jooho made their first contribution in https://github.com/kserve/kserve/pull/3172
• @vignesh-murugani2i made their first contribution in https://github.com/kserve/kserve/pull/3167
• @guohaoyu110 made their first contribution in https://github.com/kserve/kserve/pull/3158
• @bmopuri made their first contribution in https://github.com/kserve/kserve/pull/3194
• @daixiang0 made their first contribution in https://github.com/kserve/kserve/pull/3214
• @nilakshi104 made their first contribution in https://github.com/kserve/kserve/pull/3184
• @gavrishp made their first contribution in https://github.com/kserve/kserve/pull/3217
• @spolti made their first contribution in https://github.com/kserve/kserve/pull/3203
• @HAO2167 made their first contribution in https://github.com/kserve/kserve/pull/3079
• @homily707 made their first contribution in https://github.com/kserve/kserve/pull/3219
• @rhuss made their first contribution in https://github.com/kserve/kserve/pull/3110
• @gawsoftpl made their first contribution in https://github.com/kserve/kserve/pull/3353
• @kevinmingtarja made their first contribution in https://github.com/kserve/kserve/pull/3450
• @robbertvdg made their first contribution in https://github.com/kserve/kserve/pull/3390
• @ajstewart made their first contribution in https://github.com/kserve/kserve/pull/3466

Full Changelog: https://github.com/kserve/kserve/compare/v0.11.1...v0.12.0

What's Changed

• docs: Corrections and edits on release process document by @terrytangyuan in https://github.com/kserve/kserve/pull/3326
• build: Switch to use kustomize in kubectl to simplify build process. Fixes #3314 by @terrytangyuan in https://github.com/kserve/kserve/pull/3315
• feat: Expose defaults for several batcher handler parameters by @terrytangyuan in https://github.com/kserve/kserve/pull/3301
• fix: Properly close resources and handle errors in agent and storage. Fixes #3323 by @terrytangyuan in https://github.com/kserve/kserve/pull/3321
• Add model arguments to API and update BERT inference example by @yuzisun in https://github.com/kserve/kserve/pull/3332
• chore: Update generated APIs and check generated manifests by @terrytangyuan in https://github.com/kserve/kserve/pull/3335
• Update python model serving runtime API docstring by @yuzisun in https://github.com/kserve/kserve/pull/3338
• Handles s3 download for object name starts with folder name. by @andyi2it in https://github.com/kserve/kserve/pull/3205
• chore: Remove unused timeout annotation and flag in batcher by @terrytangyuan in https://github.com/kserve/kserve/pull/3341
• ci: Automate release process by @terrytangyuan in https://github.com/kserve/kserve/pull/3345
• fixes critical vulnerabilities on ray by @spolti in https://github.com/kserve/kserve/pull/3285
• chore: Bump versions to prepare v0.12.0-rc1 release by @terrytangyuan in https://github.com/kserve/kserve/pull/3352
• Change version for helm charts in README by @gawsoftpl in https://github.com/kserve/kserve/pull/3353
• Fixes CVE-2023-48795 by @spolti in https://github.com/kserve/kserve/pull/3354
• Fix Stack-based Buffer Overflow on protobuf by @spolti in https://github.com/kserve/kserve/pull/3358
• Update knative-serving by @spolti in https://github.com/kserve/kserve/pull/3362
• Fixes vulnerabilities on the otelhttp dependency by @spolti in https://github.com/kserve/kserve/pull/3361
• Change the default value for enableDirectPvcVolumeMount to true by @Jooho in https://github.com/kserve/kserve/pull/3371
• feat: Automatically generate Helm Chart docs. Fixes #3356 by @terrytangyuan in https://github.com/kserve/kserve/pull/3363
• Modified script for include all kserve poetry projects. by @andyi2it in https://github.com/kserve/kserve/pull/3350
• RawDeployment support for Inference Graph by @bmopuri in https://github.com/kserve/kserve/pull/3199
• Add compatibility for Istio CNI plugin by @israel-hdez in https://github.com/kserve/kserve/pull/3316
• Pass missing infer parameters during conversion by @sivanantha321 in https://github.com/kserve/kserve/pull/3368
• feat: Support S3 transfer acceleration by @terrytangyuan in https://github.com/kserve/kserve/pull/3305
• Implement HuggingFace model server by @yuzisun in https://github.com/kserve/kserve/pull/3334
• fix: Add missing volume mount to transformer container when using modelcars by @rhuss in https://github.com/kserve/kserve/pull/3384
• align cloudevents/sdk-go dependency by @spolti in https://github.com/kserve/kserve/pull/3387

New Contributors

• @gawsoftpl made their first contribution in https://github.com/kserve/kserve/pull/3353

Full Changelog: https://github.com/kserve/kserve/compare/v0.12.0-rc0...v0.12.0-rc1

What's Changed

• Make storage initializer image configurable by @yuzisun in https://github.com/kserve/kserve/pull/3145
• chore: Add design doc template links to feature request template by @ckadner in https://github.com/kserve/kserve/pull/3155
• Increase pytest workers for kourier e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/3151
• Upgrade istio Api and migrate to v1beta1 Api version by @sivanantha321 in https://github.com/kserve/kserve/pull/3150
• Unpack archive files for hdfs by @sivanantha321 in https://github.com/kserve/kserve/pull/3093
• Removing update op from pod-mutator webhook by @rachitchauhan43 in https://github.com/kserve/kserve/pull/3163
• Fix quick install script by @dtrifiro in https://github.com/kserve/kserve/pull/3164
• Fix self-signed-ca installation by @sivanantha321 in https://github.com/kserve/kserve/pull/3165
• Generate client-go for StorageContainer CR by @sivanantha321 in https://github.com/kserve/kserve/pull/3152
• Add S3_VERIFY_SSL to storage.py for S3 by @Jooho in https://github.com/kserve/kserve/pull/3172
• Allow disabling creation of the HPA in raw deployment mode by @andyi2it in https://github.com/kserve/kserve/pull/3086
• Restrict workflow concurrency by @vignesh-murugani2i in https://github.com/kserve/kserve/pull/3167
• Refractor v1 vs. v2 endpoint unit tests in kserve/test/test_server.py… by @guohaoyu110 in https://github.com/kserve/kserve/pull/3158
• Fix runtime not found for triton due to wrong default protocolVersion by @sivanantha321 in https://github.com/kserve/kserve/pull/3177
• Make ModelServer to stop correctly when using more than 1 worker by @andyi2it in https://github.com/kserve/kserve/pull/3174
• Added custom request timeout for inferencegraph. by @andyi2it in https://github.com/kserve/kserve/pull/3173
• Fix serving runtime webhook cert namespace for kubeflow installation by @sivanantha321 in https://github.com/kserve/kserve/pull/3188
• Add go security scan for PRs and set it up to run on a regular schedule by @sivanantha321 in https://github.com/kserve/kserve/pull/3170
• Verify codegen in CI by @sivanantha321 in https://github.com/kserve/kserve/pull/3189
• Fix knative config-defaults values overrided by kserve by @sivanantha321 in https://github.com/kserve/kserve/pull/3130
• Fix qpext metrics port by @yuzisun in https://github.com/kserve/kserve/pull/3209
• docs: fix some typos by @daixiang0 in https://github.com/kserve/kserve/pull/3214
• chore: Add new PR reviewers and approvers by @ckadner in https://github.com/kserve/kserve/pull/3213
• Added async with postprocess method. by @andyi2it in https://github.com/kserve/kserve/pull/3204
• Remove the redundant python lint check in CI environment by @nilakshi104 in https://github.com/kserve/kserve/pull/3184
• Move pmml worker validation to runtime by @sivanantha321 in https://github.com/kserve/kserve/pull/3182
• Bump torchserve version to 0.9.0 by @gavrishp in https://github.com/kserve/kserve/pull/3217
• CVE-2023-44487 - qpext by @spolti in https://github.com/kserve/kserve/pull/3203
• Allow ray >=2.7,<3 by @ddelange in https://github.com/kserve/kserve/pull/3075
• Fix lightgbm model input conversion when input is list of lists by @sivanantha321 in https://github.com/kserve/kserve/pull/3226
• CVE-2023-44487 by @spolti in https://github.com/kserve/kserve/pull/3202
• Sanitize a command line argument in agent by @israel-hdez in https://github.com/kserve/kserve/pull/3245
• Validation added for ensuring same model format has same priority for runtime by @andyi2it in https://github.com/kserve/kserve/pull/3181
• Fix: Unexpected Panic in Inference graph when it fails to create http request by @HAO2167 in https://github.com/kserve/kserve/pull/3079
• Add default clusterstoragecontainer cr into resources by @homily707 in https://github.com/kserve/kserve/pull/3219
• Support verify variable with storage-config json style (fix-3263) by @Jooho in https://github.com/kserve/kserve/pull/3267
• Update qpext docs on image patch by @sivanantha321 in https://github.com/kserve/kserve/pull/3266
• Added 3.11 support for paddle in workflow. by @andyi2it in https://github.com/kserve/kserve/pull/3246
• Torchserve grpc v2 by @andyi2it in https://github.com/kserve/kserve/pull/3247
• Bump istio version to 1.19.4 by @sivanantha321 in https://github.com/kserve/kserve/pull/3258
• image_patch_dev.sh: set pipefail by @dtrifiro in https://github.com/kserve/kserve/pull/3274
• s3 storage initializer: only set environment variables if variables are set in storage secret json by @dtrifiro in https://github.com/kserve/kserve/pull/3259
• feat: CA bundle mount options for storage initializer by @Jooho in https://github.com/kserve/kserve/pull/3250
• Fix tensorflow e2e test fails due to OOM error by @sivanantha321 in https://github.com/kserve/kserve/pull/3293
• Update Istio-Dex docs by @sivanantha321 in https://github.com/kserve/kserve/pull/3260
• chore: Upgrade Go to v1.21 by @terrytangyuan in https://github.com/kserve/kserve/pull/3296
• fix: Properly handle the creation and closure of success file in DownloadModel() by @terrytangyuan in https://github.com/kserve/kserve/pull/3295
• Updated ray to 2.8.0 and removed detached flag to avoid deprecation error in future by @andyi2it in https://github.com/kserve/kserve/pull/3272
• fix: Surface errors when writing graphHandler response by @terrytangyuan in https://github.com/kserve/kserve/pull/3308
• Fix qpext hangs during shutdown by @sivanantha321 in https://github.com/kserve/kserve/pull/3268
• chore: Upgrade to XGBoost v2.0.2. Fixes #3310 by @terrytangyuan in https://github.com/kserve/kserve/pull/3309
• fix: Check if HPA has the same scaleTargetRef and behavior by @terrytangyuan in https://github.com/kserve/kserve/pull/3294
• Updated quick_install script to temporarily fix 0.11.2 release install by @andyi2it in https://github.com/kserve/kserve/pull/3311
• Remove deprecated protobuf packages by @sivanantha321 in https://github.com/kserve/kserve/pull/3328
• Add health check for controller manager by @sivanantha321 in https://github.com/kserve/kserve/pull/3289
• Introduce retry on resource conflict by @sivanantha321 in https://github.com/kserve/kserve/pull/3240
• Updated Kserve version file path in pyproject.toml. by @andyi2it in https://github.com/kserve/kserve/pull/3225
• docs: Add link to OpenShift Container Platform instructions by @terrytangyuan in https://github.com/kserve/kserve/pull/3322
• Fix inference request fails when sending with less number of features than the total model features on lightgbm by @sivanantha321 in https://github.com/kserve/kserve/pull/3313
• Add a CI_USE_ISVC_HOST for testing with the ISVC hostname by @israel-hdez in https://github.com/kserve/kserve/pull/3324
• Upgraded poetry version to 1.7.1 by @andyi2it in https://github.com/kserve/kserve/pull/3271
• ci: publish helm chart to ghcr by @davidspek in https://github.com/kserve/kserve/pull/3319
• Fix raw deployment service points to predictor container port instead of transformer container port in transformer collocation by @sivanantha321 in https://github.com/kserve/kserve/pull/3318
• Upgrade cloudevent to v2 by @homily707 in https://github.com/kserve/kserve/pull/3255
• Restrict storage uri to predictor only in collocation of transformer and predictor by @sivanantha321 in https://github.com/kserve/kserve/pull/3280
• Add support for modelcars by @rhuss in https://github.com/kserve/kserve/pull/3110
• Add regex support for propagating IG headers by @sivanantha321 in https://github.com/kserve/kserve/pull/3178
• chore: Prepare v0.12.0-rc0 release by @terrytangyuan in https://github.com/kserve/kserve/pull/3325

New Contributors

• @dtrifiro made their first contribution in https://github.com/kserve/kserve/pull/3164
• @Jooho made their first contribution in https://github.com/kserve/kserve/pull/3172
• @vignesh-murugani2i made their first contribution in https://github.com/kserve/kserve/pull/3167
• @guohaoyu110 made their first contribution in https://github.com/kserve/kserve/pull/3158
• @bmopuri made their first contribution in https://github.com/kserve/kserve/pull/3194
• @daixiang0 made their first contribution in https://github.com/kserve/kserve/pull/3214
• @nilakshi104 made their first contribution in https://github.com/kserve/kserve/pull/3184
• @gavrishp made their first contribution in https://github.com/kserve/kserve/pull/3217
• @spolti made their first contribution in https://github.com/kserve/kserve/pull/3203
• @HAO2167 made their first contribution in https://github.com/kserve/kserve/pull/3079
• @homily707 made their first contribution in https://github.com/kserve/kserve/pull/3219
• @rhuss made their first contribution in https://github.com/kserve/kserve/pull/3110

Full Changelog: https://github.com/kserve/kserve/compare/v0.11.1...v0.12.0-rc0

What's Changed

• Fix serving runtime webhook cert namespace for kubeflow installation by @sivanantha321 in https://github.com/kserve/kserve/pull/3190
• [release-0.11] Fix qpext metrics port (#3209) by @houshengbo in https://github.com/kserve/kserve/pull/3210
• [release-0.11] Fix lightgbm model input conversion when input is list of lists by @sivanantha321 in https://github.com/kserve/kserve/pull/3229
• [release-0.11]Fix runtime not found for triton due to wrong default protocolVersion by @sivanantha321 in https://github.com/kserve/kserve/pull/3232
• [release-0.11]Fix mlserver runtime priority for sklearn by @sivanantha321 in https://github.com/kserve/kserve/pull/3233
• [release-0.11] Cherry-picks related to CVE-2023-44487 by @israel-hdez in https://github.com/kserve/kserve/pull/3242
• Version bump to 0.11.2 by @israel-hdez in https://github.com/kserve/kserve/pull/3244

New Contributors

• @houshengbo made their first contribution in https://github.com/kserve/kserve/pull/3210

Full Changelog: https://github.com/kserve/kserve/compare/v0.11.1...v0.11.2

What's Changed

• Fix configmap docs removed by kustomize build by @sivanantha321 in https://github.com/kserve/kserve/pull/3024
• Loosen ray version range by @ddelange in https://github.com/kserve/kserve/pull/2993
• Retry on resource conflict error by @sivanantha321 in https://github.com/kserve/kserve/pull/3035
• chore: Fix no space left on device error in predictor-runtime-build by @ckadner in https://github.com/kserve/kserve/pull/3049
• Update ModelMesh version to v0.11.0-rc1 by @rafvasq in https://github.com/kserve/kserve/pull/3047
• Bump scikit-learn version to 1.3.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/3040
• template out kube-rbac-proxy image by @tessapham in https://github.com/kserve/kserve/pull/3048
• Add ARM64 arch support for serving runtimes by @sivanantha321 in https://github.com/kserve/kserve/pull/3038
• Support secret name overrides with annotation by @yuzisun in https://github.com/kserve/kserve/pull/3034
• release: Update defaultModelMeshVersion to v0.11.0 by @ckadner in https://github.com/kserve/kserve/pull/3059
• chore: Rename ModelMesh validating webhook by @ckadner in https://github.com/kserve/kserve/pull/3064
• Release v0.11.0 by @andyi2it in https://github.com/kserve/kserve/pull/3061
• Update poetry lock files by @yuzisun in https://github.com/kserve/kserve/pull/3066
• [docker] reduction in the number of layers for controller image by @alekseyolg in https://github.com/kserve/kserve/pull/3070
• document status conditions for RoutesReady and LatestDeploymentReady by @tessapham in https://github.com/kserve/kserve/pull/3069
• Update indirect dependency golang.org/x/net/html by @israel-hdez in https://github.com/kserve/kserve/pull/3072
• Fix kubeflow overlay kustomization by @sivanantha321 in https://github.com/kserve/kserve/pull/3083
• Check sys platform before using SIGQUIT - fix windows development by @andyi2it in https://github.com/kserve/kserve/pull/3089
• Use knative operator for installing knative in e2e tests by @sivanantha321 in https://github.com/kserve/kserve/pull/2984
• Upgrade k8s to 1.27, istio 1.8 in test environment by @sivanantha321 in https://github.com/kserve/kserve/pull/3077
• Introduce Storage container CRD by @greenmoon55 in https://github.com/kserve/kserve/pull/3060
• List Models v2 REST API by @jvujjini in https://github.com/kserve/kserve/pull/2963
• Introduce Priority field in ServingRuntime by @sivanantha321 in https://github.com/kserve/kserve/pull/3031
• Storage initializer fix so that it downloads only specific file when provided uri is not a folder by @andyi2it in https://github.com/kserve/kserve/pull/3088
• IG response code. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/3039
• Add doc.go for v1alpha1 API version by @sivanantha321 in https://github.com/kserve/kserve/pull/3118
• Fixed torchserve e2e test. by @andyi2it in https://github.com/kserve/kserve/pull/3106
• Fix: error response handling for splitter and switch nodes by @rachitchauhan43 in https://github.com/kserve/kserve/pull/3116
• Fix validation for custom storageUri by @greenmoon55 in https://github.com/kserve/kserve/pull/3134
• Bumping version for 0.11.1 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/3141

New Contributors

• @alekseyolg made their first contribution in https://github.com/kserve/kserve/pull/3070
• @israel-hdez made their first contribution in https://github.com/kserve/kserve/pull/3072
• @jvujjini made their first contribution in https://github.com/kserve/kserve/pull/2963

Full Changelog: https://github.com/kserve/kserve/compare/v0.11.0...v0.11.1

🌈 What's New?

Core Inference & Serving Runtimes

• Feature enable ingress for path based routing by @kandrio in https://github.com/kserve/kserve/pull/2357
• Allow multiple containers in ServingRuntime by @markwinter in https://github.com/kserve/kserve/pull/2321
• Add disable ingress configuration for raw deployment by @andyi2it in https://github.com/kserve/kserve/pull/2773
• Add support for collocation of transformer and predictor by @sivanantha321 in https://github.com/kserve/kserve/pull/2873
• Support setting labels and annotations on the component level by @lizzzcai in https://github.com/kserve/kserve/pull/2925
• Add RoutesReady and LastDeploymentReady status conditions by @tessapham in https://github.com/kserve/kserve/pull/3008
• Triton FasterTransformer LLM by @cmaddalozzo in https://github.com/kserve/kserve/pull/2836
• Implement v2/open inference endpoints for kserve python runtimes by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2655
• Support mixed input type for kserve python runtimes by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2789
• Upgrade mlserver version to 1.3.2 by @sivanantha321 in https://github.com/kserve/kserve/pull/2910
• TorchServe 0.8.0 for LLM support by @sivanantha321 in https://github.com/kserve/kserve/pull/2980
• Bump triton server version to 23.05-py3 by @sivanantha321 in https://github.com/kserve/kserve/pull/2992

Advanced Inference

• Allowing setting minReplicas for Inference Graph router. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2679
• Adding pod affinity and resource requirements to IG Spec by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2711
• add json mimetype header for IG response by @krazik-intuit in https://github.com/kserve/kserve/pull/2877

Storage Provider

• Storage Initializer: Support virtual path style in S3 by @lizzzcai in https://github.com/kserve/kserve/pull/2887
• Support Direct VolumeMount for PVC by @lizzzcai in https://github.com/kserve/kserve/pull/2738

KServe Python SDK

kserve 0.11.0 now uses poetry for dependency management, cloud storage dependencies are now made optional and you can run pip install kserve[storage] to install those dependencies.

• Make storage dependency as an optional dependency by @andyi2it in https://github.com/kserve/kserve/pull/2700
• Support parameters in InferInput and InferOutput by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2699
• Dependency resolver using poetry by @andyi2it in https://github.com/kserve/kserve/pull/2602
• Allow to override the UvicornServer's default log config by @elukey in https://github.com/kserve/kserve/pull/2782
• Move cloud event decode logic from preprocess to decode method by @sivanantha321 in https://github.com/kserve/kserve/pull/2881
• Allow using SSL between transformer and predictor/explainer by @greenmoon55 in https://github.com/kserve/kserve/pull/2911
• Make postprocess interface consistent with V2 protocol by @cmaddalozzo in https://github.com/kserve/kserve/pull/2876
• Add a KServe module level logger by @cmaddalozzo in https://github.com/kserve/kserve/pull/2884
• Log exception stack for python runtimes by @yuzisun in https://github.com/kserve/kserve/pull/2939
• Checked model readiness before attempting inference. by @andyi2it in https://github.com/kserve/kserve/pull/2917
• Load Kubeconfig from python dict by @ShreehariVaasishta in https://github.com/kserve/kserve/pull/2924
• Added response id based on request id. by @andyi2it in https://github.com/kserve/kserve/pull/3020

⚠️ What's Changed

• Remove "default" suffix from generated component name - updated by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2508
• Remove(AIX explainer): Remove AIX explainer API and SDK by @Tomcli in https://github.com/kserve/kserve/pull/2826
• Fix raw deployment status.address.url displays wrong url by @sivanantha321 in https://github.com/kserve/kserve/pull/2830
• Make status.address.url consistent across installations by @sivanantha321 in https://github.com/kserve/kserve/pull/2875
• Added support to accept the request body/payload in any format (not just json) by @SatishBethi in https://github.com/kserve/kserve/pull/2524
  ⚠️ Now, you are required to set content-type header to application/json for the server to recognize and decode the json type payload.

🐛 What's Fixed

• Loosen protobuf and numpy dependency by @andyi2it in https://github.com/kserve/kserve/pull/2673
• Fix dependency issue and remove pinned pip version in xgbserver by @dependabot in https://github.com/kserve/kserve/pull/2689
• Fixing the dockerfile to run as non-root user by @chirag-orbittec in https://github.com/kserve/kserve/pull/2687
• Add check for adding gpu tag suffix when image field is specified by @yuzisun in https://github.com/kserve/kserve/pull/2709
• Use fork for multiprocessing mode by @yuzisun in https://github.com/kserve/kserve/pull/2718
• Adjust order of types to default to float,int by @pascalwhoop in https://github.com/kserve/kserve/pull/2754
• Fix trained model ready status by @andyi2it in https://github.com/kserve/kserve/pull/2774
• Fix missing ingress config options in helm chart by @andyi2it in https://github.com/kserve/kserve/pull/2772
• model_server.py: fix documentation for enable_latency_logging by @elukey in https://github.com/kserve/kserve/pull/2777
• Handle file exist scenario for local storage by @sivanantha321 in https://github.com/kserve/kserve/pull/2794
• Loosen tritonclient and azure storage blob dependencies by @sivanantha321 in https://github.com/kserve/kserve/pull/2815
• Add RBAC for inferencegraphs/finalizers by @ReToCode in https://github.com/kserve/kserve/pull/2839
• Do not create GRPCServer when grpc is not enabled by @greenmoon55 in https://github.com/kserve/kserve/pull/2878
• Make Pod mutator idempotent to support fluid by @hclchimumu in https://github.com/kserve/kserve/pull/2896
• Fix incorrect log message in transformer reconciliation by @leecs0503 in https://github.com/kserve/kserve/pull/2968
• Reconcile when rollout duration is changed by @henrysecond1 in https://github.com/kserve/kserve/pull/2916
• Fix status.address.url for networking layer other than istio by @sivanantha321 in https://github.com/kserve/kserve/pull/2908
• Fix IngressReady condition by @tessapham in https://github.com/kserve/kserve/pull/2977
• Use standard socket for single process by @yuzisun in https://github.com/kserve/kserve/pull/3000
• Remove distutils from Python SDK by @xfu83 in https://github.com/kserve/kserve/pull/3010
• Fix raw deployment service port by @sivanantha321 in https://github.com/kserve/kserve/pull/2967
• Allow passthrough of InferRequest id by @markgeejw in https://github.com/kserve/kserve/pull/2945
• Fix: if there is a symbol '?' in the path, force url. query as the mi… by @Wercurial in https://github.com/kserve/kserve/pull/3014

⬆️ Version Upgrade

• Bump torch from 1.13.0 to 1.13.1 in /python/aixexplainer by @dependabot in https://github.com/kserve/kserve/pull/2802
• Add support for k8s 1.26 by @sivanantha321 in https://github.com/kserve/kserve/pull/2835
• Go 1.20 upgrade by @sivanantha321 in https://github.com/kserve/kserve/pull/2914
• Bump the Go version to 1.20 for the builder image by @skonto in https://github.com/kserve/kserve/pull/2860
• Update the OpenShift guide to version 4.12 and use OpenShift Serverless by @ReToCode in https://github.com/kserve/kserve/pull/2855
• Added support for python 3.10 and removed python 3.7 references by @andyi2it in https://github.com/kserve/kserve/pull/2832
• Poetry plugin should update pyproject.toml by @andyi2it in https://github.com/kserve/kserve/pull/2899
• Python 3.11 support by @andyi2it in https://github.com/kserve/kserve/pull/2933
• Add python 3.11 support for alibi explainer by @sivanantha321 in https://github.com/kserve/kserve/pull/3006

🔨 Project SDLC

• Fix running out of disk space in e2e by @andyi2it in https://github.com/kserve/kserve/pull/2765
• Updating Knative Serving and Istio to their latest version by @matzew in https://github.com/kserve/kserve/pull/2697
• Fix formatting and controller tests by @yuzisun in https://github.com/kserve/kserve/pull/2783
• Parametrized docker builds by @peterableda in https://github.com/kserve/kserve/pull/2666
• Fix minimum k8s version in quick install by @sivanantha321 in https://github.com/kserve/kserve/pull/2791
• Make deployment scheduling behavior configurable by @ddelange in https://github.com/kserve/kserve/pull/2627
• Upgrade kustomization.yaml to support kustomize 5.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/2841
• Extract modelmesh part in helm chart by @hhk7734 in https://github.com/kserve/kserve/pull/2704
• chown python virtual env path to runtime user by @ReToCode in https://github.com/kserve/kserve/pull/2845
• Use buildkit for building docker images by @sivanantha321 in https://github.com/kserve/kserve/pull/2848
• Implement dynamic versioning using poetry plugin by @andyi2it in https://github.com/kserve/kserve/pull/2869
• Break down the Serving and net-istio artifact downloads into their own release trains by @matzew in https://github.com/kserve/kserve/pull/2890
• Add poetry lockfile consistency check to CI environment by @sivanantha321 in https://github.com/kserve/kserve/pull/2905
• Upgrade controller gen version to 0.12.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/2912
• Fix kourier e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/2991
• chore: Free up disk space on E2E test GHA runner node by @ckadner in https://github.com/kserve/kserve/pull/2972
• Fix e2e workflow syntax typo that broke e2e tests by @andyi2it in https://github.com/kserve/kserve/pull/2998
• Enable Triton e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/3004
• Added manual workflow trigger for release branch. by @andyi2it in https://github.com/kserve/kserve/pull/3002

📝 Documentation Update

• update kserve model method signatures in docs by @andyi2it in https://github.com/kserve/kserve/pull/2713
• update outlier detection example by @andyi2it in https://github.com/kserve/kserve/pull/2701
• Feat: adds huggingface bloom example to torchserve by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2466
• Iter8 canary and performance testing samples by @sriumcp in https://github.com/kserve/kserve/pull/2752
• Fix Cifar10 drift detection example's InferenceService by @aliok in https://github.com/kserve/kserve/pull/2787
• Update tutorial of inference logging with Knative Eventing by @aliok in https://github.com/kserve/kserve/pull/2792
• Update feast transformer docs by @sivanantha321 in https://github.com/kserve/kserve/pull/2780
• fix(samples): Update AIX examples to use custom explainer spec by @Tomcli in https://github.com/kserve/kserve/pull/2811
• Add KServe Fluid example on LLMs by @lizzzcai in https://github.com/kserve/kserve/pull/2819
• Update kafka example by @sivanantha321 in https://github.com/kserve/kserve/pull/2817
• Add configmap docs by @sivanantha321 in https://github.com/kserve/kserve/pull/3016
• Updated onnx-example. by @andyi2it in https://github.com/kserve/kserve/pull/3001
• add documentation about storage-initializer userid for istio-cni by @ReToCode in https://github.com/kserve/kserve/pull/3028

New Contributors

• @nagar-ajay made their first contribution in https://github.com/kserve/kserve/pull/2662
• @swapkh91 made their first contribution in https://github.com/kserve/kserve/pull/2609
• @kandrio made their first contribution in https://github.com/kserve/kserve/pull/2357
• @chirag-orbittec made their first contribution in https://github.com/kserve/kserve/pull/2687
• @pascalwhoop made their first contribution in https://github.com/kserve/kserve/pull/2754
• @matzew made their first contribution in https://github.com/kserve/kserve/pull/2697
• @peterableda made their first contribution in https://github.com/kserve/kserve/pull/2666
• @aliok made their first contribution in https://github.com/kserve/kserve/pull/2787
• @Naegionn made their first contribution in https://github.com/kserve/kserve/pull/2797
• @ReToCode made their first contribution in https://github.com/kserve/kserve/pull/2839
• @hhk7734 made their first contribution in https://github.com/kserve/kserve/pull/2704
• @skonto made their first contribution in https://github.com/kserve/kserve/pull/2860
• @krazik-intuit made their first contribution in https://github.com/kserve/kserve/pull/2877
• @SatishBethi made their first contribution in https://github.com/kserve/kserve/pull/2524
• @taneem-ibrahim made their first contribution in https://github.com/kserve/kserve/pull/2907
• @hclchimumu made their first contribution in https://github.com/kserve/kserve/pull/2896
• @leecs0503 made their first contribution in https://github.com/kserve/kserve/pull/2968
• @henrysecond1 made their first contribution in https://github.com/kserve/kserve/pull/2916
• @ShreehariVaasishta made their first contribution in https://github.com/kserve/kserve/pull/2924
• @fj-ochiai made their first contribution in https://github.com/kserve/kserve/pull/3017
• @xfu83 made their first contribution in https://github.com/kserve/kserve/pull/3010
• @markgeejw made their first contribution in https://github.com/kserve/kserve/pull/2945
• @Wercurial made their first contribution in https://github.com/kserve/kserve/pull/3014

Full Changelog: https://github.com/kserve/kserve/compare/v0.10.0...v0.11.0

What's Changed

• Replace unmaintained satori/go.uuid package by @sivanantha321 in https://github.com/kserve/kserve/pull/2932
• Log exception stack for python runtimes by @yuzisun in https://github.com/kserve/kserve/pull/2939
• Upgrade controller gen version to 0.12.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/2912
• Checked model readiness before attempting inference. by @andyi2it in https://github.com/kserve/kserve/pull/2917
• moviesentiment storageUri updated. by @andyi2it in https://github.com/kserve/kserve/pull/2952
• Python 3.11 support by @andyi2it in https://github.com/kserve/kserve/pull/2933
• Update alibi explainer storage uri by @sivanantha321 in https://github.com/kserve/kserve/pull/2966
• Updated storageUri for paddle example and e2e test. by @andyi2it in https://github.com/kserve/kserve/pull/2956
• Decode avro cloud event by @sivanantha321 in https://github.com/kserve/kserve/pull/2929
• Fix incorrect log message in transformer reconciliation by @leecs0503 in https://github.com/kserve/kserve/pull/2968
• Reconcile when rollout duration is changed by @henrysecond1 in https://github.com/kserve/kserve/pull/2916
• Support setting labels and annotations on the component level by @lizzzcai in https://github.com/kserve/kserve/pull/2925
• Load Kubeconfig from python dict by @ShreehariVaasishta in https://github.com/kserve/kserve/pull/2924
• Fix status.address.url for networking layer other than istio by @sivanantha321 in https://github.com/kserve/kserve/pull/2908
• Fix kourier e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/2991
• fix IngressReady condition by @tessapham in https://github.com/kserve/kserve/pull/2977
• chore: Free up disk space on E2E test GHA runner node by @ckadner in https://github.com/kserve/kserve/pull/2972
• Fix e2e workflow syntax typo that broke e2e tests by @andyi2it in https://github.com/kserve/kserve/pull/2998
• Use standard socket for single process by @yuzisun in https://github.com/kserve/kserve/pull/3000
• Bump torchserve version to 0.8.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/2980
• Fix params while loading kube config from dict by @ShreehariVaasishta in https://github.com/kserve/kserve/pull/3005
• Add python 3.11 support for alibi explainer by @sivanantha321 in https://github.com/kserve/kserve/pull/3006
• Enable Triton e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/3004
• Bump triton server version to 23.05-py3 by @sivanantha321 in https://github.com/kserve/kserve/pull/2992
• Update ModelMesh version to v0.11.0-rc0 by @rafvasq in https://github.com/kserve/kserve/pull/2969
• Fix a typo docs/samples/metrics-and-monitoring/README.md by @fj-ochiai in https://github.com/kserve/kserve/pull/3017
• Remove distutils from Python SDK by @xfu83 in https://github.com/kserve/kserve/pull/3010
• Fix raw deployment service port by @sivanantha321 in https://github.com/kserve/kserve/pull/2967
• Allow passthrough of InferRequest id by @markgeejw in https://github.com/kserve/kserve/pull/2945
• Add configmap docs by @sivanantha321 in https://github.com/kserve/kserve/pull/3016
• add ServiceReady status conditions by @tessapham in https://github.com/kserve/kserve/pull/3008
• Updated onnx-example. by @andyi2it in https://github.com/kserve/kserve/pull/3001
• Fixes for Integrating KServe with Openshift by @skonto in https://github.com/kserve/kserve/pull/2853
• Added manual workflow trigger for release branch. by @andyi2it in https://github.com/kserve/kserve/pull/3002
• fix: if there is a symbol '?' in the path, force url. query as the mi… by @Wercurial in https://github.com/kserve/kserve/pull/3014
• Added response id based on request id. by @andyi2it in https://github.com/kserve/kserve/pull/3020
• put back PredictorReady in living condition set by @tessapham in https://github.com/kserve/kserve/pull/3026
• add documentation about storage-initializer userid for istio-cni by @ReToCode in https://github.com/kserve/kserve/pull/3028
• publish RC1 version for v0.11.0 by @tessapham in https://github.com/kserve/kserve/pull/3027

New Contributors

• @leecs0503 made their first contribution in https://github.com/kserve/kserve/pull/2968
• @henrysecond1 made their first contribution in https://github.com/kserve/kserve/pull/2916
• @ShreehariVaasishta made their first contribution in https://github.com/kserve/kserve/pull/2924
• @tessapham made their first contribution in https://github.com/kserve/kserve/pull/2977
• @fj-ochiai made their first contribution in https://github.com/kserve/kserve/pull/3017
• @xfu83 made their first contribution in https://github.com/kserve/kserve/pull/3010
• @markgeejw made their first contribution in https://github.com/kserve/kserve/pull/2945
• @Wercurial made their first contribution in https://github.com/kserve/kserve/pull/3014

Full Changelog: https://github.com/kserve/kserve/compare/v0.11.0-rc0...v0.11.0-rc1

What's Changed

• Fix github workflow on release-0.10 by @greenmoon55 in https://github.com/kserve/kserve/pull/2892
• Do not create GRPCServer when grpc is not enabled by @greenmoon55 in https://github.com/kserve/kserve/pull/2886
• Cherry-pick: Add a KServe module level logger (#2884) by @yuzisun in https://github.com/kserve/kserve/pull/2940
• Use standard socket to fix performance regression in kserve python server by @yuzisun https://github.com/kserve/kserve/pull/3000
• Fix 0.10.1 cherry-pick merge issue by @yuzisun in https://github.com/kserve/kserve/pull/2999

Full Changelog: https://github.com/kserve/kserve/compare/v0.10.1...v0.10.2

🌈 What's New?

Core Inference

• Feature enable ingress for path based routing by @kandrio in https://github.com/kserve/kserve/pull/2357
• Support Direct VolumeMount for PVC by @lizzzcai in https://github.com/kserve/kserve/pull/2738
• Allow multiple containers in ServingRuntime by @markwinter in https://github.com/kserve/kserve/pull/2321
• Implement v2/open inference endpoints for OOTB python model servers by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2655
• Support parameters in InferInput and InferOutput by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2699
• Pass parameter in rest v2 infer by @Naegionn in https://github.com/kserve/kserve/pull/2797
• Support mixed input type for kserve python runtimes by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2789
• Add disable ingress feature for raw deployment by @andyi2it in https://github.com/kserve/kserve/pull/2773
• python: allow to override the UvicornServer's default log config by @elukey in https://github.com/kserve/kserve/pull/2782
• Add a KServe module level logger by @cmaddalozzo in https://github.com/kserve/kserve/pull/2884
• Storage Initializer: Support virtual path style in S3 by @lizzzcai in https://github.com/kserve/kserve/pull/2887
• Add support for collocation of transformer and predictor by @sivanantha321 in https://github.com/kserve/kserve/pull/2873
• Move cloud event decode logic from preprocess to decode method by @sivanantha321 in https://github.com/kserve/kserve/pull/2881
• Added support to accept the request body/payload in any format (not just json) by @SatishBethi in https://github.com/kserve/kserve/pull/2524
• Allow using SSL between transformer and predictor/explainer by @greenmoon55 in https://github.com/kserve/kserve/pull/2911
• Make postprocess interface consistent with V2 protocol by @cmaddalozzo in https://github.com/kserve/kserve/pull/2876
• Make pod mutator idempotent to support fluid by @hclchimumu in https://github.com/kserve/kserve/pull/2896

Inference Graph

• Allowing setting minReplicas for IG router. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2679
• Adding podaffinity and resourcerequirments to IG Spec by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2711
• Add RBAC for inferencegraphs/finalizers by @ReToCode in https://github.com/kserve/kserve/pull/2839
• add json mimetype header for IG response by @krazik-intuit in https://github.com/kserve/kserve/pull/2877

What's Changed

• Remove "default" suffix from generated component name - updated by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2508
• Remove(AIX explainer): Remove AIX explainer API and SDK by @Tomcli in https://github.com/kserve/kserve/pull/2826
• Cleanup aix explainer by @sivanantha321 in https://github.com/kserve/kserve/pull/2889
• Make status.address.url consistent across installations by @sivanantha321 in https://github.com/kserve/kserve/pull/2875

Poetry Dependency Management

• Dependency resolver using poetry by @andyi2it in https://github.com/kserve/kserve/pull/2602
• Make storage dependency as an optional dependency by @andyi2it in https://github.com/kserve/kserve/pull/2700
• Implement dynamic versioning using poetry plugin by @andyi2it in https://github.com/kserve/kserve/pull/2869
• Poetry plugin should update pyproject.toml by @andyi2it in https://github.com/kserve/kserve/pull/2899
• Add poetry lockfile consistency check to CI environment by @sivanantha321 in https://github.com/kserve/kserve/pull/2905

🐛 What's Fixed

• Fix KUBE_VERSION variable in quick_install.sh file by @nagar-ajay in https://github.com/kserve/kserve/pull/2662
• Update quick install script to add Cluster Autoscaler and istiod memory leakage fix fields by @swapkh91 in https://github.com/kserve/kserve/pull/2609
• Fixing the dockerfile to run as non-root user by @chirag-orbittec in https://github.com/kserve/kserve/pull/2687
• Add check for adding gpu tag suffix when image field is specified by @yuzisun in https://github.com/kserve/kserve/pull/2709
• Use fork for multiprocessing mode by @yuzisun in https://github.com/kserve/kserve/pull/2718
• Fix knative installation failure in e2e test by @andyi2it in https://github.com/kserve/kserve/pull/2726
• Adjust order of types to default to float,int by @pascalwhoop in https://github.com/kserve/kserve/pull/2754
• Fix trained model ready status by @andyi2it in https://github.com/kserve/kserve/pull/2774
• fix missing ingress config options in helm chart by @andyi2it in https://github.com/kserve/kserve/pull/2772
• Handle file exist scenario for local storage by @sivanantha321 in https://github.com/kserve/kserve/pull/2794
• Fix inferencegraphs/finalizers rbac by @sivanantha321 in https://github.com/kserve/kserve/pull/2858
• Do not create GRPCServer when grpc is not enabled by @greenmoon55 in https://github.com/kserve/kserve/pull/2878
• Fix raw deployment status.address.url displays wrong url by @sivanantha321 in https://github.com/kserve/kserve/pull/2830

Documentation Updates

• update kserve model method signatures in docs by @andyi2it in https://github.com/kserve/kserve/pull/2713
• update outlier detection example by @andyi2it in https://github.com/kserve/kserve/pull/2701
• Feat: adds huggingface bloom example to torchserve by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2466
• Iter8 canary and performance testing samples by @sriumcp in https://github.com/kserve/kserve/pull/2752
• model_server.py: fix documentation for enable_latency_logging by @elukey in https://github.com/kserve/kserve/pull/2777
• Fix Cifar10 drift detection example's InferenceService by @aliok in https://github.com/kserve/kserve/pull/2787
• Update tutorial of inference logging with Knative Eventing by @aliok in https://github.com/kserve/kserve/pull/2792
• Update feast transformer docs by @sivanantha321 in https://github.com/kserve/kserve/pull/2780
• Update AIX examples to use custom explainer spec by @Tomcli in https://github.com/kserve/kserve/pull/2811
• Adding doc for release process v2 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2559
• Add Triton FasterTransformer example by @cmaddalozzo in https://github.com/kserve/kserve/pull/2836
• Add KServe Fluid example on LLMs by @lizzzcai in https://github.com/kserve/kserve/pull/2819
• Point S3 example README.md to KServe website by @yuzisun in https://github.com/kserve/kserve/pull/2824
• Update the OpenShift guide to version 4.12 and use OpenShift Serverless by @ReToCode in https://github.com/kserve/kserve/pull/2855
• Point KServe example readme to website by @yuzisun in https://github.com/kserve/kserve/pull/2864
• Update kafka example by @sivanantha321 in https://github.com/kserve/kserve/pull/2817

SDLC Changes

• Parametrized docker builds by @peterableda in https://github.com/kserve/kserve/pull/2666
• Make deployment scheduling behavior configurable by @ddelange in https://github.com/kserve/kserve/pull/2627
• Extract modelmesh part in helm chart by @hhk7734 in https://github.com/kserve/kserve/pull/2704
• chown python virtual env path to runtime user by @ReToCode in https://github.com/kserve/kserve/pull/2845
• Add cherry pick github action by @yuzisun in https://github.com/kserve/kserve/pull/2707
• Adding token for cherry-pick action. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2716
• Upgrading cherry pick action to v1.0.9 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2735
• Use buildkit for building docker images by @sivanantha321 in https://github.com/kserve/kserve/pull/2848
• Break down the Serving and net-istio artifact downloads into their own release trains by @matzew in https://github.com/kserve/kserve/pull/2890

Dependency Updates

• Loosen protobuf and numpy dependency by @andyi2it in https://github.com/kserve/kserve/pull/2673
• Bump pillow from 9.0.1 to 9.3.0 in /python/custom_transformer by @dependabot in https://github.com/kserve/kserve/pull/2677
• Fix dependency issue and remove pinned pip version in xgbserver by @dependabot in https://github.com/kserve/kserve/pull/2689
• Fix running out of disk space in e2e by @andyi2it in https://github.com/kserve/kserve/pull/2765
• Updating Knative Serving and Istio to their latest version by @matzew in https://github.com/kserve/kserve/pull/2697
• Fix formatting and controller tests by @yuzisun in https://github.com/kserve/kserve/pull/2783
• Fix minimum k8s version in quick install by @sivanantha321 in https://github.com/kserve/kserve/pull/2791
• Bump cryptography from 38.0.4 to 39.0.1 in /python/sklearnserver by @dependabot in https://github.com/kserve/kserve/pull/2803
• Bump torch from 1.13.0 to 1.13.1 in /python/aixexplainer by @dependabot in https://github.com/kserve/kserve/pull/2802
• Bump golang.org/x/net from 0.0.0-20220225172249-27dd8689420f to 0.7.0 in /qpext by @dependabot in https://github.com/kserve/kserve/pull/2805
• Bump golang.org/x/crypto from 0.0.0-20200622213623-75b288015ac9 to 0.1.0 in /docs/samples/graph/bgtest/bgtest by @dependabot in https://github.com/kserve/kserve/pull/2806
• Bump pillow from 9.0.1 to 9.3.0 in /python/custom_model by @dependabot in https://github.com/kserve/kserve/pull/2804
• Bump opencv-python from 3.4.18.65 to 4.2.0.32 in /python/paddleserver by @dependabot in https://github.com/kserve/kserve/pull/2807
• Bump golang.org/x/net from 0.4.0 to 0.7.0 by @dependabot in https://github.com/kserve/kserve/pull/2827
• Loosen tritonclient and azure storage blob dependencies by @sivanantha321 in https://github.com/kserve/kserve/pull/2815
• Upgrade kustomization.yaml to support kustomize 5.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/2841
• Add support for k8s 1.26 by @sivanantha321 in https://github.com/kserve/kserve/pull/2835
• Bump the Go version for the builder image by @skonto in https://github.com/kserve/kserve/pull/2860
• Added support for python 3.10 and removed python 3.7 references by @andyi2it in https://github.com/kserve/kserve/pull/2832
• Upgrade mlserver version to 1.3.2 by @sivanantha321 in https://github.com/kserve/kserve/pull/2910
• Go 1.20 upgrade by @sivanantha321 in https://github.com/kserve/kserve/pull/2914
• Update makefile by @sivanantha321 in https://github.com/kserve/kserve/pull/2920

New Contributors

• @nagar-ajay made their first contribution in https://github.com/kserve/kserve/pull/2662
• @swapkh91 made their first contribution in https://github.com/kserve/kserve/pull/2609
• @kandrio made their first contribution in https://github.com/kserve/kserve/pull/2357
• @chirag-orbittec made their first contribution in https://github.com/kserve/kserve/pull/2687
• @pascalwhoop made their first contribution in https://github.com/kserve/kserve/pull/2754
• @matzew made their first contribution in https://github.com/kserve/kserve/pull/2697
• @peterableda made their first contribution in https://github.com/kserve/kserve/pull/2666
• @aliok made their first contribution in https://github.com/kserve/kserve/pull/2787
• @sivanantha321 made their first contribution in https://github.com/kserve/kserve/pull/2791
• @Naegionn made their first contribution in https://github.com/kserve/kserve/pull/2797
• @ReToCode made their first contribution in https://github.com/kserve/kserve/pull/2839
• @hhk7734 made their first contribution in https://github.com/kserve/kserve/pull/2704
• @skonto made their first contribution in https://github.com/kserve/kserve/pull/2860
• @krazik-intuit made their first contribution in https://github.com/kserve/kserve/pull/2877
• @SatishBethi made their first contribution in https://github.com/kserve/kserve/pull/2524
• @taneem-ibrahim made their first contribution in https://github.com/kserve/kserve/pull/2907
• @hclchimumu made their first contribution in https://github.com/kserve/kserve/pull/2896

Full Changelog: https://github.com/kserve/kserve/compare/v0.10.0...v0.11.0-rc0

What's Changed

• Fix KUBE_VERSION variable in quick_install.sh file by @nagar-ajay in https://github.com/kserve/kserve/pull/2662
• Loosen protobuf and numpy dependency by @andyi2it in https://github.com/kserve/kserve/pull/2673
• Update quick install script to add Cluster Autoscaler and istiod memory leakage fix fields by @swapkh91 in https://github.com/kserve/kserve/pull/2609
• Feature enable ingress for path based routing by @kandrio in https://github.com/kserve/kserve/pull/2357
• Bump pillow from 9.0.1 to 9.3.0 in /python/custom_transformer by @dependabot in https://github.com/kserve/kserve/pull/2677
• Fix dependency issue and remove pinned pip version in xgbserver by @dependabot in https://github.com/kserve/kserve/pull/2689
• Fixing the dockerfile to run as non-root user by @chirag-orbittec in https://github.com/kserve/kserve/pull/2687
• Allowing setting minReplicas for IG router. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2679
• disable modelmesh helm e2e test by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2702
• Support parameters in InferInput and InferOutput by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2699
• Add cherry pick github action by @yuzisun in https://github.com/kserve/kserve/pull/2707
• update kserve model method signatures in docs by @andyi2it in https://github.com/kserve/kserve/pull/2713
• Add check for adding gpu tag suffix when image field is specified by @yuzisun in https://github.com/kserve/kserve/pull/2709
• Adding token for cherry-pick action. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2716
• update outlier detection example by @andyi2it in https://github.com/kserve/kserve/pull/2701
• Use fork for multiprocessing mode by @yuzisun in https://github.com/kserve/kserve/pull/2718
• Fix knative installation failure in e2e test by @andyi2it in https://github.com/kserve/kserve/pull/2726
• Update OWNERS by @yuzisun in https://github.com/kserve/kserve/pull/2724
• Adding podaffinity and resourcerequirments to IG Spec by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2711
• Feat: adds huggingface bloom example to torchserve by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2466
• Upgrading cherry pick action to v1.0.9 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2735
• Creating new manifests for v0.10.1 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2736

New Contributors

• @nagar-ajay made their first contribution in https://github.com/kserve/kserve/pull/2662
• @swapkh91 made their first contribution in https://github.com/kserve/kserve/pull/2609
• @kandrio made their first contribution in https://github.com/kserve/kserve/pull/2357
• @chirag-orbittec made their first contribution in https://github.com/kserve/kserve/pull/2687

Full Changelog: https://github.com/kserve/kserve/compare/v0.10.0...v0.10.1

🌈 What's New?

Core Inference

• Capture exit code in model status by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2290
• Added support for loading models with custom name by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2252
• Support Knative rollout duration annotation by @andyi2it in https://github.com/kserve/kserve/pull/2300
• Allows to make Istio and VirtualServices optional for serverless mode by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2380
• Add prometheus metrics for kserve model server by @alexagriffith in https://github.com/kserve/kserve/pull/2425
• Add prometheus port configs for aggregating metrics in queue proxy by @alexagriffith in https://github.com/kserve/kserve/pull/2459
• Add queue proxy ext for metrics aggregation by @alexagriffith in https://github.com/kserve/kserve/pull/2478
• FastAPI: Separate model server and data plane by @sukumargaonkar @xfu83 in https://github.com/kserve/kserve/pull/2444
• Make webhook port number configurable by @sel in https://github.com/kserve/kserve/pull/2498
• Support V2 GRPC for KServe Model Server by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2415
• Add Unified Inference Type and refactor REST/gRPC server code by @yuzisun in https://github.com/kserve/kserve/pull/2629
• add model_ready v2 endpoint by @alexagriffith in https://github.com/kserve/kserve/pull/2617
• Start uvicorn server in multiple process as per worker count by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2573

Serving Runtimes

• Add labels and annotations to ServingRuntimePodSpec by @lizzzcai in https://github.com/kserve/kserve/pull/2440
• Add ImagePullSecrets to ServingRuntimePodSpec by @lizzzcai in https://github.com/kserve/kserve/pull/2443
• Bump torchserve version to 0.7.0 by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2530

Advanced Inference

• Propagating IG headers to it's nodes. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2396

Storage Provider

• AWS IRSA S3 Support by @matty-rose in https://github.com/kserve/kserve/pull/2373
• Retrieve SAS token for Azure storage by @tjandy98 in https://github.com/kserve/kserve/pull/2418
• Supports more authentication approaches on Azure in Storage Initializer by @laozc in https://github.com/kserve/kserve/pull/2014
• Supports more authentication approaches on Azure in Storage Initializer - Build fix by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2481

Multi-Arch Image

• Adding support for linux/ppc64le in github action for kserve-controller by @adilhusain-s in https://github.com/kserve/kserve/pull/2550
• Adding support for linux/ppc64le arch in github action for kserve-agent by @adilhusain-s in https://github.com/kserve/kserve/pull/2549
• Adding multi-arch support for linux-ppc64le for router by @adilhusain-s in https://github.com/kserve/kserve/pull/2605
• Adding multi-arch support for linux-ppc64le for qpext by @adilhusain-s in https://github.com/kserve/kserve/pull/2604
• Fix multi-arch docker publish by @ddelange in https://github.com/kserve/kserve/pull/2619

⚠️ What's Changed

• Cleanup InferenceService configmap for ML framework related fields by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2225
  Warning: If you still have inference service predictors which are not mutated by the webook to convert to the new model spec introduced since 0.8, you need to make a simple spec update to have them go through the mutating webhook.

• Pass request headers to predict method (#2284) by @andyi2it in https://github.com/kserve/kserve/pull/2360
  Warning: the preprocess, predict and postprocess now requires passing the additional argument with headers.

🐛 What's Fixed

• Fix cluster local label InferenceService by @TimKleinloog in https://github.com/kserve/kserve/pull/2101
• Restoring init container support. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2475
• Make aix use default image only if no image is provided by @andyi2it in https://github.com/kserve/kserve/pull/2503
• Change cluster-local label to networking.knative.dev/visibility by @tenzen-y in https://github.com/kserve/kserve/pull/2518
• Update with dry-run before diffing deployments by @cmaddalozzo in https://github.com/kserve/kserve/pull/2490
• storage-initializer: Let boto3 decide the endpoint for S3 by @dimara in https://github.com/kserve/kserve/pull/2377
• Fix failure to create gRPC isvc when specifying multiple ContainerPorts by @andyi2it in https://github.com/kserve/kserve/pull/2464
• fix light gbm model format by @alexagriffith in https://github.com/kserve/kserve/pull/2640

⬆️ Version Upgrade

• Update quick install to use 0.9.0 by @yuzisun in https://github.com/kserve/kserve/pull/2362
• update ray to 2.0.0 by @park12sj in https://github.com/kserve/kserve/pull/2410
• Go 1.18 upgrade by @yuzisun in https://github.com/kserve/kserve/pull/2420
• Reduce numpy version constraints by @alembiewski in https://github.com/kserve/kserve/pull/2424
• Update quick install knative version to 1.7.0 by @alexagriffith in https://github.com/kserve/kserve/pull/2431
• Update quick install to use Istio 1.15 by @yuzisun in https://github.com/kserve/kserve/pull/2446
• Updated yq version (v4.28.1) by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2480
• Loosen boto3 requirement by @ddelange in https://github.com/kserve/kserve/pull/2644
• Bump kube-rbac-proxy version for kserve-controller by @ddelange in https://github.com/kserve/kserve/pull/2628

🔨 Project SDLC

• Regenerate the Go client by code-generator by @tenzen-y in https://github.com/kserve/kserve/pull/2458
• Code coverage by @andyi2it in https://github.com/kserve/kserve/pull/2351
• remove pytorchserver dead code by @alexagriffith in https://github.com/kserve/kserve/pull/2453
• Update KServe generated client code by @yuzisun in https://github.com/kserve/kserve/pull/2492
• Added a pytest ini to register the markers by @andyi2it in https://github.com/kserve/kserve/pull/2505
• Add security vulnerabilities reporting process by @yuzisun in https://github.com/kserve/kserve/pull/2523
• Add openssf best practice badge by @yuzisun in https://github.com/kserve/kserve/pull/2525
• Updated docker build to use a cpu only version of torchvision by @andyi2it in https://github.com/kserve/kserve/pull/2515
• Adding new manifests for 0.10.0 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2544
• Update configmap for helm chart v0.10.0-rc0 by @yuzisun in https://github.com/kserve/kserve/pull/2545
• Fix kserve annotation constants by @ddelange in https://github.com/kserve/kserve/pull/2491
• removed arch dependency for multiarc support by @pranavpandit1 in https://github.com/kserve/kserve/pull/2476
• Fixing indentation bug in image patch config by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2539

Security Patches

• Optimize docker image builds by @andyi2it in https://github.com/kserve/kserve/pull/2319
• Update versions for art-explainer to resolve several critical CVEs by @MessKon in https://github.com/kserve/kserve/pull/2272
• Vulnerability fixes for kserve and model images by @andyi2it in https://github.com/kserve/kserve/pull/2320
• Patch fixed critical CVEs in kserve/alibi-explainer by @MessKon in https://github.com/kserve/kserve/pull/2270
• aix-explainer: update versions to fix CVEs by @MessKon in https://github.com/kserve/kserve/pull/2364

📝 Documentation Update

• fix: torchserve-grpc client by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2353
• Update KServe main page README by @yuzisun in https://github.com/kserve/kserve/pull/2375
• Fix typos in main README by @rafvasq in https://github.com/kserve/kserve/pull/2384
• Update python/kserve dependency and art example by @yuzisun in https://github.com/kserve/kserve/pull/2391
• fix: update torchserve readme links by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2394
• Add script to identify broken links by @ckadner in https://github.com/kserve/kserve/pull/2423
• Update CIFAR-10 Outlier Detector sample by @rafvasq in https://github.com/kserve/kserve/pull/2472
• Add an example of Lime text explainer from AIX360 toolkit by @C1berwiz in https://github.com/kserve/kserve/pull/2355
• Update sample YAMLs for s3 secrets to use right annotation by @dilverse in https://github.com/kserve/kserve/pull/2528
• Copy-edit torchserve readme by @rafvasq in https://github.com/kserve/kserve/pull/2531
• fix: set default torchserve model store uri to v1 by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2635
• Point transformer doc to website repo by @yuzisun in https://github.com/kserve/kserve/pull/2623
• fix: Incorrect URL when making predictions via curl by @terrytangyuan in https://github.com/kserve/kserve/pull/2626

Full Changelog

• Optimize docker image builds by @andyi2it in https://github.com/kserve/kserve/pull/2319
• Update versions for art-explainer to resolve several critical CVEs by @MessKon in https://github.com/kserve/kserve/pull/2272
• Vulnerability fixes for kserve and model images by @andyi2it in https://github.com/kserve/kserve/pull/2320
• Capture exit code in model status by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2290
• Update quick install to use 0.9.0 by @yuzisun in https://github.com/kserve/kserve/pull/2362
• Update quick install to use 0.9.0 by @yuzisun in https://github.com/kserve/kserve/pull/2363
• Patch fixed critical CVEs in kserve/alibi-explainer by @MessKon in https://github.com/kserve/kserve/pull/2270
• aix-explainer: update versions to fix CVEs by @MessKon in https://github.com/kserve/kserve/pull/2364
• fix: torchserve-grpc client by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2353
• Update KServe main page README by @yuzisun in https://github.com/kserve/kserve/pull/2375
• Added support for loading models with custom name by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2252
• Fix typos in main README by @rafvasq in https://github.com/kserve/kserve/pull/2384
• Add rollout duration feature by @andyi2it in https://github.com/kserve/kserve/pull/2300
• Update python/kserve dependency and art example by @yuzisun in https://github.com/kserve/kserve/pull/2391
• fix: update torchserve readme links by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2394
• AWS IRSA S3 Support by @matty-rose in https://github.com/kserve/kserve/pull/2373
• storage-initializer: Let boto3 decide the endpoint for S3 by @dimara in https://github.com/kserve/kserve/pull/2377
• Allows to make Istio and VirtualServices optional by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2380
• update ray to 2.0.0 by @park12sj in https://github.com/kserve/kserve/pull/2410
• Cleanup InferenceService configmap for ML framework related fields by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2225
• Go 1.18 upgrade by @yuzisun in https://github.com/kserve/kserve/pull/2420
• Reduce numpy version constraints by @alembiewski in https://github.com/kserve/kserve/pull/2424
• Add script to identify broken links by @ckadner in https://github.com/kserve/kserve/pull/2423
• Pass request headers to predict method (#2284) by @andyi2it in https://github.com/kserve/kserve/pull/2360
• update quick install knative version to 1.7.0 by @alexagriffith in https://github.com/kserve/kserve/pull/2431
• add prometheus metrics for kserve model server by @alexagriffith in https://github.com/kserve/kserve/pull/2425
• add labels and annotations to ServingRuntimePodSpec by @lizzzcai in https://github.com/kserve/kserve/pull/2440
• Update quick install to use Istio 1.15 by @yuzisun in https://github.com/kserve/kserve/pull/2446
• remove pytorchserver dead code by @alexagriffith in https://github.com/kserve/kserve/pull/2453
• adding prometheus port configs for aggregating metrics in queue proxy by @alexagriffith in https://github.com/kserve/kserve/pull/2459
• Regenerate the Go client by code-generator by @tenzen-y in https://github.com/kserve/kserve/pull/2458
• Retrieve SAS token by @tjandy98 in https://github.com/kserve/kserve/pull/2418
• Code coverage by @andyi2it in https://github.com/kserve/kserve/pull/2351
• Add ImagePullSecrets to ServingRuntimePodSpec by @lizzzcai in https://github.com/kserve/kserve/pull/2443
• Update CIFAR-10 Outlier Detector sample by @rafvasq in https://github.com/kserve/kserve/pull/2472
• Fix cluster local label InferenceService by @TimKleinloog in https://github.com/kserve/kserve/pull/2101
• Add an example of Lime text explainer from AIX360 toolkit by @C1berwiz in https://github.com/kserve/kserve/pull/2355
• FastAPI: Separate model server and data plane by @sukumargaonkar in https://github.com/kserve/kserve/pull/2444
• Supports more authentication approaches on Azure in Storage Initializer by @laozc in https://github.com/kserve/kserve/pull/2014
• Updated yq version (v4.28.1) by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2480
• Supports more authentication approaches on Azure in Storage Initializer - Build fix by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2481
• Propagating IG headers to it's nodes. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2396
• Agriffith96/add queue proxy ext by @alexagriffith in https://github.com/kserve/kserve/pull/2478
• Restoring init container support. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2475
• Update KServe generated client code by @yuzisun in https://github.com/kserve/kserve/pull/2492
• Make webhook port number configurable by @sel in https://github.com/kserve/kserve/pull/2498
• Added a pytest ini to register the markers by @andyi2it in https://github.com/kserve/kserve/pull/2505
• Make aix use default image only if no image is provided by @andyi2it in https://github.com/kserve/kserve/pull/2503
• Support V2 GRPC for KServe Model Server by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2415
• Updated docker build to use a cpu only version of torchvision by @andyi2it in https://github.com/kserve/kserve/pull/2515
• Change cluster-local label to networking.knative.dev/visibility by @tenzen-y in https://github.com/kserve/kserve/pull/2518
• Add security vulnerabilities reporting process by @yuzisun in https://github.com/kserve/kserve/pull/2523
• Add openssf best practice badge by @yuzisun in https://github.com/kserve/kserve/pull/2525
• Fix kserve annotation constants by @ddelange in https://github.com/kserve/kserve/pull/2491
• removed arch dependency for multiarc support by @pranavpandit1 in https://github.com/kserve/kserve/pull/2476
• Update sample YAMLs for s3 secrets to use right annotation by @dilverse in https://github.com/kserve/kserve/pull/2528
• Bump torchserve version by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2530
• Fixing indentation bug in image patch config by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2539
• Copy-edit torchserve readme by @rafvasq in https://github.com/kserve/kserve/pull/2531
• Update with dry-run before diffing deployments by @cmaddalozzo in https://github.com/kserve/kserve/pull/2490
• Adding new manifests for 0.10.0-rc0 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2544
• Update configmap for helm chart v0.10.0-rc0 by @yuzisun in https://github.com/kserve/kserve/pull/2545
• Update OWNERS by @alexagriffith in https://github.com/kserve/kserve/pull/2540
• Update quick install to use v0.10.0-rc0 by @sukumargaonkar in https://github.com/kserve/kserve/pull/2547
• Update OWNERS by @sukumargaonkar in https://github.com/kserve/kserve/pull/2546
• move kserve crd into separate chart by @yuzisun in https://github.com/kserve/kserve/pull/2552
• remove redundant kserve-config configmap by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2555
• Made changes to fix issues with quick-install version parsing by @andyi2it in https://github.com/kserve/kserve/pull/2563
• Fix grpc is not working with logger by @andyi2it in https://github.com/kserve/kserve/pull/2463
• user defined model name overwrite issue fix by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2342
• make prom metric names consistent by @alexagriffith in https://github.com/kserve/kserve/pull/2577
• Snyk scan by @andyi2it in https://github.com/kserve/kserve/pull/2378
• Replace ioutil package with os and io package by @tenzen-y in https://github.com/kserve/kserve/pull/2581
• Handle scenario where annotations are not given in raw deployment mode by @andyi2it in https://github.com/kserve/kserve/pull/2569
• sync cluster runtimes by @alexagriffith in https://github.com/kserve/kserve/pull/2593
• Removing duplicate servingruntimes CRD by @sukumargaonkar in https://github.com/kserve/kserve/pull/2595
• Change to fix sdk replace does not wait for new isvc to be ready by @andyi2it in https://github.com/kserve/kserve/pull/1925
• Update KServe 2023 Roadmap by @yuzisun in https://github.com/kserve/kserve/pull/2526
• Upgrade the K8s version to 1.24 for tests by @tenzen-y in https://github.com/kserve/kserve/pull/2584
• Update knative serving go dependency by @yuzisun in https://github.com/kserve/kserve/pull/2603
• Add constrains for numpy<1.24.0 by @yuzisun in https://github.com/kserve/kserve/pull/2606
• TR-16622 Ingress Kubernetes manifest upgrade to v1 by @stephanschielke in https://github.com/kserve/kserve/pull/2586
• Fix serverless installation mode link by @panli889 in https://github.com/kserve/kserve/pull/2610
• Bump Torchserve version to 0.7.0 by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2611
• adding prom tags and tests by @alexagriffith in https://github.com/kserve/kserve/pull/2589
• Bumping up version to 0.10.0 for all the manifests. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2615
• Adding support for linux/ppc64le in github action for kserve-controller by @adilhusain-s in https://github.com/kserve/kserve/pull/2550
• Adding support for linux/ppc64le arch in github action for kserve-agent by @adilhusain-s in https://github.com/kserve/kserve/pull/2549
• Adding multi-arch support for linux-ppc64le for router by @adilhusain-s in https://github.com/kserve/kserve/pull/2605
• Update to v0.10.0-rc1 release manifests by @yuzisun in https://github.com/kserve/kserve/pull/2616
• Adding multi-arch support for linux-ppc64le for qpext by @adilhusain-s in https://github.com/kserve/kserve/pull/2604
• Fix multi-arch docker publish by @ddelange in https://github.com/kserve/kserve/pull/2619
• Start uvicorn server in multiple process as per worker count by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2573
• Point transformer doc to website repo by @yuzisun in https://github.com/kserve/kserve/pull/2623
• fix: Incorrect URL when making predictions via curl by @terrytangyuan in https://github.com/kserve/kserve/pull/2626
• Added github action to test kserve helm by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2588
• add model_ready v2 endpoint by @alexagriffith in https://github.com/kserve/kserve/pull/2617
• Update PRESENTATIONS.md by @yuzisun in https://github.com/kserve/kserve/pull/2630
• Use kubectl -k instead of kustomize by @yuzisun in https://github.com/kserve/kserve/pull/2634
• Bump kube-rbac-proxy version for kserve-controller by @ddelange in https://github.com/kserve/kserve/pull/2628
• fix: set default torchserve model store uri to v1 by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2635
• fix light gbm model format by @alexagriffith in https://github.com/kserve/kserve/pull/2640
• Loosen boto3 requirement by @ddelange in https://github.com/kserve/kserve/pull/2644
• Update slack link by @yuzisun in https://github.com/kserve/kserve/pull/2648
• [bugfix]: support kubectl server version correctly by @anencore94 in https://github.com/kserve/kserve/pull/2652
• Update ModelMesh version to v0.10.0 by @ckadner in https://github.com/kserve/kserve/pull/2645
• Add Unified Inference Type and refactor REST/gRPC server code by @yuzisun in https://github.com/kserve/kserve/pull/2629
• Bumping version to 0.10.0 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2656
• Update to 2023 license by @yuzisun in https://github.com/kserve/kserve/pull/2657
• Fix failure to create gRPC isvc when specifying multiple ContainerPorts by @andyi2it in https://github.com/kserve/kserve/pull/2464

New Contributors

• @MessKon made their first contribution in https://github.com/kserve/kserve/pull/2272
• @rafvasq made their first contribution in https://github.com/kserve/kserve/pull/2384
• @dimara made their first contribution in https://github.com/kserve/kserve/pull/2377
• @park12sj made their first contribution in https://github.com/kserve/kserve/pull/2410
• @alembiewski made their first contribution in https://github.com/kserve/kserve/pull/2424
• @ckadner made their first contribution in https://github.com/kserve/kserve/pull/2423
• @alexagriffith made their first contribution in https://github.com/kserve/kserve/pull/2431
• @lizzzcai made their first contribution in https://github.com/kserve/kserve/pull/2440
• @tenzen-y made their first contribution in https://github.com/kserve/kserve/pull/2458
• @tjandy98 made their first contribution in https://github.com/kserve/kserve/pull/2418
• @TimKleinloog made their first contribution in https://github.com/kserve/kserve/pull/2101
• @C1berwiz made their first contribution in https://github.com/kserve/kserve/pull/2355
• @rachitchauhan43 made their first contribution in https://github.com/kserve/kserve/pull/2396
• @sel made their first contribution in https://github.com/kserve/kserve/pull/2498
• @pranavpandit1 made their first contribution in https://github.com/kserve/kserve/pull/2476
• @dilverse made their first contribution in https://github.com/kserve/kserve/pull/2528
• @cmaddalozzo made their first contribution in https://github.com/kserve/kserve/pull/2490
• @stephanschielke made their first contribution in https://github.com/kserve/kserve/pull/2586
• @panli889 made their first contribution in https://github.com/kserve/kserve/pull/2610
• @adilhusain-s made their first contribution in https://github.com/kserve/kserve/pull/2550
• @anencore94 made their first contribution in https://github.com/kserve/kserve/pull/2652

Full Changelog: https://github.com/kserve/kserve/compare/v0.9.0...v0.10.0

What's Changed

• Update quick install to use v0.10.0-rc0 by @sukumargaonkar in https://github.com/kserve/kserve/pull/2547
• move kserve crd into separate chart by @yuzisun in https://github.com/kserve/kserve/pull/2552
• remove redundant kserve-config configmap by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2555
• Made changes to fix issues with quick-install version parsing by @andyi2it in https://github.com/kserve/kserve/pull/2563
• Fix grpc is not working with logger by @andyi2it in https://github.com/kserve/kserve/pull/2463
• user defined model name overwrite issue fix by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2342
• make prom metric names consistent by @alexagriffith in https://github.com/kserve/kserve/pull/2577
• Snyk scan by @andyi2it in https://github.com/kserve/kserve/pull/2378
• Replace ioutil package with os and io package by @tenzen-y in https://github.com/kserve/kserve/pull/2581
• Handle scenario where annotations are not given in raw deployment mode by @andyi2it in https://github.com/kserve/kserve/pull/2569
• sync cluster runtimes by @alexagriffith in https://github.com/kserve/kserve/pull/2593
• Removing duplicate servingruntimes CRD by @sukumargaonkar in https://github.com/kserve/kserve/pull/2595
• Change to fix sdk replace does not wait for new isvc to be ready by @andyi2it in https://github.com/kserve/kserve/pull/1925
• Update KServe 2023 Roadmap by @yuzisun in https://github.com/kserve/kserve/pull/2526
• Upgrade the K8s version to 1.24 for tests by @tenzen-y in https://github.com/kserve/kserve/pull/2584
• Update knative serving go dependency by @yuzisun in https://github.com/kserve/kserve/pull/2603
• Add constrains for numpy<1.24.0 by @yuzisun in https://github.com/kserve/kserve/pull/2606
• TR-16622 Ingress Kubernetes manifest upgrade to v1 by @stephanschielke in https://github.com/kserve/kserve/pull/2586
• Fix serverless installation mode link by @panli889 in https://github.com/kserve/kserve/pull/2610
• Bump Torchserve version to 0.7.0 by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2611
• adding prom tags and tests by @alexagriffith in https://github.com/kserve/kserve/pull/2589
• Bumping up version to 0.10.0 for all the manifests. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2615
• Adding support for linux/ppc64le in github action for kserve-controller by @adilhusain-s in https://github.com/kserve/kserve/pull/2550
• Adding support for linux/ppc64le arch in github action for kserve-agent by @adilhusain-s in https://github.com/kserve/kserve/pull/2549
• Adding multi-arch support for linux-ppc64le for router by @adilhusain-s in https://github.com/kserve/kserve/pull/2605
• Update to v0.10.0-rc1 release manifests by @yuzisun in https://github.com/kserve/kserve/pull/2616
• Adding multi-arch support for linux-ppc64le for qpext by @adilhusain-s in https://github.com/kserve/kserve/pull/2604
• Fix multi-arch docker publish by @ddelange in https://github.com/kserve/kserve/pull/2619
• Start uvicorn server in multiple process as per worker count by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2573

New Contributors

• @stephanschielke made their first contribution in https://github.com/kserve/kserve/pull/2586
• @panli889 made their first contribution in https://github.com/kserve/kserve/pull/2610
• @adilhusain-s made their first contribution in https://github.com/kserve/kserve/pull/2550

Full Changelog: https://github.com/kserve/kserve/compare/v0.10.0-rc0...v0.10.0-rc1

🌈 What's New?

Core Inference

• Capture exit code in model status by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2290
• Added support for loading models with custom name by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2252
• Support Knative rollout duration annotation by @andyi2it in https://github.com/kserve/kserve/pull/2300
• Allows to make Istio and VirtualServices optional by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2380
• Pass request headers to predict method (#2284) by @andyi2it in https://github.com/kserve/kserve/pull/2360
• add prometheus metrics for kserve model server by @alexagriffith in https://github.com/kserve/kserve/pull/2425
• adding prometheus port configs for aggregating metrics in queue proxy by @alexagriffith in https://github.com/kserve/kserve/pull/2459
• Fix cluster local label InferenceService by @TimKleinloog in https://github.com/kserve/kserve/pull/2101
• FastAPI: Separate model server and data plane by @sukumargaonkar @xfu83 in https://github.com/kserve/kserve/pull/2444
• Agriffith96/add queue proxy ext by @alexagriffith in https://github.com/kserve/kserve/pull/2478
• Restoring init container support. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2475
• Make webhook port number configurable by @sel in https://github.com/kserve/kserve/pull/2498
• Make aix use default image only if no image is provided by @andyi2it in https://github.com/kserve/kserve/pull/2503
• Support V2 GRPC for KServe Model Server by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2415
• Change cluster-local label to networking.knative.dev/visibility by @tenzen-y in https://github.com/kserve/kserve/pull/2518
• Update with dry-run before diffing deployments by @cmaddalozzo in https://github.com/kserve/kserve/pull/2490

Serving Runtimes

• add labels and annotations to ServingRuntimePodSpec by @lizzzcai in https://github.com/kserve/kserve/pull/2440
• Add ImagePullSecrets to ServingRuntimePodSpec by @lizzzcai in https://github.com/kserve/kserve/pull/2443
• Bump torchserve version by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2530

Advanced Inference

• Propagating IG headers to it's nodes. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2396

Storage Provider

• AWS IRSA S3 Support by @matty-rose in https://github.com/kserve/kserve/pull/2373
• storage-initializer: Let boto3 decide the endpoint for S3 by @dimara in https://github.com/kserve/kserve/pull/2377
• Retrieve SAS token for Azure storage by @tjandy98 in https://github.com/kserve/kserve/pull/2418
• Supports more authentication approaches on Azure in Storage Initializer by @laozc in https://github.com/kserve/kserve/pull/2014
• Supports more authentication approaches on Azure in Storage Initializer - Build fix by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2481

What's Changed

• Cleanup InferenceService configmap for ML framework related fields by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2225

Version Upgrade

• Update quick install to use 0.9.0 by @yuzisun in https://github.com/kserve/kserve/pull/2362
• update ray to 2.0.0 by @park12sj in https://github.com/kserve/kserve/pull/2410
• Go 1.18 upgrade by @yuzisun in https://github.com/kserve/kserve/pull/2420
• Reduce numpy version constraints by @alembiewski in https://github.com/kserve/kserve/pull/2424
• update quick install knative version to 1.7.0 by @alexagriffith in https://github.com/kserve/kserve/pull/2431
• Update quick install to use Istio 1.15 by @yuzisun in https://github.com/kserve/kserve/pull/2446
• Updated yq version (v4.28.1) by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2480

Project SDLC

• Regenerate the Go client by code-generator by @tenzen-y in https://github.com/kserve/kserve/pull/2458
• Code coverage by @andyi2it in https://github.com/kserve/kserve/pull/2351
• remove pytorchserver dead code by @alexagriffith in https://github.com/kserve/kserve/pull/2453
• Update KServe generated client code by @yuzisun in https://github.com/kserve/kserve/pull/2492
• Added a pytest ini to register the markers by @andyi2it in https://github.com/kserve/kserve/pull/2505
• Add security vulnerabilities reporting process by @yuzisun in https://github.com/kserve/kserve/pull/2523
• Add openssf best practice badge by @yuzisun in https://github.com/kserve/kserve/pull/2525
• Updated docker build to use a cpu only version of torchvision by @andyi2it in https://github.com/kserve/kserve/pull/2515
• Adding new manifests for 0.10.0 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2544
• Update configmap for helm chart v0.10.0-rc0 by @yuzisun in https://github.com/kserve/kserve/pull/2545
• Fix kserve annotation constants by @ddelange in https://github.com/kserve/kserve/pull/2491
• removed arch dependency for multiarc support by @pranavpandit1 in https://github.com/kserve/kserve/pull/2476
• Fixing indentation bug in image patch config by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2539

Security Patches

• Optimize docker image builds by @andyi2it in https://github.com/kserve/kserve/pull/2319
• Update versions for art-explainer to resolve several critical CVEs by @MessKon in https://github.com/kserve/kserve/pull/2272
• Vulnerability fixes for kserve and model images by @andyi2it in https://github.com/kserve/kserve/pull/2320
• Patch fixed critical CVEs in kserve/alibi-explainer by @MessKon in https://github.com/kserve/kserve/pull/2270
• aix-explainer: update versions to fix CVEs by @MessKon in https://github.com/kserve/kserve/pull/2364

Documentation Update

• fix: torchserve-grpc client by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2353
• Update KServe main page README by @yuzisun in https://github.com/kserve/kserve/pull/2375
• Fix typos in main README by @rafvasq in https://github.com/kserve/kserve/pull/2384
• Update python/kserve dependency and art example by @yuzisun in https://github.com/kserve/kserve/pull/2391
• fix: update torchserve readme links by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2394
• Add script to identify broken links by @ckadner in https://github.com/kserve/kserve/pull/2423
• Update CIFAR-10 Outlier Detector sample by @rafvasq in https://github.com/kserve/kserve/pull/2472
• Add an example of Lime text explainer from AIX360 toolkit by @C1berwiz in https://github.com/kserve/kserve/pull/2355
• Update sample YAMLs for s3 secrets to use right annotation by @dilverse in https://github.com/kserve/kserve/pull/2528
• Copy-edit torchserve readme by @rafvasq in https://github.com/kserve/kserve/pull/2531

New Contributors

• @MessKon made their first contribution in https://github.com/kserve/kserve/pull/2272
• @rafvasq made their first contribution in https://github.com/kserve/kserve/pull/2384
• @dimara made their first contribution in https://github.com/kserve/kserve/pull/2377
• @park12sj made their first contribution in https://github.com/kserve/kserve/pull/2410
• @alembiewski made their first contribution in https://github.com/kserve/kserve/pull/2424
• @ckadner made their first contribution in https://github.com/kserve/kserve/pull/2423
• @alexagriffith made their first contribution in https://github.com/kserve/kserve/pull/2431
• @lizzzcai made their first contribution in https://github.com/kserve/kserve/pull/2440
• @tenzen-y made their first contribution in https://github.com/kserve/kserve/pull/2458
• @tjandy98 made their first contribution in https://github.com/kserve/kserve/pull/2418
• @TimKleinloog made their first contribution in https://github.com/kserve/kserve/pull/2101
• @C1berwiz made their first contribution in https://github.com/kserve/kserve/pull/2355
• @rachitchauhan43 made their first contribution in https://github.com/kserve/kserve/pull/2396
• @sel made their first contribution in https://github.com/kserve/kserve/pull/2498
• @pranavpandit1 made their first contribution in https://github.com/kserve/kserve/pull/2476
• @dilverse made their first contribution in https://github.com/kserve/kserve/pull/2528
• @cmaddalozzo made their first contribution in https://github.com/kserve/kserve/pull/2490

Full Changelog: https://github.com/kserve/kserve/compare/v0.9.0...v0.10.0-rc0

🌈 What's New?

In this release we are excited to introduce the new InferenceGraph feature which has long been asked from the community. Also continuing the effort from the last release for unifying the InferenceService API for deploying models on KServe and ModelMesh, ModelMesh is now fully compatible with KServe InferenceService API!

Core Inference

• Add mlflow support by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2034
• Add autoscaling target and metric to isvc components by @andyi2it in https://github.com/kserve/kserve/pull/2082
• Add ingress class name configuration by @pradithya in https://github.com/kserve/kserve/pull/2049
• Add template for generating inference service domain by @pradithya in https://github.com/kserve/kserve/pull/2054
• Add Model Status API to isvc by @pvaneck in https://github.com/kserve/kserve/pull/2084
• Add logic to update ModelStatus by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2088
• Allow InferenceService url scheme to be configurable by @markwinter in https://github.com/kserve/kserve/pull/2202

Advanced Inference

• Initial inference graph API implementation by @yuzisun @Iamlovingit @njhill https://github.com/kserve/kserve/pull/1910
• InferenceGraph python sdk by @andyi2it in https://github.com/kserve/kserve/pull/2341
• Enable transformers to work with ModelMesh by @chinhuang007 in https://github.com/kserve/kserve/pull/2136

Model Storage Provider

• Introduce new storage spec for unified configuration by @Tomcli in https://github.com/kserve/kserve/pull/1899
• Add Azure file share support by @laozc @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2180
• Support webhdfs in storageURI and storage spec by @markwinter in https://github.com/kserve/kserve/pull/2077

Serving Runtime

• Add protocolversion in servingruntime spec by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2118
• Add Volumes to ServingRuntimePodSpec; allow other built-in ServerTypes by @njhill in https://github.com/kserve/kserve/pull/2147
• Allow more fields in servingruntime container spec by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2112
• Add env field to ServingRuntime builtInAdapter settings by @njhill in https://github.com/kserve/kserve/pull/2123

⚠️ What's Changed

• Convert kserve manager from statefulset to deployment to make HA by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2160 https://github.com/kserve/kserve/pull/2348
  statefulset will be removed in 0.10

🐞 Fixes

• Update ray to 1.10 for log4j security vulnerability fix by @markwinter @andyi2it in https://github.com/kserve/kserve/pull/2056 https://github.com/kserve/kserve/pull/2322
• Runtimes installation issue fix by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2071
• Fix: replace image tag issue by @ittus in https://github.com/kserve/kserve/pull/2074
• Fix status RestURL type by @pvaneck in https://github.com/kserve/kserve/pull/2121
• Use default port for raw deployment as fail safe by @andyi2it in https://github.com/kserve/kserve/pull/2116
• Fix canary rollout falling back to previously rolled out version by @wenyangchou in https://github.com/kserve/kserve/pull/2097
• Fix: predict address url on status object by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2146
• Fix downloading model with nested sub folders from gcs by @andyi2it in https://github.com/kserve/kserve/pull/2152
• Delete only the trainedmodel in the namespace where the isvc by @hehe04 in https://github.com/kserve/kserve/pull/2166
• Loosen setuptools lower pin by @ddelange in https://github.com/kserve/kserve/pull/2231
• Fix KServe dependencies conflicts with KFP by @safoinme in https://github.com/kserve/kserve/pull/2295
• Update leader-election-role name by @pvaneck in https://github.com/kserve/kserve/pull/2296
• Fix HPA Scaling for Raw Deployment mode by @Iamlovingit in https://github.com/kserve/kserve/pull/2279
• Use enum value in request validation by @luranhe in https://github.com/kserve/kserve/pull/2249
• Fix: Prevent all predictor defaulting with MM by @pvaneck in https://github.com/kserve/kserve/pull/2288
• Fix incorrect function definition, issue #2258 by @eyalcha in https://github.com/kserve/kserve/pull/2266

⬆️ Version upgrades

• go mod: Upgrade to ginkgo v2 by @haoxins in https://github.com/kserve/kserve/pull/2062
• upgrade alibi version to 0.6.4 by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2092
• Upgrade kserve python dep by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2103
• Bump torchserve version to 0.6.0 by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2214
• Update python dep for kserve sdk by @yuzisun in https://github.com/kserve/kserve/pull/2216
• Upgrade mlserver version to 1.0.0 by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2262

📖 Documentation

• TorchServe - KServe v2 - Examples update by @shrinath-suresh in https://github.com/kserve/kserve/pull/2035
• TorchServe - KServe v2 - bert explanation by @shrinath-suresh in https://github.com/kserve/kserve/pull/2043
• Fix the required K8s version comments by @haoxins in https://github.com/kserve/kserve/pull/2076
• Fix triton + torchscript guidelines to be executable by @Curt-Park in https://github.com/kserve/kserve/pull/2091
• fix: configmap url in sklearn example by @ittus in https://github.com/kserve/kserve/pull/2072
• Fix e2e test example gcs bucket by @yuzisun in https://github.com/kserve/kserve/pull/2134
• Update docs/samples/pipelines/ by @georgetree in https://github.com/kserve/kserve/pull/2122
• Update Infer proto docs to mention BFloat16 type by @rmccorm4 in https://github.com/kserve/kserve/pull/2159
• Add cherry pick script and document cherrypick process by @yuzisun in https://github.com/kserve/kserve/pull/2153
• Made changes to update sdk and docs by running code-gen by @andyi2it in https://github.com/kserve/kserve/pull/2162
• Update documentation for getting Prometheus metrics. by @shrinandj in https://github.com/kserve/kserve/pull/2171
• Update deprecated gcs bucket by @yuzisun in https://github.com/kserve/kserve/pull/2215
• Update Feast transformer to support ModelMesh by @chinhuang007 in https://github.com/kserve/kserve/pull/2204
• update graph sample by @Iamlovingit in https://github.com/kserve/kserve/pull/2223

⚒️ Developer Experience

• Move ComponentExtensionSpec validation to own test file by @markwinter in https://github.com/kserve/kserve/pull/2110
• Add default container annotation by @haoxins in https://github.com/kserve/kserve/pull/2124
• update kserve manager kind as deployment in helm chart by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2172
• Fix kubectl version compatibility issue in post e2e test script by @yuzisun in https://github.com/kserve/kserve/pull/2175
• Add aix-explainer deploy command by @Cheng8994 in https://github.com/kserve/kserve/pull/2174
• Added a specific version for protobuf by @andyi2it in https://github.com/kserve/kserve/pull/2201
• Fix controller manager image patch in CI by @yuzisun in https://github.com/kserve/kserve/pull/2199
• Remove presubmit tests depending on optional-test-infra by @aws-kf-ci-bot in https://github.com/kserve/kserve/pull/2194
• chore: Update E2E tests to use GH Actions by @pvaneck in https://github.com/kserve/kserve/pull/2206
• Add install script for KServe and ModelMesh by @chinhuang007 in https://github.com/kserve/kserve/pull/2032
• Publish helm chart as release asset by @ddelange in https://github.com/kserve/kserve/pull/2189
• e2e test enhancement changes by @andyi2it in https://github.com/kserve/kserve/pull/2237

New Contributors

• @shrinath-suresh made their first contribution in https://github.com/kserve/kserve/pull/2035
• @ittus made their first contribution in https://github.com/kserve/kserve/pull/2074
• @Curt-Park made their first contribution in https://github.com/kserve/kserve/pull/2091
• @georgetree made their first contribution in https://github.com/kserve/kserve/pull/2122
• @wenyangchou made their first contribution in https://github.com/kserve/kserve/pull/2097
• @rmccorm4 made their first contribution in https://github.com/kserve/kserve/pull/2159
• @hehe04 made their first contribution in https://github.com/kserve/kserve/pull/2166
• @Cheng8994 made their first contribution in https://github.com/kserve/kserve/pull/2174
• @shrinandj made their first contribution in https://github.com/kserve/kserve/pull/2171
• @aws-kf-ci-bot made their first contribution in https://github.com/kserve/kserve/pull/2194
• @ddelange made their first contribution in https://github.com/kserve/kserve/pull/2189
• @luranhe made their first contribution in https://github.com/kserve/kserve/pull/2249
• @eyalcha made their first contribution in https://github.com/kserve/kserve/pull/2266
• @safoinme made their first contribution in https://github.com/kserve/kserve/pull/2295

Full Changelog: https://github.com/kserve/kserve/compare/v0.8.0...v0.9.0

🌈 What's New?

Core Inference

• Add mlflow support by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2034
• Add autoscaling target and metric to isvc components by @andyi2it in https://github.com/kserve/kserve/pull/2082
• Add ingress class name configuration by @pradithya in https://github.com/kserve/kserve/pull/2049
• Add template for generating inference service domain by @pradithya in https://github.com/kserve/kserve/pull/2054
• Add Model Status API to isvc by @pvaneck in https://github.com/kserve/kserve/pull/2084
• Add logic to update ModelStatus by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2088
• Allow InferenceService url scheme to be configurable by @markwinter in https://github.com/kserve/kserve/pull/2202

Advanced Inference

• Initial inference graph API implementation by @yuzisun @Iamlovingit @njhill https://github.com/kserve/kserve/pull/1910
• Enable transformers to work with ModelMesh by @chinhuang007 in https://github.com/kserve/kserve/pull/2136

Model Storage Provider

• Introduce new storage spec for unified configuration by @Tomcli in https://github.com/kserve/kserve/pull/1899
• Add Azure file share support by @laozc @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2180
• Support webhdfs in storageURI and storage spec by @markwinter in https://github.com/kserve/kserve/pull/2077

Serving Runtime

• Add protocolversion in servingruntime spec by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2118
• Add Volumes to ServingRuntimePodSpec; allow other built-in ServerTypes by @njhill in https://github.com/kserve/kserve/pull/2147
• Allow more fields in servingruntime container spec by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2112
• Add env field to ServingRuntime builtInAdapter settings by @njhill in https://github.com/kserve/kserve/pull/2123

⚠️ What's Changed

• Convert kserve manager from statefulset to deployment to make HA by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2160

🐞 Fixes

• Update ray to 1.9.2 for log4j security vulnerability fix by @markwinter in https://github.com/kserve/kserve/pull/2056
• Runtimes installation issue fix by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2071
• Fix: replace image tag issue by @ittus in https://github.com/kserve/kserve/pull/2074
• Fix status RestURL type by @pvaneck in https://github.com/kserve/kserve/pull/2121
• Use default port for raw deployment as fail safe by @andyi2it in https://github.com/kserve/kserve/pull/2116
• Fix canary rollout falling back to previously rolled out version by @wenyangchou in https://github.com/kserve/kserve/pull/2097
• Fix: predict address url on status object by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2146
• Fix downloading model with nested sub folders from gcs by @andyi2it in https://github.com/kserve/kserve/pull/2152
• Delete only the trainedmodel in the namespace where the isvc by @hehe04 in https://github.com/kserve/kserve/pull/2166

⬆️ Version upgrades

• go mod: Upgrade to ginkgo v2 by @haoxins in https://github.com/kserve/kserve/pull/2062
• upgrade alibi version to 0.6.4 by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2092
• Upgrade kserve python dep by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2103
• Bump torchserve version to 0.6.0 by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2214
• Update python dep for kserve sdk by @yuzisun in https://github.com/kserve/kserve/pull/2216

📖 Documentation

• TorchServe - KServe v2 - Examples update by @shrinath-suresh in https://github.com/kserve/kserve/pull/2035
• TorchServe - KServe v2 - bert explanation by @shrinath-suresh in https://github.com/kserve/kserve/pull/2043
• Fix the required K8s version comments by @haoxins in https://github.com/kserve/kserve/pull/2076
• Fix triton + torchscript guidelines to be executable by @Curt-Park in https://github.com/kserve/kserve/pull/2091
• fix: configmap url in sklearn example by @ittus in https://github.com/kserve/kserve/pull/2072
• Fix e2e test example gcs bucket by @yuzisun in https://github.com/kserve/kserve/pull/2134
• Update docs/samples/pipelines/ by @georgetree in https://github.com/kserve/kserve/pull/2122
• Update Infer proto docs to mention BFloat16 type by @rmccorm4 in https://github.com/kserve/kserve/pull/2159
• Add cherry pick script and document cherrypick process by @yuzisun in https://github.com/kserve/kserve/pull/2153
• Made changes to update sdk and docs by running code-gen by @andyi2it in https://github.com/kserve/kserve/pull/2162
• Update documentation for getting Prometheus metrics. by @shrinandj in https://github.com/kserve/kserve/pull/2171
• Update deprecated gcs bucket by @yuzisun in https://github.com/kserve/kserve/pull/2215
• Update Feast transformer to support ModelMesh by @chinhuang007 in https://github.com/kserve/kserve/pull/2204
• update graph sample by @Iamlovingit in https://github.com/kserve/kserve/pull/2223

⚒️ Developer Experience

• Move ComponentExtensionSpec validation to own test file by @markwinter in https://github.com/kserve/kserve/pull/2110
• Add default container annotation by @haoxins in https://github.com/kserve/kserve/pull/2124
• update kserve manager kind as deployment in helm chart by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2172
• Fix kubectl version compatibility issue in post e2e test script by @yuzisun in https://github.com/kserve/kserve/pull/2175
• Add aix-explainer deploy command by @Cheng8994 in https://github.com/kserve/kserve/pull/2174
• Added a specific version for protobuf by @andyi2it in https://github.com/kserve/kserve/pull/2201
• Fix controller manager image patch in CI by @yuzisun in https://github.com/kserve/kserve/pull/2199
• Remove presubmit tests depending on optional-test-infra by @aws-kf-ci-bot in https://github.com/kserve/kserve/pull/2194
• chore: Update E2E tests to use GH Actions by @pvaneck in https://github.com/kserve/kserve/pull/2206
• Add install script for KServe and ModelMesh by @chinhuang007 in https://github.com/kserve/kserve/pull/2032
• Publish helm chart as release asset by @ddelange in https://github.com/kserve/kserve/pull/2189

New Contributors

• @shrinath-suresh made their first contribution in https://github.com/kserve/kserve/pull/2035
• @ittus made their first contribution in https://github.com/kserve/kserve/pull/2074
• @Curt-Park made their first contribution in https://github.com/kserve/kserve/pull/2091
• @georgetree made their first contribution in https://github.com/kserve/kserve/pull/2122
• @wenyangchou made their first contribution in https://github.com/kserve/kserve/pull/2097
• @rmccorm4 made their first contribution in https://github.com/kserve/kserve/pull/2159
• @hehe04 made their first contribution in https://github.com/kserve/kserve/pull/2166
• @Cheng8994 made their first contribution in https://github.com/kserve/kserve/pull/2174
• @shrinandj made their first contribution in https://github.com/kserve/kserve/pull/2171
• @aws-kf-ci-bot made their first contribution in https://github.com/kserve/kserve/pull/2194
• @ddelange made their first contribution in https://github.com/kserve/kserve/pull/2189

Full Changelog: https://github.com/kserve/kserve/compare/v0.8.0...v0.9.0-rc0

🌈 What's New?

This release introduces two new CRDs ServingRuntimes and ClusterServingRuntimes with the only difference between these two is that one is namespace-scoped and one is cluster-scoped. A ServingRuntime defines the templates for Pods that can serve one or more particular model formats. Each ServingRuntime defines key information such as the container image of the runtime and a list of the model formats that the runtime supports.

In previous versions of KServe, supported predictor formats and container images were defined in a config map in the control plane namespace. The ServingRuntime CRD should allow for improved flexibility and extensibility for defining or customizing runtimes to how you see fit without having to modify any controller code or any resources in the controller namespace.

Several out-of-the-box ClusterServingRuntimes are provided with KServe so that users can continue to use KServe how they did before without having to define the runtimes themselves.

• Add ServingRuntime support by @pvaneck in https://github.com/kserve/kserve/pull/1901 @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1926
• Support auto selection for servingRuntimes by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1948
• Add multiModel field to ServingRuntime spec by @pvaneck in https://github.com/kserve/kserve/pull/1983
• Python SDK for servingRuntimes by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1946
• Support gRPC between transformer and predictor by @xcjason in https://github.com/kserve/kserve/pull/1933
• Torchserve v2 REST protocol support by @jagadeeshi2i in https://github.com/kserve/kserve/pull/1870
• Update CloudEvent Handling in Python SDK by @markwinter in https://github.com/kserve/kserve/pull/1934
• sklearnserver: allow mixed type inputs by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1972

⚠️ What's Changed

• Rename KF prefixed PythonSDK classes by @markwinter in https://github.com/kserve/kserve/pull/1951
  KFModel -> Model
  KFServer -> ModelServer
  KFModelRepository -> ModelRepository
• KServe's pytorchserver has been deprecated, for PyTorch model KServe now defaults to use TorchServe serving runtime.
• ONNX runtime server has been deprecated, for ONNX model KServe now defaults to use Triton Inference Server.

⬆️ Version upgrades

• Updated cert-manager to v1 version. by @andyi2it in https://github.com/kserve/kserve/pull/1904
• Update ray to 1.9.0 and add ray tests by @markwinter in https://github.com/kserve/kserve/pull/1949
• Upgrade sklearnserver to use scikit-learn==1.0.1 and xgbserver to use xgboost==1.5 by @yuzisun in https://github.com/kserve/kserve/pull/1954
• Bump mlserver to 0.5.3 by @adriangonz in https://github.com/kserve/kserve/pull/1853
• Upgrade Golang to 1.17 by @haoxins in https://github.com/kserve/kserve/pull/1962
• Update KServe controller to use Knative 1.0 version by @yuzisun in https://github.com/kserve/kserve/pull/1969
• Update lightgbm version by @yuzisun in https://github.com/kserve/kserve/pull/2033
• Update helm chart for release v0.8.0 by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2008

🐞 Fixes

• Explainer service account not being attached issue fix by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1868
• storage.py: add more logging and an error condition for s3 by @elukey in https://github.com/kserve/kserve/pull/1883
• Fix model agent when deployed as raw deployment by @andyi2it in https://github.com/kserve/kserve/pull/1891
• Return only JSON responses from KFServer by @markwinter in https://github.com/kserve/kserve/pull/1918
• Throw error if storage initializer can not locate PVC source uri by @yuzisun in https://github.com/kserve/kserve/pull/1940
• Add content type for transformer to predictor HTTP call https://github.com/kserve/kserve/issues/1941 by @caffeinism in https://github.com/kserve/kserve/pull/1950
• Allow to set worker count more than 1 by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1984
• Doc spelling fixes by @jsoref in https://github.com/kserve/kserve/pull/1970
• Allow later versions of google-cloud-storage by @aodahl in https://github.com/kserve/kserve/pull/1978
• Fixes Azure blob download as class is no longer hashable by @laozc in https://github.com/kserve/kserve/pull/1971
• Never ever use the default serviceaccount, but kserve-controller-manager by @juliusvonkohout in https://github.com/kserve/kserve/pull/1996
• Fix security issues in kserve manifest by @yuzisun in https://github.com/kserve/kserve/pull/1997
• Use non root user for python server images by @yuzisun in https://github.com/kserve/kserve/pull/2005
• Fix AIX explainer example pip dependency by @yuzisun in https://github.com/kserve/kserve/pull/2021
• Model agent to support custom container port by @andyi2it in https://github.com/kserve/kserve/pull/1905
• Support extracting archive with directories by @laozc in https://github.com/kserve/kserve/pull/1988
• Fix status condition names by @yuzisun in https://github.com/kserve/kserve/pull/2016
• Fix canary rollout falling back to prev rolledout version by @yuzisun in https://github.com/kserve/kserve/pull/2040

Full Changelog: https://github.com/kserve/kserve/compare/v0.7.0...v0.8.0

What's Changed

• explainer service account not being attached issue fix - issue #1778 by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1868
• Handle migration for kubeflow based installs by @markwinter in https://github.com/kserve/kserve/pull/1873
• Update kafka example doc by @yuzisun in https://github.com/kserve/kserve/pull/1877
• Samples and community housekeeping by @theofpa in https://github.com/kserve/kserve/pull/1876
• Add helm chart for KServe by @yuzisun in https://github.com/kserve/kserve/pull/1878
• Update AIF explainer example by @Tomcli in https://github.com/kserve/kserve/pull/1887
• remove v1alpha model and docs from python sdk by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1888
• storage.py: add more logging and an error condition for s3 by @elukey in https://github.com/kserve/kserve/pull/1883
• Update torchscript README by @xcjason in https://github.com/kserve/kserve/pull/1898
• Fix model agent settings when deployed as raw deployment by @andyi2it in https://github.com/kserve/kserve/pull/1891
• Updated cert-manager version. by @andyi2it in https://github.com/kserve/kserve/pull/1904
• Fix path to kserve.yaml in quick_install.sh script by @iamahern in https://github.com/kserve/kserve/pull/1916
• Return only JSON responses from KFServer by @markwinter in https://github.com/kserve/kserve/pull/1918
• Add preliminary ServingRuntime support by @pvaneck in https://github.com/kserve/kserve/pull/1901
• Bump mlserver to 0.5.3 by @adriangonz in https://github.com/kserve/kserve/pull/1853
• manifests: Upgrade cert manager API version from v1alpha2 to v1 by @haoxins in https://github.com/kserve/kserve/pull/1929
• Delete Google CLA requirement by @yuzisun in https://github.com/kserve/kserve/pull/1936
• Support grpc for transformer by @xcjason in https://github.com/kserve/kserve/pull/1933
• Follow up work on ServingRuntime support - PR1 #1924 by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1926
• Update Tensorflow GPU Example by @markwinter in https://github.com/kserve/kserve/pull/1945
• Torchserve v2 protocol by @jagadeeshi2i in https://github.com/kserve/kserve/pull/1870
• Throw error if storage initializer can not locate PVC source uri by @yuzisun in https://github.com/kserve/kserve/pull/1940
• Update ray to 1.9.0 and add ray tests by @markwinter in https://github.com/kserve/kserve/pull/1949
• Add content type for transformer to predictor HTTP call #1941 by @caffeinism in https://github.com/kserve/kserve/pull/1950
• Ensure e2e tests use correct runtime images by @pvaneck in https://github.com/kserve/kserve/pull/1953
• Remove h5py installation step in python test workflow by @markwinter in https://github.com/kserve/kserve/pull/1955
• added autoSelect field in framework by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1948
• Update CloudEvent Handling in KFServer by @markwinter in https://github.com/kserve/kserve/pull/1934
• Split framework struct by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1956
• Python sdk update for runtime by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1946
• sklearnserver/xgbserver version upgrade by @yuzisun in https://github.com/kserve/kserve/pull/1954
• updated istio download url by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1959
• Rename KF prefixed classes by @markwinter in https://github.com/kserve/kserve/pull/1951
• Bump pillow from 6.2.0 to 8.3.2 in /python/custom_transformer by @dependabot in https://github.com/kserve/kserve/pull/1961
• Chore: Upgrade Golang to 1.17 by @haoxins in https://github.com/kserve/kserve/pull/1962
• Bump opencv-python-headless from 4.0.0.21 to 4.2.0.32 in /docs/samples/kafka by @dependabot in https://github.com/kserve/kserve/pull/1963
• Update transformer e2e tests by @yuzisun in https://github.com/kserve/kserve/pull/1964
• Update kserve sdk examples with renamed classes by @markwinter in https://github.com/kserve/kserve/pull/1966
• Serving Runtime e2e tests by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1943
• Spelling by @jsoref in https://github.com/kserve/kserve/pull/1970
• Update KServe controller to use Knative 1.0 library by @yuzisun in https://github.com/kserve/kserve/pull/1969
• Fix ServingRuntime kubebuilder annotations by @pvaneck in https://github.com/kserve/kserve/pull/1974
• Bump cvxopt from 1.2.4 to 1.2.7 in /docs/samples/explanation/aix/mnist by @dependabot in https://github.com/kserve/kserve/pull/1980
• controller-gen issue fix by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1979
• Organise handlers into separate files by @markwinter in https://github.com/kserve/kserve/pull/1973
• Allow later versions of google-cloud-storage by @aodahl in https://github.com/kserve/kserve/pull/1978
• Fixes Azure blob download as class is no longer hashable by @laozc in https://github.com/kserve/kserve/pull/1971
• fix: allow to set worker count more than 1 by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1984
• sklearnserver: ignore converting instances into np.array by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1972
• Bump pillow from 8.3.2 to 9.0.0 in /python/custom_transformer by @dependabot in https://github.com/kserve/kserve/pull/1986
• Upgrade test env to use Kube 1.22 by @yuzisun in https://github.com/kserve/kserve/pull/1981
• Update copyright info in openapi and python doc for release by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1987
• Add multiModel field to ServingRuntime spec by @pvaneck in https://github.com/kserve/kserve/pull/1983
• Torchserve Changes for kserve migration by @jagadeeshi2i in https://github.com/kserve/kserve/pull/1944
• updated openapi and python sdk for release v0.8.0-rc0 by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1994
• release: v0.8.0-rc0 by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/1989

New Contributors

• @lucinvitae made their first contribution in https://github.com/kserve/kserve/pull/1674
• @maganaluis made their first contribution in https://github.com/kserve/kserve/pull/1592
• @tedhtchang made their first contribution in https://github.com/kserve/kserve/pull/1757
• @animesh-agarwal made their first contribution in https://github.com/kserve/kserve/pull/1770
• @Lewiky made their first contribution in https://github.com/kserve/kserve/pull/1772
• @zijianjoy made their first contribution in https://github.com/kserve/kserve/pull/1832
• @Suresh-Nakkeran made their first contribution in https://github.com/kserve/kserve/pull/1836
• @ScrapCodes made their first contribution in https://github.com/kserve/kserve/pull/1851
• @jeremy-london made their first contribution in https://github.com/kserve/kserve/pull/1856
• @andyi2it made their first contribution in https://github.com/kserve/kserve/pull/1837
• @xcjason made their first contribution in https://github.com/kserve/kserve/pull/1898
• @iamahern made their first contribution in https://github.com/kserve/kserve/pull/1916
• @haoxins made their first contribution in https://github.com/kserve/kserve/pull/1929
• @caffeinism made their first contribution in https://github.com/kserve/kserve/pull/1950
• @jsoref made their first contribution in https://github.com/kserve/kserve/pull/1970
• @aodahl made their first contribution in https://github.com/kserve/kserve/pull/1978
• @laozc made their first contribution in https://github.com/kserve/kserve/pull/1971

Full Changelog: https://github.com/kserve/kserve/compare/v0.7.0...v0.8.0-rc0

What's Changed?

• KServing is rebranded to KServe and moved to the independent org https://github.com/kserve under repository https://github.com/kserve/kserve.
• InferenceService API group is changed from serving.kubeflow.org to serving.kserve.io https://github.com/kserve/kserve/issues/1826.
• Python SDK name is changed from kfserving to kserve https://github.com/kserve/kserve/issues/1827.
• KServe Installation manifests https://github.com/kserve/kserve/issues/1824.
• Model-web-app is separated out of the kserve repository to https://github.com/kserve/models-web-app (https://github.com/kserve/kserve/issues/1820).
• Docs and examples are moved to separate repository https://github.com/kserve/website.
• Migration job for existing KFServing installation https://github.com/kserve/kserve/pull/1834.
• KServe images are migrated to kserve docker hub account.
• v1alpha2 API group is deprecated https://github.com/kserve/kserve/pull/1850.

🌈 What's New?

• ModelMesh project is joining KServe under repository https://github.com/kserve/modelmesh-serving !
• KServe now has its own website temporarily hosted on https://kserve.github.io/website !
• Support v1 crd and webhook configuration for Kubernetes 1.22 https://github.com/kserve/kserve/pull/1837.
• (Alpha feature) Raw kubernetes deployment support, Istio/Knative dependency is now optional https://github.com/kserve/kserve/pull/1508, https://github.com/kserve/kserve/pull/1830.
• Triton model serving runtime now defaults to 21.09 version https://github.com/kserve/kserve/pull/1840.

🐛 What's Fixed?

• Bug fix for Azure blob https://github.com/kserve/kserve/pull/1845.
• Tar/Zip support for all storage options https://github.com/kserve/kserve/pull/1836.
• Fix AWS_REGION and add AWS_CA_BUNDLE for S3 https://github.com/kserve/kserve/pull/1780.
• Torchserve custom package install fix https://github.com/kserve/kserve/issues/1619.

• Migrate images from gcr.io to dockerhub #1782 @yuzisun
• Update Alibi Explainers to 0.6.0 #1720 @cliveseldon
• Enable tag based routing #1752 @yuzisun
• prevent nested directories in s3 to be created as file inside model directory #1770 @animesh-agarwal
• Upgrade ray[serve] to version 1.5.0, allowing kfserving to be installed on python3.9 #1772 @Lewiky

🌈 What's New?

• Web-app for managing InferenceServices #1328 @kimwnasptd
• Web-app: Add manifests for launching and exposing the app #1512 @kimwnasptd
• Web-app: Implement a GitHub action for building the web app #1504 @kimwnasptd
• [storage-initializer] add support for aws sts, switch to use boto #1472 @matty-rose
• [storage-initializer] Supports anonymous S3 connect #1640 @mkbhanda
• MMS: Add heathcheck endpoint for InferenceService agent #1509 @yuzisun
• MMS: Trained Model Validation Webhook + Memory in trained model immutable #1394 @abchoo
• MMS: Add Multi Model Server support for custom spec #1470 @shydefoo
• MMS: Added annotation to use anonymous credentials for s3 #1538 @abchoo
• MMS: Adds condition for Trained Model to check if isvc predictor supports MMS #1522 @abchoo
• MMS: Introducing HTTP protocol for MMS downloader #1510 @abchoo
• PMML: Improve PMMLServer predict performance #1405 @AnyISalIn
• TorchServe: Upgrade torchserve version to 0.4.0 #1649 @jagadeeshi2i
• Paddle: Add Paddle predictor #1615 @Ruminateer
• KFServer: Parallel inference support #1637 @yuzisun
• Logger: Add the component label in payload logging #1636 @theofpa
• Logger: Add logger in explainer and transformer #1597 @theofpa

🐛 What's Fixed?

• The ingress virtual service is not reconciled when updating annotations/labels of inference service #1525 @wengyao04
• Resolve knative service diff to prevent dup revision #1484 @yuzisun
• Make v1beta1 custom predictors have configurable protocol #1493 @cliveseldon
• Ingress reconciler compatibility with istio 1.10 #1643 @theofpa
• MMS: Service gets 404 during autoscaling #1429 @mszacillo
• MMS: Added mutex for downloader providers. #1531 @abchoo
• MMS: Prevents /mnt/models/ from being converted into a file #1549 @abchoo
• MMS: Watcher should not be started until models downloaded in MMS #1429 @abchoo
• Storage initializer: download tar.gz or zip from uri with query params fails #1463 @metaphor
• Storage initializer: Extend zip content type check when download zip use uri #1673 @haijohn
• Logger: Fix logger for error response case #1533 @yuzisun
• [xgboostserver] Convert list input to numpy array before creating DMatrix #1513 @pradithya
• KFServer: Limit number of asyncio workers in custom transformers #1687 @sukumargaonkar

What's Changed?

• Support knative 0.19+, defaults to use knative-local-gateway #1334 @theofpa

Development experience and docs

• Speed-up alibi-explainer image build #1395 @theofpa
• Improvements to self-signed-ca.sh #1661 @elukey
• Fixes storage initializer image patch script #1650 @Ruminateer
• Update all e2e tests to v1beta1 #1622 @yuzisun
• Update kubeflow overlay #1424 @pvaneck
• Add github action for python lint #1485 @yuzisun
• Update logger samples for newer eventing versions #1526 @pvaneck
• Update pipelines documentation #1498 @pvaneck
• Add Spark model inference example with export pmml file #1434 @yuzisun
• Reorg multi-model serving doc #1412 @yuzisun
• Feast transformer example doc #1647 @chinhuang007
• Added benchmark for multi-model serving #1554 @Aaronchoo