serving

A flexible, high-performance serving system for machine learning models

APACHE-2.0 License

Stars
6.2K
Committers
228

Bot releases are hidden (Show)

serving - 2.9.3

Published by rtg0795 almost 2 years ago

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • This release is based on TF version 2.9.3
serving - 2.11.0-rc2

Published by rtg0795 almost 2 years ago

Release 2.11.0-rc2

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes.

Bug Fixes and Other Changes

  • This release is based on TF version 2.11.0-rc2
serving - 2.11.0-rc1

Published by rtg0795 almost 2 years ago

Release 2.11.0-rc1

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes.

Bug Fixes and Other Changes

  • This release is based on TF version 2.11.0-rc1
serving - 2.11.0-rc0

Published by rtg0795 almost 2 years ago

Release 2.11.0-rc0

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes.

Bug Fixes and Other Changes

  • No-op for public code. (commit: 20655b5904fdb4a810bfd8aef22db8becd4e80f3)
  • Removed net_http/client/public/* now that all the users have been migrated to test_client/ (commit: e64a73afc23ea8f9538660cb8bc20f48d5682848)
  • Fix the bug when accessing concat.tensor_data() outside its lifecycle (commit: cc3720091867c06615b8b3f50c1c2468a90e6b1c)
  • BUILD cleanup (commit: 9e81e7b1bc8e1bd28c3324cf8feee717420f96f4)
  • BUILD cleanup (commit: 8235ed86f9f07123e30ea8830a1454334bc86a2c)
  • Update TF Text to v2.8.2. (commit: 31204d664d4ff985a526dccfe1f13ffde113deb6)
  • Replace tensorflow/core/lib/core/blocking_counter in favor of the one from tensorflow/platform. (commit: 4ed7c5c30d0be43254a1177e8488675dc60d0384)
  • Update TF Text to v2.9.0. (commit: e88506ab6709f2dc3a3bb1601ac4b84c23025611)
  • Cleaning up BUILD files to remove "loose" headers. (commit: c2cd4c9629fbc868bd5e2cb186c7b081f22d709b)
  • Remove the unnecessary dependency (commit: d976a37b4e9481de5ca371ae734645d925143088)
  • Use value instead of ValueOrDie. (commit: b48e6e7cc02d8060cc3da5d363a90baf9324a2a0)
  • Update TF Text to v2.9.0. (commit: a73f2925e367106bab0bfeca187fbaa1b3f36676)
  • Replace tensorflow::Status::OK() with tensorflow::OkStatus(). (commit: 49ac8acb50291c21a0a72cfd9135aa2030e3ae88)
  • Replace tensorflow::Status::OK() with tensorflow::OkStatus(). (commit: e8be1a742c3913cbbb6158dc1202c17130583219)
  • Replace tensorflow::Status::OK() with tensorflow::OkStatus(). (commit: 88bd9d1638f6017b4af526a9b468641966d8972d)
  • Add support for TensorFlow Decision Forests models. (commit: 4592081169068a0f059be71ac1b484d568f6e5d2)
  • Remove special handling of tflite model when creating batching (commit: 2d39f8c8aa90ccfdc78faa51e4c8295832796a68)
  • Improve batching test in following ways: (commit: 68d4d3962dc40fa6c1980df6d8df51338e44301e)
  • Split proto helper function to its own util library. (commit: 01386268be6948429ea796fcd348beea4c7174d6)
  • Created net_http/public folder for shared files and updated files in net_http and model_servers/http_server.cc to match. Also removed old directories from net_http/client to make way for new client API and implementation. (commit: 8086d33b6b74899dc8062ddbdba3fcc95e9af7e5)
  • Updating a reference to Env post-refactor. (commit: 728474f92533be737958edc095abc0648a494452)
  • Replace tensorflow::Status::OK() with tensorflow::OkStatus(). (commit: 9861f7fd742dc3ec0a5e2cf0314d68b799a11e73)
  • Experimental support for per-model batching params. (commit: 94f2d6944f310069ebd527a52649fe3c001c38e3)
  • tensorflow-serving-api python package requires Python >= 3.7 (support for prior versions has been dropped). (commit: 30ea18d66416e8cfd3873fba3c2482ec68184ec6)
  • Replace tensorflow::Status::OK() with tensorflow::{Status, OkStatus}(). (commit: 6393b29242ab6648c723a51f64eb2e67ebf497db)
  • Open up http_server_clients package group for easier 3P (commit: 66b199ba6e8fc81cb278988aa541e03987a1d27d)
serving - 2.9.2

Published by rtg0795 about 2 years ago

Release 2.9.2

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • This release is based on TF version 2.9.2
serving - 2.10.0

Published by rtg0795 about 2 years ago

Release 2.10.0

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes.

Bug Fixes and Other Changes

  • This release is based on TF version 2.10.0.
serving - 2.8.3

Published by rtg0795 about 2 years ago

Release 2.8.3

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes.

Bug Fixes and Other Changes

  • This release is based on TF version 2.8.3.
serving - 2.7.4

Published by rtg0795 about 2 years ago

Release 2.7.4

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • This release is based on TF version 2.7.4
serving - 2.10.0-rc3

Published by rtg0795 about 2 years ago

Release 2.10.0-rc3

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • This release is based on TF version 2.10.0-rc3
serving - 2.10.0-rc2

Published by rtg0795 about 2 years ago

Release 2.10.0-rc2

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • This release is based on TF version 2.10.0-rc2
serving - 2.10.0-rc1

Published by rtg0795 about 2 years ago

Release 2.10.0-rc1

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • This release is based on TF version 2.10.0-rc1
serving - 2.10.0-rc0

Published by rtg0795 about 2 years ago

Release 2.10.0-rc0

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • tfs:aarch64: add aarch64 mkl bazel config to enable onednn+acl backend (commit: 1285e41acc707ba0d18e8eaf8a42c6d5110e8af8)
  • Match packages in devel and non-devel GPU with TF dockerfile. (commit: a8ffec79e0794650a4c0856c4122032e985296cc)
  • Validate batching params when creating the wrapped (batching) session, (commit: 48ff72dcb6582e989452ba870c88a2bb710ea0c4)
  • Merge and clean up implementations of GetModelDiskSize and GetAllDescendants in util.cc. (commit: 6da9c43c5f71abe361841fb3fd5eaad57fc847b1)
  • Parallelize iteration over child files in GetModelDiskSize (commit: d09d2efe6e9b88ef0266e5982a3e732da14dc93b)
  • Fix gpu docker build failure due to bad substitution (commit: 1d7cd5b2ba43c3d98f0c8bef6806c203b2c14592)
  • Call run_returning_status instead of run (commit: 8f9085ac678755afea6bf0067fe40a32e37ce2fa)
  • Fixing broken link for ResNet in TensorFlow. (commit: b15210ca076b11eaa2dfd0ac2fb125be780c5d40)
  • Update the TensorFlow BatchingSession metric monitoring class to be compatible with Google's internal monitoring tools. (commit: 05b944ad9367027a1082756a3069619f44955de1)
  • Increase timeout for model tests. (commit: 677ba5a07813c4fb5a2ffb4567a7ec4a137eebe6)
  • Use pb.h for topology.proto. (commit: 21fda280bc72bdbc4386c7b0d2ad4b97264921ad)
serving - 2.7.3

Published by rtg0795 about 2 years ago

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • Update TF Text to v2.7.3 (commit: ee7892be7801a0e4ae9a6dd8b5f7bab06ae9c87c)
  • This release is based on TF version 2.7.3
serving - 2.9.1

Published by rtg0795 over 2 years ago

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • This release is based on TF version 2.9.0
serving - 2.6.5

Published by rtg0795 over 2 years ago

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • Rollback incompatible C++17 changes. (commit: ba0fa72b61bc2c42388b815253ba72e6830f03cf)
  • Roll forward with std::optional -> absl::optional. (commit: 009dac683bf84165b84702d177bb9a021ebef728)
  • Replace STL algorithm call with a container method (performance-inefficient-algorithm). (commit: f5bc09998e0043ce72d34b14104379163048406c)
  • Remove unused "using" decl. (commit: ffcc4a16c76c4fa1189edd9682fc486442a33e52)
  • Move status_proto to public visible apis/ (it being used by public API protos) (commit: 7f894c79fce5e58758f3cb49e858a16e3602ae80)
  • Move core/logging.proto -> apis/logging.proto (commit: 37c64b8820a923aafc1b5c8bf264fd5cce5224f3)
  • Update TF Text to v2.5.0. (commit: 48e5a9e23a1e0b2951b77c3e8f9832193d9b1851)
  • Adding python targets for config protos (commit: 757c3a6b6c8a03731dc73ff758f69a61aeddcf67)
  • Remove experimental tags from uses of gRPC C++ callback API. (commit: b355023b034ca6ef72b507920d9de2a02e0f4a2a)
  • Add new --use_alts_credentials flag, to enable building secure credentials using Google ALTS. (commit: ceba636bb7c5c98bde35d1818fd033b36300fffe)
  • Enable HTTP PATCH support in evhttp_server (commit: 6cbc4a9eb419c8078c3a4e791381cda70dd8fc78)
serving - 2.8.2

Published by rtg0795 over 2 years ago

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • Replace int64 with int64_t and uint64 with uint64_t. (commit: 21360c763767823b82768ce42c5c90c0c9012601)
  • update to latest benchmark API changes (commit: 860e1013385289ad3f9eb4d854b55c23e7cb8087)
  • This release is based on TF version 2.8.2
serving - 2.9.0

Published by rtg0795 over 2 years ago

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • Do not report successful loads that are cancelled, unload immediately instead. (commit: 923269955f5582cc26d0454992afa5c888a9377f)
  • Add a lock to avoid race condition on memoized_resource_estimate_. (commit: 83959e364e7ff1234bf47a5d8139677d1bdb18c1)
  • Update Resnet model used in K8S tutorial (commit: 6e76f6a9460bf2d37630f025fcfd3e06c4230fee)
  • Prepare for development of new http client API. (commit: 78e94e99650deae956fe20dffa9932a72ec7d765)
  • Integrate TPU initialization changes into TF Serving. (commit: 6549ef2136940cd98cfbb9ee0e29221d86101d16)
  • Allow max_execution_batch_size to be actually used by allowing (commit: 48a699a2fd32404c4b19f55077a1fb29112a0afe)
  • Delete batch_schedulers_ before thread_pool_name_ (commit: 2837812341e7c98be4717e5901286692a5dcc02a)
  • Add missing NVIDIA repository key. (commit: c0998e13451b9b83c9bdf157dd3648b2272dac59)
  • Bump minimum bazel version 5.1.1, to match with TF and root.workspace (commit: 8a02874cee6957e5817960613627a549bd80a6e9)
  • Update to use C++17 (commit: 7166e2efc6b7e63c908515c6a53d0e4fe8fa0aae)
  • Update tensorflow_model_server_test to depend on the pip installed tensorflow. (commit: 04b8676730a882cab61b7772097f2c23c0447ef9)
  • This release is based on TF version 2.9.0
serving - 2.8.0

Published by rtg0795 over 2 years ago

Release 2.8.0

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • Force-allow labels for the models which are not yet loaded. The feature is meant to be used for non-prod environments only as it may break the serving until relevant models are not loaded yet. (commit: 988bbce80038ac0b7141dcb4413124ba486344cf)
  • Update CreateRPC API interface. (commit: 2e7ca90c18f310c542ed0dcde92d676db6454285)
  • Add --tensorflow_session_config_file flag to tf serving model server to support custom SessionConfig (commit: 342a8088524c33f68e3eb4d66800f01a777ceb38)
  • Add --experimental_cc_shared_library by default to all builds. (commit: 49b138fdd4c0fb7170736193063c6f03dfb4dba4)
  • Add --num_request_iterations_for_warmup flag (fixes #1949) (commit: 2a55aec18cc1923ece84c7fcf701185306ef99b1)
serving - 2.6.3

Published by rtg0795 over 2 years ago

Release 2.6.3

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • This release is based on TF version 2.6.3
serving - 2.5.4

Published by rtg0795 over 2 years ago

Release 2.5.4

Major Features and Improvements

  • No major features or improvements.

Breaking Changes

  • No breaking changes

Bug Fixes and Other Changes

  • This release is based on TF version 2.5.3