google-cloud-java

Dependencies

• Upgrade to gax 1.20.0

DLP

• Add a utility conversion function
• Add DLP v2 client

Logging

• Fix page size not propagating

Pubsub

• Make Publisher use GAPIC client
• Remove polling implementation

Storage

• Change batch endpoint from /batch to /batch/storage/v1
• Speed up IT

Video intelligence

• Add Video-intelligence v1p1beta1

Bigtable

• Improve ranges
• Implement bulk mutations
• Improve RowCell by using getters for attributes

Bigquery

• Update dependencies
• Declare GA
• Added a snippet to show how to read a newline-delimited-json file and store it in a Table

Datastore

• Mark entity bindings as unsupported operation and deprecated

Documentation

• Firestore: removed extra 'a' in ArraySortedMap findkey documentation

Firestore

• Fixing order test to verify that we order by components

Pubsub

• Make Publisher/Subscriber accept plain strings

Spanner

• Add auto-generated GAPIC client

Translate

• Fix log messages

Vision

• Add Vision v1p2beta1

Misc

• Update proto and grpc dependency versions
• Added more detail to troubleshooting guide (#2988)
• Update api-common dependency to 1.4.0 (#2991)
• Delete APPENGINE.md
• Move generated protobuf and grpc dependencies to bom (#2990)
• Update README.md
• Upgrade cloudresourcemanager dependency version (#2944)
• Move bom dependencies to outer pom (#2976)
• Add TROUBLESHOOTING.md (#2977)
• Clarifying Alpha (deletion is possible) (#2975)

Bigtable

• Implement ReadRows retries (#2986)
• Implement ReadModifyWriteRow (#2981)
• Implement CheckAndMutateRow (#2980)
• Implement MutateRow (#2941)
• Implementation: integrate ReadRows (#2940)
• Bulk Mutations (#2936)
• ReadModifyWriteRow (#2939)
• CheckAndMutate (#2938)

Bigquery

• BigQuery GA (#2982)

Storage

• Delete blobs faster (#2972)

Firestore

• Equals to the Public API + Allowing empty merges + Test Fix (#2971)

Spanner

• Support for Batch Read API (#2953)

Misc

• Update proto and grpc dependency versions
• Version fixes (tagging, incorrect versions, bigtable downgrade) (#2956)
• Add new version update scripts (#2947)
• Add grpc-core to BOM (#2931)

Bigtable

• Rewrite ReframingResponseObserver (#2925)
• Implement SampleRowKeys (#2913)
• Update helper script to work with the latest artman changes (#2943)
• Update Settings test to use StubSettings, formatting (#2935)
• Rename surface (#2934)
• Implement ReadRows row merging logic. (#2914)
• Surface: MutateRow (#2861)

Core

• oneof -> inheritance conversion (#2930) breaking change

Logging

• Log more kubernetes properties (#2937)

Firestore

• Fix integration test (#2950)

Misc

• Update_versions.sh script: update versions in bom pom (#2703)
• Add XML syntax highlighting in READMEs (#2922)
• Add missing copyright headers to scripts (#2923)
• Remove Travis (#2883)
• Update CONTRIBUTING.MD for installing (#2881)
• Adding basic builds to CircleCI config (#2877)
• Use new googleapis javadoc page (#2862)
• Add a veneer-dev profile that autoformats modified sources during maven runs (#2851)

Bigtable

• Cleanup - tweak filters (#2919)
• Bug fix - Fix Reframer error handling (#2920)
• Bug fix - Make ranges mutable (#2915)
• Add a generic reframer (#2907)
• Add Base structure for Bigtable surface updates (#2842)
• Add SampleRowKeys to the surface (#2857)
• Add Readrows to the surface (#2849)
• Add a couple of developer helper scripts (#2841)

Bigquery

• Add table label (#2873)
• Make FieldValue publicly construct-able (#2891)
• Try getting job if create fails (#2887)
• Add support for customer supplied encryption keys (#2870)

Storage

• Add documentation to FakeStorageRpc and LocalStorageHelper (#2906)
• Make download in StorageExamples more straightforward (#2905)
• Fix Storage integration tests (#2886)
• Add initial opencensus instrumentation code in Cloud Storage (#2846)
• Fix intermittent Storage integration test failures (#2872)

Speech

• Remove PageResponseWrappers, add speech v1p1beta1 (#2927)

Core

• Allow custom roles (#2863)
• Make BaseWriteChannel surprise less (#2900)
• Add validation for project-id returned by metadata server (#2868)
• Update gax to 1.19.0 (#2885)
• Use grpc-netty-shaded (#2832)
• Use GAE_RUNTIME to detect java version (#2837)

Logginig

• Support HTTP request latency (#2908)
• Fix Logging integration tests (#2860)
• Delete redundant tests (#2850)

Firestore

• Accept strings in where(FieldPath.documentId(), ...) (#2903)
• Pull in newest version of Conformance Tests (#2898)

Datastore

• Document DatastoreWriter.update exception (#2894)

Dns

• Fix Dns batch operations (#2858)

BigQuery

• bigquery: properly forward Dataset labels (#2799)
• bigquery: support null values in inserts (#2798)
• simplify string concat (#2773)
• bigquery: small refactorings (#2817)
• bigquery: allow users to construct TableDefinition (#2814)
• bigquery: fix failing integ test (#2831)

Compute

• compute: deprecate (#2819) breaking change

Datastore

• support datastore transaction options (#2613)
• datastore: better document emulator functions (#2828)

Dependencies/build logic

• add logback to bom (#2815)
• Initial CircleCI config for integration tests (#2808)
• CircleCI: Adding speech integration tests (#2826)
• CircleCI integration tests: adding more APIs (#2829)
• CircleCI: Adding firestore, bumping compute timeout (#2836)
• CircleCI: Adding Storage (#2839)
• Disabling integration tests in Travis/Appveyor (#2840)

Firestore

• Adding test for return value of runTransaction() (#2801)
• Adding .close() to Firestore Service (#2807)
• Making sure Firestore Java doesn't drop update values (#2818)
• Adding Query Conformance Tests (#2811)
• Adding Transaction.getAll() (#2844)

Logging

• logging: clear null trace_id (#2760)
• logback: log stack trace (#2765)
• logging delete unused methods (#2827)

Storage

• Using extended headers with sign URL (#2422)
• Filesys name (#2809)

Cross-API

• Gax java stubsettings (#2825) widespread breaking changes
• batch refresh (#2843)
• fix build (#2830)

Readmes/other docs

• firestore: document transport (#2790)
• READMEs: clarifying umbrella package (#2806)
• firestore: fix doc typo (#2747)
• Removing self from CODEOWNERS (#2824)

Big Query

• bigquery: properly handle empty array params (#2695)
• bigquery: allow schema-ful data listing (#2697)
• bigquery: properly spell "BigQuery" (#2716) breaking change
• bigquery: also allow schema-ful list from Table (#2718)
• bigquery: add setUseLegacySql to ViewDefinition (#2743)
• bigquery: properly detect statistics type (#2742)
• bigquery: loudly report invalid operations on dryruns (#2772)
• bigquery: use standard SQL by default (#2766)

Firestore

• Adding Firestore Watch (#2665)
• Adding Conformance Test for the Java Firestore SDK (#2719)
• Stripping Empty Write Requests (#2739)
• Pulling in the latest version of the Conformance Tests (#2767)
• Adding support for DocumentSnapshot cursors (#2768)
• Adding QueryDocumentSnapshot (#2738)

Logging

• logging: flowcontrol should block (#2741)

NIO

• Generation support (#2232)

Pub/Sub

• pubsub: use system executor for stream reconnection (#2749)
• pubsub: respect total expiration while modacking (#2715)
• pubsub: use gax pool (#2751)
• pubsub: document Subscriber running forever (#2750)

Spanner

• Cloud Spanner: Adds tracing (#2677)
• Treat RESOURCE_EXHAUSTED with retry information as aborted. (#2645)
• We can retry on "Received unexpected EOS". (#2757)

Cross-API

• Add support for custom static headers (#2690) breaking change
• Regenerating GAPIC clients (#2774)
• Java autogen client refresh, proto/grpc bump (#2779)

New Clients

• Adding dataproc and oslogin (#2780)
  • Adding missing modules (os-login & dataproc) (#2785)
  • Fixing google-cloud-dataproc version (#2786)

Dependencies/build logic

• Removing compile dependency on org.json (#2728)
• add grpc-testing to bom (#2761)
• Update license check to be compatible with toolkit changes (#2762)
• Update google-cloud-datastore proto driver to v1.6.0. (#2770)
• Deleting google-cloud-dep-verification (#2782)
• Bumping grpc from 1.7 to 1.9 (#2783)

Readmes/other docs

• [video-intelligence] update readme v1beta to v1 (#2704)
• Fix css for doc page (#2711)
• add bigquery release notes (#2717)
• Compute readme: this client is no longer being updated (#2726)
• Adding readme for google-cloud-bom (#2725)
• Reword comment (#2541)
• Fix the code snippet in README (#2455)
• Fixes typo in javadocs for Datastore's BaseEntity class. (#2403)
• Adding README for dialogflow (#2730)
• Improve GCS signUrlOption javadoc (#1928)
• all: fix copyright header (#2763)

Note
We have started a new reference page which details breaking changes at https://github.com/GoogleCloudPlatform/google-cloud-java/blob/master/CHANGES.md . This will be updated to reflect breaking changes in a more descriptive way going forward, and will be the best place to consult for finding out how to adjust to the breaking changes in each release.

New/promoted clients

• Adding container-v1 (#2689 )
• Adding bigquerydatatransfer-v1 (#2689 )
• Adding vision-v1p1beta1 (#2689 )

Firestore

• Adding data structures (#2658 )
• Adding v1beta1 ordering semantics (#2662 )

Notification

• Adding notification client, a light wrapper around pubsub and storage clients (#2571 )

Storage

• Public data download available to unauthenticated clients (#2649 )

Datastore

• Adding toString() to OrderBy

Other

• Codegen refresh (#2689 )
• Removing deprecated code (#2640 )
• Add Maven bill of materials (BOM) (#2679 )

New/promoted clients

• Adding cloud-trace-v2 (#2630)
• Adding videointelligence-v1 (#2632)
• Promoting google-cloud-vision to GA (#2633)

Firestore

• Rejecting conflicting field paths (#2625)

Other

• Codegen refresh (#2631)

Core

• Fix long-running operations (#2619)
• Clean up generated proto property names (#2608)

Dialog Flow

• Initial release (#2626)

Datastore

• Update google-cloud-datastore protos + client (#2574)

PubSub

• BREAKING CHANGE Fix and simplify deadline extension (#2604)
  • This release removes the ability to set padding time. Setting this time
    too high or too low has created many bugs in the past.
    Currently the value is set to 5 seconds, which should be enough to account
    for communication latency between client and server.
    If you believe you need this configuration, please file an issue.
• Remove tests from SubscriberTest (#2618)
• Make connection log less aggressively (#2615)
• Clarify sleep-then-stop in snippet (#2617)
• Send message receipts (#2580)

Firestore

• Make FieldPath public (#2602)
• Make getPath() relative to the database root (#2599)
• Allow DocumentReferences for Query cursors

• Regenerating clients with surface cleanup (#2598)
• Bumping dependencies (api-common, gax, protos) (#2600)
  • api-common -> 1.2.0
  • gax -> 1.14.0
  • gax-grpc -> 1.14.0 (first 1.x version)
  • generated proto packages -> 1.0.0/0.1.24
• Bumping language to GA, 4 others to Beta (#2601)
  • google-cloud-language: Beta -> GA
  • google-cloud-dlp: Alpha -> Beta
  • google-cloud-errorreporting: Alpha -> Beta
  • google-cloud-monitoring: Alpha -> Beta
  • google-cloud-trace: Alpha -> Beta

Dependencies update:

• api-client -> 1.23.0
• gax-java -> 1.13.0
• gax-grpc -> 0.30.0
• google-auth-library -> 0.9.0
• grpc -> 1.7.0
• nettyssl -> 2.0.6

General:

• Add new surface for Bigtable v2 and admin-v2 APIs
• Adjustments to breaking changes in gax-java

Bigquery:

• Allow user to set null schema
• Add simple benchmarks

Firestore:

• DatabaseName renamed to DatabaseRootName
• Using the pageable response from ListCollectionIds

Pubsub:

• Add keepalive
• Translate exception to ApiException

Storage:

• Support userProject param for some Requester Pays operations

Video Intelligence:

• annotateVideoAsync has parameters removed

Documentation:

• Pubsub: point users to Guava's Service doc
• Fix doc link for Firestore

BigQuery

• missing features and fix found bugs (see #2446)
• add retries for insertAll

Dependency

• gax dependency -> 1.9.0
• google-cloud-datastore client dependency -> 1.4.1

DLP

• refreshed client lib

Firestore

• Using commitTime instead of updateTime for deletes

PubSub

• fix race condition in streaming connection
• clarify subscriber shutdown doc
• make logs quieter
• reconnect with old executor

Samples

• update download requester pays sample

Spanner

• tests and style fixes

BigQuery:

• getQueryResults no longer returns null on 404

Example:

• add PubSub emulator snippet
  Firestore:
• google-cloud-firestore beta released

Logging:

• remove unused flushSize logging configuration parameter

PubSub:

• retry on ABORTED
• all connections share one message queue

Spanner:

• increase response header size

Storage:

• fix requester pays issues

Video intelligence:

• beta release

Dependency Update

• generated Proto/gRPC packages -> 0.1.19

Video Intelligence

• add google-cloud-video-intelligence v1beta2

Natural Language

• refresh google-cloud-language v1

Documentation

• Spanner: update documentation of INSERT_OR_UPDATE mutation
• Storage: adding RequesterPays snippets

Version update

• Update gax versions (#2434)
• Update dependency verification versions (#2435)

http-based clients

• Fix response code retrying logic for HTTP responses with "Content-Type" other than "application/json". (#2329)

BigQuery

• Skip 0 byte writes
• Add numDmlAffectedRows to QueryResponse (#2320)
• Using Jobs.insert instead of Jobs.query for queries (#2323)

Datastore

• datastore: cache application name (#2292)
• fix NullPointerException (#2271)

Logging

• Add missing fields to LogEntry (#2313)

Nio

• [NIO] Fix inconsistent failure messages. (#2330)

Pub/Sub

• pubsub: enable streaming pull (#2344)

Storage

• Fixing retries of Storage.create (#2359)

Util

• Creating google-cloud-compat-checker (#2317)
• Checking more things in google-cloud-compat-checker (#2347)

Documentation-only

• P0 auth sample (#2298)
• Fix storage bucket listing sample in README.md (#2301)
• Fix typo in storage README.md s/while/for
• Describing services in package-info files (#2312)
• Updating and expanding explanation of supported platforms (#2314)
• Add documentation about how google-cloud-pom can be used as BOM (#2318)
• Clarify that AppEngine SDK is not required for Flex and Standard J8 (#2264)
• README : Project ID helper (#2134)
• Clarify usage of LocalStorageHelper, explicitly specify which operations are supported and which are not (#2334)
• Add missing READMEs (#2338)
• Moving API-specific sections out of main README into API-specific READMEs (#2336, #2337, #2346, #2345, #2350, #2352, #2354)
• README link cleanup (#2355)

Testing-only

• Ignore analyze* Tests (#2327)
• Adding BigQuery integration test for query dry runs (#2328)
• Travis config changes - retaining Precise, removing oraclejdk7 (#2325)
• Disabling failing integration test (#2360)
• Update sink IT: expecting exception when sink doesn't exist (#2362)

Speech v1

Add Speech Time Stamp feature (the new 'WordInfo' structure)

Samples

• pubsub: correct emulator sample (#2254)

Dependencies

• use objenesis 2.6 (#2252)
• Unify proto-google-cloud-* and grpc-google-cloud-* dependencies, bump proto/grpc dependency to 0.1.14.
• Fixing dependency problems for consumers of google-cloud-java (#2284)

Translate

• support 'format' option for google translate api (#2253)

Storage

• Add user project options for requester pays flag (#2260) Alpha feature (behind whitelist)

Logging

• Adding @BetaApi to particular exception constructors (#2286)

Auto-generated clients

• Refactoring to allow multiple transports in GAPIC clients (#2156) widespread breaking change
  • Not affected:
    • Non-advanced calls to API methods (i.e. not using *Callable() methods)
    • Trivial instantiation of clients
  • Affected:
    • Catching exceptions that are thrown
    • Customized instantiation of clients
    • Advanced calls to API methods (i.e. using *Callable() methods)
  • Other notes:
    • This change adds *Stub classes for every API, which allows advanced calls to every API method for an API whether or not they are exposed on *Client classes (particularly relevant for Pub/Sub)