generative-ai-python

What's Changed

Bugfixes

• Fix bug passing single-string safety settings. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/417
• Fix operator conversion. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/419
• Fix 'ResourceWarning: unclosed <ssl.SSLSocket>' by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/422
• Fix list_models by @rozha in https://github.com/google-gemini/generative-ai-python/pull/439
• Add PngImagePlugin to imports. by @mbanani in https://github.com/google-gemini/generative-ai-python/pull/438
• Add webp to mimetypes by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/440

Docs and Samples

• Caching samples by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/399
• Model list and get samples by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/404
• System instructions sample by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/407
• Count tokens samples by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/403
• fix genai.GenerativeModel argument name in example by @philippemiron in https://github.com/google-gemini/generative-ai-python/pull/394
• Adding text generation samples by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/405
• Add samples for chat by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/408
• Rename json_mode.py and create function calling sample by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/406
• Add tuned_models samples by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/409
• Add no json schema sample by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/416
• fix list initialization and redundant parentheses by @PandasPirate in https://github.com/google-gemini/generative-ai-python/pull/412
• Adding a note about free tier not available in Europe by @Giom-V in https://github.com/google-gemini/generative-ai-python/pull/401
• Update text only prompts by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/420
• Add cache_from_name and cache_chat by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/413
• Add create_audio and create_text to samples/files.py by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/414
• Add safety_settings sample by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/415
• Add REST sample for listing and getting models by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/421
• Cleanup samples/files.py by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/402
• format-samples by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/410
• Add model configuration sample by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/427
• move SI by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/428
• No 's' by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/431
• Fix snippet name. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/432
• Fix snippet names + reorder. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/435
• move tuning to tuned_models by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/436
• Fix typos by @PandasPirate in https://github.com/google-gemini/generative-ai-python/pull/437
• Update tuned_models.py by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/441
• Check video status. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/442

New Contributors

• @philippemiron made their first contribution in https://github.com/google-gemini/generative-ai-python/pull/394
• @Giom-V made their first contribution in https://github.com/google-gemini/generative-ai-python/pull/401
• @rozha made their first contribution in https://github.com/google-gemini/generative-ai-python/pull/439
• @mbanani made their first contribution in https://github.com/google-gemini/generative-ai-python/pull/438

Full Changelog: https://github.com/google-gemini/generative-ai-python/compare/v0.7.1...v0.7.2

What's Changed

• Add code execution by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/396

Full Changelog: https://github.com/google-gemini/generative-ai-python/compare/v0.7.0...v0.7.1

What's Changed

For a detailed introduction, check out the context caching guide on the site.

Features

• Explicit Caching by @mayureshagashe2105 in https://github.com/google-gemini/generative-ai-python/pull/355
• Explicit Caching patch by @mayureshagashe2105 in https://github.com/google-gemini/generative-ai-python/pull/377

Bugfixes and small changes

• Delete .github/ISSUE_TEMPLATE directory by @ryanwilson in https://github.com/google-gemini/generative-ai-python/pull/389
• Update gapic lib to use 0.6.5 and fix tests by @mayureshagashe2105 in https://github.com/google-gemini/generative-ai-python/pull/390
• Accept partial file names by @mayureshagashe2105 in https://github.com/google-gemini/generative-ai-python/pull/386
• Remove duplicate test by @mayureshagashe2105 in https://github.com/google-gemini/generative-ai-python/pull/387

Docs

• remove references to pro-vision by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/388

New Contributors

• @ryanwilson made their first contribution in https://github.com/google-gemini/generative-ai-python/pull/389

Full Changelog: https://github.com/google-gemini/generative-ai-python/compare/v0.6.0...v0.7.0

What's Changed

Features

• Add genai.protos to discourage direct use of google.ai.generativelanguage by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/354
• Add video metadata and error to File by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/348
• Restrict Harm category to the subset supported by Gemini by @aertoria in https://github.com/google-gemini/generative-ai-python/pull/295
• Improve request_options by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/297
• Add GenerateContentResponse.to_dict() by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/337
• Quick safety filtering: Allow safety_settings="block_none" by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/347

Bugfixes

• Cleanup file data handling. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/321
• Allow count_tokens with no contents. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/342
• improve the no-credentials error message, fail fast for no-credentials in colab. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/352
• Make printing less verbose. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/340
• Add request options to chat. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/341
• Handle image RGBA mode by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/374

Docs

• Fix bugs, improve code clarity, and enhance overall reliability across several files. by @Faisal-Alsrheed in https://github.com/google-gemini/generative-ai-python/pull/339
• Enhance functions Documentation and Improve Error Messages by @Faisal-Alsrheed in https://github.com/google-gemini/generative-ai-python/pull/350
• Fix argument description. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/338
• Update init.py to use the latest model by @logankilpatrick in https://github.com/google-gemini/generative-ai-python/pull/362

New Contributors

• @Faisal-Alsrheed made their first contribution in https://github.com/google-gemini/generative-ai-python/pull/339
• @logankilpatrick made their first contribution in https://github.com/google-gemini/generative-ai-python/pull/362

Full Changelog: https://github.com/google-gemini/generative-ai-python/compare/v0.5.4...v0.6.0

What's Changed

• Update version of generativelanguage to fix timeout errors. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/345

What's Changed

Features

• Extend permissions service support to Tuned Models by @mayureshagashe2105 in https://github.com/google-gemini/generative-ai-python/pull/219
• Support improved CountTokens and usage_metadata output by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/315
• Add JSON schema support
  • Add response_schema parameter by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/302
  • Improve schema support by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/309
• Upgrade file handling
  • Add file state by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/316
  • Add support for resumable uploads for File API by @TYMichaelChen in https://github.com/google-gemini/generative-ai-python/pull/275
  • Return full file details at the end of create. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/314
    • Update client.py by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/325

Bugfixes

• update_time defined twice hence removing once. by @PandasPirate in https://github.com/google-gemini/generative-ai-python/pull/301

• Add main async code match test by @mayureshagashe2105 in https://github.com/google-gemini/generative-ai-python/pull/299

• Copy test cases over for new responder.py by @shilpakancharla in https://github.com/google-gemini/generative-ai-python/pull/303

• Add f to f-string by @markmcd in https://github.com/google-gemini/generative-ai-python/pull/322

Docs

• Debug docs build. by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/298
• Update issue templates to point to the Discourse forum by @ymodak in https://github.com/google-gemini/generative-ai-python/pull/304
• typo by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/313

New Contributors

• @PandasPirate made their first contribution in https://github.com/google-gemini/generative-ai-python/pull/301

Full Changelog: https://github.com/google-gemini/generative-ai-python/compare/v0.5.2...v0.5.3

Bug Fix

• Fix file uploads by @MarkDaoust in https://github.com/google-gemini/generative-ai-python/pull/291

New Features

• Support for new TaskTypes and output_dimensionality param by @mayureshagashe2105 in https://github.com/google-gemini/generative-ai-python/pull/285

Full Changelog: https://github.com/google-gemini/generative-ai-python/compare/v0.5.1...v0.5.2

New features

• Add JSON mode by @shilpakancharla in https://github.com/google/generative-ai-python/pull/274

Docs and small fixes

• Fix: incorrect type checking by @Yeuoly in https://github.com/google/generative-ai-python/pull/283
• Fix an internal test failure by @markmcd in https://github.com/google/generative-ai-python/pull/279
• Allow incomplete GenerationConfigDict by @markmcd in https://github.com/google/generative-ai-python/pull/286
• Use generativelanguage v0.6.2 for json mode + update package version. by @MarkDaoust in https://github.com/google/generative-ai-python/pull/287

New Contributors

• @Yeuoly made their first contribution in https://github.com/google/generative-ai-python/pull/283

Full Changelog: https://github.com/google/generative-ai-python/compare/v0.5.0...v0.5.1

What's Changed

New features

• Files API

  You can now upload files to the api. Then instead of resending an image with each request, just pass a file reference in your prompt:

  f = genai.upload_file(path="image.png")
  m = genai.GenerativeModel(model_name=...)
  response = m.generate_content(["Please describe this file:", f])
  

  • Add initial prototype supporting the files API by @MarkDaoust in https://github.com/google/generative-ai-python/pull/249
  • Files API: improve error messages, add delete_file, add .uri property by @TYMichaelChen in https://github.com/google/generative-ai-python/pull/260

• Semantic retriever

  Using answer.generate_answer, you can now either pass "inline_passages" to include the reference material in the request:

  from google.generativeai import answer
  answer.generate_answer(
      content=question,
      inline_passages=splitter.split(document)
  )
  

  Or pass a reference to a retriever Document or Corpus:

  from google.generativeai import answer
  from google.generativeai import retriever
  my_corpus = retriever.get_corpus('my_corpus')
  genai.generate_answer(
      content=question,
      semantic_retreiver=my_corpus
  )
  

  • Finish Semantic Retriever. by @shilpakancharla in https://github.com/google/generative-ai-python/pull/230

• System instructions

  When creating a model you can pass a string (or Content) as system_instructions: genai.GenerativeModel(system_instructions="Be good!")

  • Add basic SI and tool_config support by @MarkDaoust in https://github.com/google/generative-ai-python/pull/257
  • Add system_instruction to model repr by @markmcd in https://github.com/google/generative-ai-python/pull/272

• Function Calling - Tool Config

  The list of tools available for function calling during a chat session is typically constant. The new tool_config argument lets you switch the function calling mode between None (No function calls), Auto (The model chooses to return text or a FunctionCall), and Any (the model must call a function).

  model = genai.GenerativeModel(tools=[my_functions])
  chat = model.start_chat()
  chat.send_message(tool_config={"function_calling_config": "ANY"})
  

  In Any mode the model will return a function call. You may also pass allowed_function_names to restrict the calls to a subset of the available functions: `chat.send_message(tool_config={"function_calling_config": "ANY", "allowed_function_names": [...]})

  In Any mode the model can use constrained decoding to more strictly follow the argument specifications in the function declarations.

  • Add basic SI and tool_config support by @MarkDaoust in https://github.com/google/generative-ai-python/pull/257
  • Function calling mode patch by @mayureshagashe2105 in https://github.com/google/generative-ai-python/pull/271

Docs, bug fixes, and minor updates.

• Update README.md by @aertoria in https://github.com/google/generative-ai-python/pull/256
• Fix incorrect reference to self.candidates[0].parts, self.candidates[0].parts[0].text by @Andy963 in https://github.com/google/generative-ai-python/pull/239
• Fix TypedDict usage for compatibility with PyDantic by @MarkDaoust in https://github.com/google/generative-ai-python/pull/259
• Simplify the Python SDK README by @random-forests in https://github.com/google/generative-ai-python/pull/267
• Sdk update to use glm 0.6.1 by @mayureshagashe2105 in https://github.com/google/generative-ai-python/pull/270

New Contributors

• @aertoria made their first contribution in https://github.com/google/generative-ai-python/pull/256
• @TYMichaelChen made their first contribution in https://github.com/google/generative-ai-python/pull/260
• @random-forests made their first contribution in https://github.com/google/generative-ai-python/pull/267

Full Changelog: https://github.com/google/generative-ai-python/compare/v0.4.1...v0.5.0

Bugfix

• The send_message_async method should call the asynchronous method generate_content_async by @xnny in https://github.com/google/generative-ai-python/pull/229

Docs

• Fix wrong arg name in README by @lll-lll-lll-lll in https://github.com/google/generative-ai-python/pull/228

New Contributors

• @lll-lll-lll-lll made their first contribution in https://github.com/google/generative-ai-python/pull/228
• @xnny made their first contribution in https://github.com/google/generative-ai-python/pull/229

Full Changelog: https://github.com/google/generative-ai-python/compare/v0.4.0...v0.4.1

What's new

Features

• Update notebook magics to work with Gemini by @markmcd in https://github.com/google/generative-ai-python/pull/109
• Semantic retriever by @shilpakancharla in https://github.com/google/generative-ai-python/pull/168
• Attributed question answering (genai.generate_answer) by @shilpakancharla in https://github.com/google/generative-ai-python/pull/169
• Automatic function calling. by @MarkDaoust in https://github.com/google/generative-ai-python/pull/201

   model = genai.GenerativeModel(..., tools=[my_function])
   chat = model.start_chat(enable_automatic_function_calling=True)
  

• Request options (timeouts, retry, ...) by @aidoskanapyanov in https://github.com/google/generative-ai-python/pull/204

  Model.generate_content(..., 
      request_options={'timeout': 100, 'retry': google.api_core.retry.Retry()})
  

• Permissions module by @mayureshagashe2105 in https://github.com/google/generative-ai-python/pull/205

More updates

• Lock google-auth version to fix #114 by @yihong0618 in https://github.com/google/generative-ai-python/pull/115
• Update code in README.md and generate_content documentation by @Hamza-nabil in https://github.com/google/generative-ai-python/pull/149
• Make error message more readable by @ftnext in https://github.com/google/generative-ai-python/pull/163
• Python 3.12 support. by @MarkDaoust in https://github.com/google/generative-ai-python/pull/165
• Rename model defaults to use gemini-pro by @markmcd in https://github.com/google/generative-ai-python/pull/175
• Add a more explicit error when no parts are returned by @markmcd in https://github.com/google/generative-ai-python/pull/180
• Add embed_content_async implementation by @mayureshagashe2105 in https://github.com/google/generative-ai-python/pull/189
• Link embed_content reference page to model details page by @kaycebasques in https://github.com/google/generative-ai-python/pull/194
• Implement __repr__ for GenerateContentResponse and ChatSession by @aidoskanapyanov in https://github.com/google/generative-ai-python/pull/202
• Fixed #166. Thanks @piresramon. by @MarkDaoust in https://github.com/google/generative-ai-python/pull/208

New Contributors

• @yihong0618 made their first contribution in https://github.com/google/generative-ai-python/pull/115
• @ftnext made their first contribution in https://github.com/google/generative-ai-python/pull/163
• @mayureshagashe2105 made their first contribution in https://github.com/google/generative-ai-python/pull/189
• @kaycebasques made their first contribution in https://github.com/google/generative-ai-python/pull/194
• @aidoskanapyanov made their first contribution in https://github.com/google/generative-ai-python/pull/202

Full Changelog: https://github.com/google/generative-ai-python/compare/v0.3.2...v0.4.0

What's Changed

Fix GenerativeModel.count_tokens.
Add basic function call support.
Fix async streaming with python 3.9.
Use typing_extensions for TypedDict.
Fix docs and error messages.

New Contributors

• @Andy963 made their first contribution in https://github.com/google/generative-ai-python/pull/123
• @luo-anthony made their first contribution in https://github.com/google/generative-ai-python/pull/132
• @thesanju made their first contribution in https://github.com/google/generative-ai-python/pull/131
• @mpursley made their first contribution in https://github.com/google/generative-ai-python/pull/129
• @Hamza-nabil made their first contribution in https://github.com/google/generative-ai-python/pull/140
• @YebowenHu made their first contribution in https://github.com/google/generative-ai-python/pull/116
• @eavanvalkenburg made their first contribution in https://github.com/google/generative-ai-python/pull/104

Full Changelog: https://github.com/google/generative-ai-python/compare/v0.3.1...v0.3.2

Doc and Bug fixes.

Adds the Content family of methods to support Gemini models.

• Handle maximum batch size for embed_text.
• Restore types.ModelNameOptions.
• Update tuning to handle more dataset types (json, pandas, urls, google-sheets).
• Expose count_text_tokens
• Expose operations management.
• Allow users to pass custom metadata (HTML headers).
• Add dataclass prettyprinting.

• Bugfix: Add missing enum names to saftey_types.py
• Update to google.ai.generativelanguage v0.3.3
  • replace generativelanguage_v1beta3 with generativelanguage
    since that's the default in v0.3.3.

• Add support for tuning:
  • Add get_tuned_model.
  • Add list_tuned_models.
  • Add create_tuned_model.
• More flexible safety settings:
  • Accept strings and ints for enums.
• Accept a {category:threshold} dict in addition to the list of dicts format ([{"category": category, "threshold": threshold}, ...]).
• Add support for batched embeddings.