msgspec

A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML

BSD-3-CLAUSE License

Downloads
3.2M
Stars
1.9K
Committers
22
View Code on GitHub Visit Website View on X
Ecosystems: JSON, Python, YAML, JSON Schema

Bot releases are visible (Hide)

msgspec - Version 0.18.6 Latest Release

Published by jcrist 9 months ago

  • Support coercing integral floats to ints when strict=False (#619).
  • Preserve leading _ when renaming fields to camel or pascal case (#620).
  • Support zero-copy decoding binary fields to a memoryview (#624).
  • Fix a bug when inheriting from the same Generic base class multiple times (#626).
  • Add an order option to all encoders for enforcing deterministic/sorted ordering when encoding. This can help provide a more consistent or human readable output (#627).
  • Support inheriting from any slots-class when defining a new Struct type with gc=False (#635).
  • Automatically infer the input field naming convention when converting non-dict mappings or arbitrary objects to Struct types in msgspec.convert (#636).
msgspec - Version 0.18.5

Published by jcrist 10 months ago

  • Support unhashable Annotated metadata in msgspec.inspect.type_info (#566).
  • Fix bug preventing decoding dataclasses/attrs types with default values and slots=True, frozen=True (#569).
  • Support passing parametrized generic struct types to msgspec.structs.fields (#571).
  • Validate str constraints on dict keys when decoding msgpack (#577).
  • Support UUID subclasses as inputs to msgspec.convert (#592).
  • Call __eq__ from generated __ne__ if user defines manual __eq__ method on a Struct type (#593).
  • Include the Struct type in the generated hash (#595).
  • Add a cache_hash struct option (#596).
  • Fix a bug around caching of dataclass type info when dealing with subclasses of dataclasses (#599).
  • Add msgspec.structs.force_setattr (#600).
  • Support custom dict key types in JSON encoder and decoder (#602).
  • Include dict key constraints in generated JSON schema via the propertyNames field (#604).
  • Add a schema_hook for generating JSON schemas for custom types (#605).
  • Add support for Python 3.12's type aliases (#606).
msgspec - Version 0.18.4

Published by jcrist about 1 year ago

  • Resolve an issue leading to periodic segfaults when importing msgspec on CPython 3.12 (#561)
msgspec - Version 0.18.3

Published by jcrist about 1 year ago

  • Improve type annotation for Struct.__rich_repr__ (#557)
  • Add pre-built wheels for Python 3.12 (#558)
msgspec - Version 0.18.2

Published by jcrist about 1 year ago

  • Support Enum._missing_ hooks for handling unknown enum values (#532).
  • Fix JSON encoding of datetime.datetime objects with zoneinfo.ZoneInfo timezone components (#534).
  • Add support for attrs validators (#538).
  • Relax datetime/time parsing format to allow some RFC3339 extensions from ISO8601 (#539).
msgspec - Version 0.18.1

Published by jcrist about 1 year ago

  • Support custom builtin_types in msgspec.to_builtins (#517).
  • Try getattr before getitem when converting with from_attributes=True (#519).
  • More efficient module state access in top-level functions (#521).
msgspec - Version 0.18.0

Published by jcrist about 1 year ago

  • Add a new msgspec.json.Decoder.decode_lines method for decoding newline-delimited JSON into a list of values (#485).
  • Support for decoding UUIDs from binary values (#499).
  • Support for encoding UUIDs in alternate formats (#499).
  • Overhaul how dataclasses are encoded to support more dataclass-like objects (#501).
  • Encode all declared fields on a dataclass (#501).
  • Support encoding edgedb.Object instances as dataclass-like objects (#501).
  • Improve performance when json decoding float values (#510).
  • Support for JSON encoding dicts with float keys (#510).
  • Support for JSON decoding dicts with float keys (#510).
  • Add float_hook to msgspec.json.Decoder to support changing the default for how JSON floats are decoded (#511).
msgspec - Version 0.17.0

Published by jcrist over 1 year ago

  • Ensure None may be explicitly passed to defstruct for module/namespace/bases (#445).
  • Support decoding datetime.datetime values from int/float values (interpreted as seconds since the Unix epoch) when strict=False (#452).
  • Support subclasses of collection types (list, dict, ...) as inputs to convert (#453).
  • Support str subclasses as keys in to_builtins and all protocol encode methods (#454).
  • Improved performance when JSON encoding decimal.Decimal values (#455).
  • Improved performance when JSON encoding int/float values (#458).
  • Improved performance when JSON encoding str values (#459).
  • Wrap errors in dec_hook with a ValidationError (#460).
  • Support decoding decimal.Decimal values from numeric values (#463)
  • Support encoding decimal.Decimal values as numeric values (#465).
  • Support converting decimal.Decimal values to float in convert (#466).
  • Preliminary support for CPython 3.12 beta releases (#467).
  • Support decoding integers that don't fit into an int64/uint64 (#469).
  • Add a new optional __post_init__ method for Struct types (#470).
  • Support decoding 0/1 into bool types when strict=False (#471).
  • Wrap errors raised in __post_init__/__attrs_post_init__ in a ValidationError when decoding (#472).
  • Add native support for encoding/decoding datetime.timedelta types (#475).
  • Add a new msgspec.json.Encoder.encode_lines method for encoding an iterable of values as newline-delimited JSON (#479).
msgspec - Version 0.16.0

Published by jcrist over 1 year ago

  • Deprecate msgspec.from_builtins in favor of msgspec.convert. The new convert function provides a superset of the functionality available in the old from_builtins function. See the converters docs for more information (#431).
  • Add a from_attributes argument to msgspec.convert for allowing conversion between object types with matching attribute names. One use case for this is converting ORM objects to Struct or dataclasses types (#419).
  • Support passing generic Mapping objects as inputs to msgspec.convert. These may be coerced to dict/Struct/dataclasses/attrs types (#427).
  • Add a new strict keyword argument to all decode functions, Decoder classes, as well as msgspec.convert. This defaults to True, setting it to false enables a wider set of coercion rules (e.g. coercing a str input to an int). See "Strict" vs "Lax" Mode for more information (#434).
  • Allow any of msgspec's supported types as inputs to msgspec.convert (#431, #418).
  • Passthrough input unchanged when coercing to typing.Any type in msgspec.convert (#435).
  • Support parametrizing Decoder types at runtime (#415).
  • Support encoding subclasses of UUID (#429).
msgspec - Version 0.15.1

Published by jcrist over 1 year ago

  • Fix a reference counting bug introduced in 0.15.0 when decoding naive (no timezone) datetime/time objects in both the msgpack and json decoders (#409).
  • Work around an upstream bug in CPython to properly support Required/NotRequired in TypedDict when __future__.annotations is enabled (#410).
msgspec - Version 0.15.0

Published by jcrist over 1 year ago

  • Add support for Generic Struct types (#386, #393).
  • Add support for Generic dataclasses and attrs types (#396).
  • Add support for Generic typing.TypedDict and typing.NamedTuple types (#398).
  • BREAKING: No longer normalize timezones to UTC when decoding datetime objects from JSON (#391).
  • Support decoding unhyphenated UUIDs (#392).
  • A few type annotation fixups (#383, #387).
  • Dedent docstrings for descriptions when generating JSON schemas (#397).
  • Use a variant of __qualname__ when auto-generating Struct tags rather than __name__ (#399).
  • Fix bug when handling typing.Literal types containing a literal None (#400).
  • Make all Encoder/Decoder methods threadsafe (#402).
  • BREAKING: Drop the write_buffer_size kwarg to Encoder (#402).
msgspec - Version 0.14.2

Published by jcrist over 1 year ago

  • Remove __del__ trashcan usage for structs with gc=False (#369).
  • Support overriding __setattr__ in Struct types (#376).
  • Support encoding large integers in JSON (#378).
  • Fix a memory leak when msgpack decoding variable length tuples with more than 16 elements (#380).
  • Remove JSON compatibility checks when constructing a msgspec.json.Decoder. Trying to decode messages into types that JSON doesn't support will now error at decode time, rather than when the decoder is constructed (#381).
msgspec - Version 0.14.1

Published by jcrist over 1 year ago

  • Further optimize decoding of JSON arrays into lists #363
  • Fix a bug preventing using structs configured with dict=True on Python 3.11 #365
  • Avoid preallocating large lists/tuples in the msgpack decoder #367
msgspec - Version 0.14.0

Published by jcrist over 1 year ago

  • Support encoding and decoding attrs types (#323).
  • Add repr_omit_defaults configuration option for omitting struct default values in the repr (#322).
  • Expose a struct's configuration through a __struct_config__ attribute (#328).
  • Add msgspec.structs.fields utility function for inspecting the fields configured on a Struct (#330).
  • Add a dict configuration option for adding a __dict__ attribute to a Struct (#331).
  • Allow non-struct mixins to be used with struct types (#332).
  • Fix a bug when defining both lt and gt constraints on an integer type (#335).
  • Fix a bug supporting fields defined with msgspec.field() with no arguments (#343).
  • Allow arbitrary input types to msgspec.from_builtins (#346).
  • Support decoding into subclasses of int & bytes in msgspec.from_builtins (#346).
  • Add msgspec.UNSET and msgspec.UnsetType for tracking unset fields. See the docs for more information (#350).
  • BREAKING: In the unlikely event you were using the previous msgspec.UNSET singleton to explicitly indicate no default value on struct types, you should now make use of msgspec.NODEFAULT instead (#350).
  • Improve struct type annotations now that mypy supports typing.dataclass_transform (#352).
  • Support typing.Final annotations for indicating that an object field should be treated as immutable (#354).
  • Add a name keyword option to msgspec.field for renaming a single field (#356).
  • BREAKING: The rules around class inheritance and a struct's rename option have changed. See #356 for more information.
msgspec - Version 0.13.1

Published by jcrist over 1 year ago

  • Fix a memory leak in the JSON decoder introduced in 0.13.0, caused by a reference counting bug when decoding into Struct types (#312).
msgspec - Version 0.13.0

Published by jcrist over 1 year ago

  • Add to_builtins function for converting messages composed of any supported type to ones composed of only simple builtin types commonly supported by Python serialization libraries (#258).
  • Add from_builtins function for converting and validating messages composed of simple builtin types to ones composed of any type msgspec supports (#266, #302).
  • Add msgspec.yaml module for encoding/decoding YAML (#267).
  • Add msgspec.toml module for encoding/decoding TOML (#268).
  • Add msgspec.structs.replace function for creating a copy of an existing Struct with some changes applied (#262).
  • Add msgspec.structs.asdict and msgspec.structs.astuple functions for converting a struct instance to a dict or tuple respectively (#300).
  • Support arbitrarily nested typing.NewType/typing.Annotated types (#272).
  • Improve error message for invalid keyword arguments passed to Struct.__init__ (#273).
  • Support default_factory configuration for Struct fields (#274).
  • BREAKING: With the exception of empty builtin collections ([], {}, set(), bytearray()), mutable default values in Struct types are no longer deepcopied when used. If a different mutable default value is needed, please configure a default_factory instead (#274).
  • Improve performance of creating Structs with default parameters (#274).
  • Support typing.ClassVar annotations of Struct types (#281).
  • Support encoding/decoding decimal.Decimal types (#288).
  • Support "abstract" type annotations like collections.abc.MutableMapping/typing.MutableMapping in decoders (#290).
  • Support any string-like or int-like type as a dict key when encoding or decoding JSON (#292).
  • Improved performance encoding large collections in JSON and MessagePack encoders (#294, #298).
msgspec - Version 0.12.0

Published by jcrist almost 2 years ago

  • Support encoding set and frozenset subclasses (#249).

  • Support encoding/decoding typing.NewType types (#251).

  • Allow creating a msgspec.Raw object from a str (#252).

  • Add new experimental msgspec.inspect module for inspecting type annotations. This is intended to be used for building downstream tooling based on msgspec-compatible types. See the docs for more information (#253).

  • Add new extra field to msgspec.Meta, for storing arbitrary user-defined metadata (#255).

  • Improved performance for JSON encoding strings (#256).

msgspec - Version 0.11.0

Published by jcrist almost 2 years ago

  • Improve performance of constructors for Struct types when using keyword arguments (#237).

  • Support constraints on dict keys for JSON (#239).

  • Add support for keyword-only arguments in Struct types, matching the behavior of kw_only for dataclasses (#242).

  • BREAKING: Change the parameter ordering rules used by Struct types to match the behavior of dataclasses. For most users this change shouldn't break anything. However, if your struct definitions have required fields after optional fields, you'll now get an error on import. This error can be fixed by either:

    • Reordering your fields so all required fields are before all optional fields
    • Using keyword-only parameters (by passing the kw_only=True option).

    See Field Ordering for more information (#242).

  • Support encoding/decoding dictionaries with integer keys for JSON (#243).

msgspec - Version 0.10.1

Published by jcrist almost 2 years ago

  • Ignore attributes with leading underscores ("_") when encoding dataclasses (#234)
msgspec - Version 0.10.0

Published by jcrist almost 2 years ago

  • Add forbid_unknown_fields configuration option to Struct types (#210)
  • BREAKING: Encode all enum types by value, rather than name (#211)
  • Fix a bug in the JSON encoder when base64 encoding binary objects (#217)
  • Add support for encoding/decoding dataclasses (#218)
  • Add support for encoding/decoding datetime.date objects (#221)
  • Add support for encoding/decoding uuid.UUID objects (#222)
  • BREAKING: support encoding/decoding datetime.datetime values without timezones by default (#224).
  • Add a tz constraint to require aware or naive datetime/time objects when decoding (#224).
  • Add support for encoding/decoding datetime.time objects (#225)
  • Add a msgspec.json.format utility for efficiently pretty-printing already encoded JSON documents (#226).
  • Support decoding JSON from strings instead of just bytes-like objects (#229)
Package Rankings
Top 33.39% on Conda-forge.org
Top 2.03% on Pypi.org
Related Projects
voluptuous

CONTRIBUTIONS ONLY: Voluptuous, despite the name, is a Python data validation library.

15 Jul 2010 1,814
msgpack-numpy

Serialize numpy arrays using msgpack

07 Feb 2013 196
orjson

Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy

21 Nov 2018 6,140
python-betterproto

Clean, modern, Python 3.6+ code generator & library for Protobuf 3 and async gRPC

10 Oct 2019 1,396
jsonschema-gen

JSONSchema generation from Python type hints

04 Apr 2024 1
dc_schema

Generate JSON schema from python dataclasses

20 Apr 2022 15
jsonschema-rs

JSON Schema validation library

07 Mar 2020 451
msgpack-python

MessagePack serializer implementation for Python msgpack.org[Python]

21 Aug 2011 1,848