class sources.JsonlString

Source reading data from line-delimited JSON strings using PyArrow.


Add data to the source.

sources.JsonlString.create(json_string=None, *, time_column, key_column, subsort_column=None, schema=None, grouping_name=None, time_unit=None)

Create a source reading from JSON strings.

  • json_string (Optional[str | BytesIO], default: None)

    The line-delimited JSON string to start from.

  • time_column (str)

    The name of the column containing the time.

  • key_column (str)

    The name of the column containing the key.

  • subsort_column (Optional[str], default: None)

    The name of the column containing the subsort.

    If not provided, the subsort will be assigned by the system.

  • schema (Optional[Schema], default: None)

    The schema to use. If not provided, it will be inferred from the input.

  • grouping_name (Optional[str], default: None)

    The name of the group associated with each key.

    This is used to ensure implicit joins are only performed between data grouped

    by the same entity.

  • time_unit (Optional[TimeUnit], default: None)

    The unit of the time column. One of ns, us, ms, or s.

    If not specified (and not specified in the data), nanosecond will be assumed.