Struct ArrowStreamSerializerConfig 

pub struct ArrowStreamSerializerConfig {
    pub schema: Option<Schema>,
    pub allow_nullable_fields: bool,
}

Configuration for Arrow IPC stream serialization

Fields

schema: Option<Schema>

The Arrow schema to use for encoding

allow_nullable_fields: bool

Allow null values for non-nullable fields in the schema.

When enabled, missing or incompatible values will be encoded as null even for fields marked as non-nullable in the Arrow schema. This is useful when working with downstream systems that can handle null values through defaults, computed columns, or other mechanisms.

When disabled (default), missing values for non-nullable fields will cause encoding errors, ensuring all required data is present before sending to the sink.

Implementations

impl ArrowStreamSerializerConfig

pub fn new(schema: Schema) -> Self

Create a new ArrowStreamSerializerConfig with a schema

pub fn input_type(&self) -> DataType

The data type of events that are accepted by ArrowStreamEncoder.

pub fn schema_requirement(&self) -> Requirement

The schema required by the serializer.

Trait Implementations

impl Clone for ArrowStreamSerializerConfig

fn clone(&self) -> ArrowStreamSerializerConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Configurable for ArrowStreamSerializerConfig

fn referenceable_name() -> Option<&'static str>

Gets the referenceable name of this value, if any.

fn metadata() -> Metadata

Gets the metadata for this value.

fn generate_schema( schema_gen: &RefCell<SchemaGenerator>, ) -> Result<SchemaObject, GenerateError>

Generates the schema for this value.

fn is_optional() -> bool

where Self: Sized,

Whether or not this value is optional.

fn validate_metadata(_metadata: &Metadata) -> Result<(), GenerateError>

where Self: Sized,

Validates the given metadata against this type.

fn as_configurable_ref() -> ConfigurableRef

where Self: Sized + 'static,

Create a new configurable reference table.

impl Debug for ArrowStreamSerializerConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ArrowStreamSerializerConfig

fn default() -> ArrowStreamSerializerConfig

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ArrowStreamSerializerConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for ArrowStreamSerializerConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl ToValue for ArrowStreamSerializerConfig

fn to_value(&self) -> Value

Convert this value into a serde_json::Value. Must not fail.