Initial Checks

• I have searched Google & GitHub for similar requests and couldn't find anything
• I have read and followed the docs and still think this feature is missing

Description

I am looking for an efficient way of creating a DocList or DocVec from a large DataFrame. Currently I am converting the DataFrame to a Dict and then looping over this to create the various objects which is slow.

I did come across the from_dataframe method: https://docs.docarray.org/API_reference/array/da_stack/#docarray.array.doc_vec.doc_vec.DocVec.from_dataframe

However this does not support list like fields, which is quite common when you have field that contains the text embeddings.

Affected Components

• Vector Database / Index
• Representing
• Sending
• storing
• multi modal data type