ChunkWriter
ChunkerWriter
The ChunkerWriter
step is used to write chunks and their vectors to a vector index.
This step must be (directly or indirectly) preceded by a Chunker in the pipeline.
Any vectors generated by an emebddign step will be stored in the vector index with the chunk.
The vector index must be configured at creation with the model name matching the model used to generate the vectors you want to store.
Step Args
Key | Value Type | Value Description |
---|---|---|
vector_index_name |
str |
the name of the vector index to which to write |