unstructured/scripts/sql-test-helpers/create-pgvector-schema.sql
Steve Canny 086b8d6f8a
rfctr(part): prepare for pluggable auto-partitioners 2 (#3657)
**Summary**
Step 2 in prep for pluggable auto-partitioners, remove `regex_metadata`
field from `ElementMetadata`.

**Additional Context**
- "regex-metadata" was an experimental feature that didn't pan out.
- It's implemented by one of the post-partitioning metadata decorators,
so get rid of it as part of the cleanup before consolidating those
decorators.
2024-09-24 17:33:25 +00:00

44 lines
1020 B
SQL

CREATE EXTENSION vector;
CREATE TABLE elements (
id UUID PRIMARY KEY,
element_id VARCHAR,
text TEXT,
embeddings vector(384),
type VARCHAR,
system VARCHAR,
layout_width DECIMAL,
layout_height DECIMAL,
points TEXT,
url TEXT,
version VARCHAR,
date_created TIMESTAMPTZ,
date_modified TIMESTAMPTZ,
date_processed TIMESTAMPTZ,
permissions_data TEXT,
record_locator TEXT,
category_depth INTEGER,
parent_id VARCHAR,
attached_filename VARCHAR,
filetype VARCHAR,
last_modified TIMESTAMPTZ,
file_directory VARCHAR,
filename VARCHAR,
languages VARCHAR [],
page_number VARCHAR,
links TEXT,
page_name VARCHAR,
link_urls VARCHAR [],
link_texts VARCHAR [],
sent_from VARCHAR [],
sent_to VARCHAR [],
subject VARCHAR,
section VARCHAR,
header_footer_type VARCHAR,
emphasized_text_contents VARCHAR [],
emphasized_text_tags VARCHAR [],
text_as_html TEXT,
detection_class_prob DECIMAL
);