yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-07-04 15:50:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
datahub/docs/automations/ai-docs.md
Harshal Sheth 0d06a61365
docs: add docs on term suggestion (#11606)
2024-10-14 20:38:23 -07:00

1.5 KiB
Raw Blame History

import FeatureAvailability from '@site/src/components/FeatureAvailability';

AI Documentation

:::info

This feature is currently in closed beta. Reach out to your Acryl representative to get access.

:::

With AI-powered documentation, you can automatically generate documentation for tables and columns.

Configuring

No configuration is required - just hit "Generate" on any table or column in the UI.

How it works

Generating good documentation requires a holistic understanding of the data. Information we take into account includes, but is not limited to:

  • Dataset name and any existing documentation
  • Column name, type, description, and sample values
  • Lineage relationships to upstream and downstream assets
  • Metadata about other related assets

Data privacy: Your metadata is not sent to any third-party LLMs. We use AWS Bedrock internally, which means all metadata remains within the Acryl AWS account. We do not fine-tune on customer data.

Limitations

  • This feature is powered by an LLM, which can produce inaccurate results. While we've taken steps to reduce the likelihood of hallucinations, they can still occur.