26 Commits

Author SHA1 Message Date
Aseem Bansal
809d1beae9
feat(snowflake): reduce permissions provisioned by default (#4543)
* feat(snowflake): reduce permissions provisioned by default

Co-authored-by: John Joyce <john@acryl.io>
2022-04-05 09:03:00 -07:00
Corentin
2fc3a48bc5
feat(ingest): indent sql queries for usage sources (#3782)
* feat(ingest): indent sql queries for usage connectors.

Co-authored-by: EC2 Default User <ec2-user@ip-172-31-22-140.eu-west-1.compute.internal>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-03-31 15:15:09 -07:00
Aseem Bansal
5d9c146bf7
doc: add example of profiling in default example (#4532) 2022-03-30 10:07:32 -07:00
Aseem Bansal
d30b6e1465
feat(ingest): Add config to improve user exp for initial ingestion and fix docs (#4510)
* feat(snowflake): change defaults to improve user experience for initial ingestion + documentation
2022-03-29 07:15:36 -07:00
Aseem Bansal
6b04dff913
docs: add example of database and schema allow/deny patterns (#4505) 2022-03-28 13:06:40 +02:00
Aseem Bansal
9596e73706
doc: add caveats to snowflake doc (#4467) 2022-03-24 16:24:38 +01:00
Aseem Bansal
4bcc2b3d12
feat(ingestion): improve logging, docs for bigquery, snowflake, redshift (#4344) 2022-03-14 08:50:29 -07:00
Aseem Bansal
05f2507e16
fix(doc): remove duplicate entry for permission (#4341) 2022-03-08 09:32:32 -08:00
Aseem Bansal
beb51ebf59
fix(ingestion): add logging, make job more resilient to errors (#4331) 2022-03-07 14:32:44 -08:00
Ravindra Lanka
51d72c6a29
feat(ingestion): Add support for snowflake view lineage. (#4163)
* Add support for snowflake view lineage.

* Add a config flag. Sepearate upstream & downstream view lineage computation. Update documentation.
2022-02-16 18:27:40 -08:00
Tamas Nemeth
63bc830cfe
Data domain containers ingestion (#4051) 2022-02-07 09:51:49 -08:00
Tamas Nemeth
68711222d4
feat(ingest): usage-stats - add ability to ignore users from top users calculation (#3735) 2022-02-01 00:11:23 -08:00
Michael A. Schlosser
c36662f837
feat(ingest): snowflake - support for additional auth mechanisms (#4009) 2022-01-30 11:47:53 -08:00
Swaroop Jagadish
9a9f448ebf
feat(ingest): platform-instance - changes to support platform instances in sources (#3996) 2022-01-27 15:31:25 -08:00
Ravindra Lanka
715a2e5f8e
feat(ingest): snowflake, glue - add support for lineage to s3 (#3946) 2022-01-21 17:19:21 -08:00
Aditya Radhakrishnan
c3e98645a2
feat(ingest): operational stats - show last updated for sql usage sources (#3845) 2022-01-07 17:27:09 -08:00
Tamas Nemeth
450cdc1739
feat(snowflake-usage): Generate email address if not exists (#3791) 2021-12-29 08:14:18 -08:00
John Joyce
110efa68b9
docs(snowflake): Adding documentation about required Snowflake Privileges (#3770) 2021-12-19 12:01:53 -08:00
Ravindra Lanka
bd69e736ba
feat(Stateful Ingestion-2/3): Client side changes for checkpointing a source job state. (#3763)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-12-16 20:06:33 -08:00
varunbharill
70d068892e
fix(ingest): snowflake honor allow/deny pattern for lineage and usage. (#3748) 2021-12-14 20:42:29 -08:00
Gabe Lyons
2e2ed34250
feat(ingest): snowflake-usage add knob for direct objects accessed vs base objects accessed (#3744) 2021-12-14 18:07:55 -08:00
Ravindra Lanka
7d64fc755b
fix(docs): snowflake documentation (#3585) 2021-11-16 10:58:14 -08:00
Ravindra Lanka
b4c0e20c68
feat(ingest): add lineage support to snowflake connector (#3331) 2021-10-05 22:58:07 -07:00
Kevin Hu
1ad1243371
feat(docs): link to SQL profiling docs from each SQL source (#3071) 2021-08-11 08:00:21 -07:00
Kevin Hu
5891482114
fix(ingest): apply case insensitive regex matching by default (#3067) 2021-08-10 10:35:57 -07:00
Kevin Hu
32b8fc6108
feat(docs): refactor source and sink ingestion docs (#3031) 2021-08-08 13:40:51 -07:00