3904 Commits

Author SHA1 Message Date
k-bartlett
dc87b51369
feat(ingest): connector for Neo4j (#11526)
Co-authored-by: kbartlett <keith.bartlett@fullsight.org>
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
Co-authored-by: Jay Feldman <8128360+feldjay@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: deepgarg-visa <149145061+deepgarg-visa@users.noreply.github.com>
Co-authored-by: Felix Lüdin <13187726+Masterchen09@users.noreply.github.com>
2024-12-02 14:53:28 +05:30
Tamas Nemeth
a31c88e622
fix[ingest/build]: Disable preflight script as it is not needed anymore (#11989) 2024-12-02 10:03:06 +01:00
Jonny Dixon
337f2b95f5
fix(docs): fix sample business glossary (#11669) 2024-11-29 11:59:18 -08:00
Jonny Dixon
74a84885df
feat(ingest/dremio): Retrieve default_schema for SQL views (#11832) 2024-11-29 11:46:29 -08:00
sagar-salvi-apptware
c42f779859
fix: Add option for disabling ownership extraction (#11970)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-11-29 21:28:31 +05:30
Harshal Sheth
a46de1ecf9
feat(ingest/athena): handle partition fetching errors (#11966) 2024-11-28 21:42:55 -05:00
Harshal Sheth
a92c6b2bb0
feat(ingest): add tests for colon characters in urns (#11976) 2024-11-28 21:42:40 -05:00
Harshal Sheth
0476bf1e32
feat(ingest): bump typing_extensions dep (#11965) 2024-11-28 21:41:53 -05:00
Harshal Sheth
189f8cefa7
feat(ingest): standardize sql type mappings (#11982) 2024-11-28 14:53:46 -05:00
skrydal
816fd3dba7
fix(ingestion/iceberg): Improvements to iceberg source (#11987) 2024-11-28 15:34:20 +00:00
Mayuri Nehate
ecba2244f0
fix(ingest/kafka):add poll for admin client for oauth_cb (#11985)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-11-28 19:23:30 +05:30
Margarida Fernandes
f3eda31326
feat(ingestion): extend feast plugin to ingest tags and owners (#11784)
Co-authored-by: John Joyce <john@acryl.io>
2024-11-27 15:41:04 -08:00
sid-acryl
7bf7673735
refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924) 2024-11-27 09:32:24 -08:00
Aseem Bansal
48d711b198
fix(ingest): more error handling (#11969) 2024-11-27 16:49:01 +05:30
Harshal Sheth
b6ccb8c9bf
fix(ingest): ensure sentry is initialized with graph tags (#11949) 2024-11-26 22:20:50 -05:00
Mayuri Nehate
2e3b4294bb
feat(ingest/mssql): allow filtering by procedure_pattern (#11953) 2024-11-26 11:16:42 -05:00
Tamas Nemeth
01fb64c531
fix(ingest/bigquery): Fix performance issue with column profiling ignore (#11807) 2024-11-26 15:32:03 +01:00
sagar-salvi-apptware
b357f87f94
fix(ingest/sigma): migrate sigma workbooks from container to dashboard (#11939) 2024-11-26 18:56:30 +05:30
Mayuri Nehate
3423e34899
feat(ingest): add more logs for kafka polling (#11954) 2024-11-26 16:22:06 +05:30
Harshal Sheth
9f9a8b1006
fix(ingest/tableau): handle none database field (#11950) 2024-11-26 11:30:56 +05:30
Mayuri Nehate
90fe14aadb
docs(ingest/bigquery): add partition support capability (#11940) 2024-11-25 12:14:10 -08:00
Hyejin Yoon
56a5dcaaea
fix: remove ai summit post (#11826) 2024-11-25 15:56:26 +09:00
Mayuri Nehate
a1c71a48f2
feat(ingest/oracle): support profile limits for large tables (#11827) 2024-11-25 10:36:58 +05:30
Mayuri Nehate
b5fb691f0d
feat(ingest/kafka): improve error handling of oauth_cb config (#11929) 2024-11-25 10:31:35 +05:30
Mayuri Nehate
dd892dfbb1
fix(ingest/bigquery): ignore include constraints for biglake datasets (#11874) 2024-11-25 10:31:17 +05:30
Mayuri Nehate
c3f9a9206d
feat(ingest/mssql): include stored procedure lineage (#11912)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-11-22 20:32:24 +05:30
sid-acryl
86b8175627
fix(ingestion/kafka): OAuth callback execution (#11900) 2024-11-22 13:08:23 +05:30
Andrew Sikowitz
80ef5418cf
docs(ingest): Raise error on unsupported sqlite version (#11921)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-11-21 21:23:24 -08:00
Harshal Sheth
1bfd4ee1d4
feat(ingest): handle mssql casing issues in lineage (#11920) 2024-11-21 17:16:04 -08:00
Harshal Sheth
7bdd0a8016
chore(ingest): always use urn creation helpers (#11911) 2024-11-21 13:49:41 +05:30
Felix Lüdin
e4d010d757
docs(ingest/sac): add additional permission for SAP Analytics Cloud source to docs (#11903) 2024-11-20 16:05:50 -08:00
Harshal Sheth
37bb0c9eae
fix(ingest/sql): disable patch checker (#11910) 2024-11-20 13:48:56 -08:00
Harshal Sheth
42bb07a35e
fix(ingest/bigquery): increase logging in bigquery-queries extractor (#11774) 2024-11-20 13:35:01 -08:00
Harshal Sheth
3b415cde69
refactor(ingest/snowflake): move oauth config into snowflake dir (#11888) 2024-11-20 13:34:47 -08:00
Harshal Sheth
5519a330e2
chore(ingest): bump black (#11898) 2024-11-20 13:33:54 -08:00
Harshal Sheth
7dbb3e60cb
chore(ingest): start using explicit exports (#11899) 2024-11-20 13:33:30 -08:00
sid-acryl
3f267afc97
fix(ingest/powerbi): m-query fixes (#11906)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-11-20 11:31:54 -08:00
Aseem Bansal
05d362a94e
fix(ingest): add error handling (#11905) 2024-11-20 20:47:39 +05:30
Harshal Sheth
524ef8c6d0
perf(ingest/redshift): limit copy lineage (#11662)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-11-20 13:59:05 +05:30
Harshal Sheth
85c8e605be
fix(ingest): consider sql parsing fallback as failure (#11896) 2024-11-19 15:06:16 -08:00
mikeburke24
4601aacfad
fix(ingest): upgrade msal (#11883) 2024-11-19 15:59:37 +05:30
Andrew Sikowitz
94f1f39667
fix(ingest/partitionExecutor): Fetch ready items for non-empty batch when _pending is empty (#11885) 2024-11-18 17:25:43 -08:00
Raudzis Sebastian
19702c8225
fix(ingest/lookml): replace class variable with instance variable for improved encapsulation (#11881) 2024-11-18 15:45:05 -08:00
skrydal
2527f54972
feat(ingest/iceberg): Iceberg performance improvement (multi-threading) (#11182) 2024-11-18 19:41:45 +01:00
Tamas Nemeth
d660db11de
fix(ingest/airflow): Remove seems like not intended force debug mode which caused plugin fail on EMR (#11877) 2024-11-18 13:36:39 +01:00
Hendrik Richert
37fa07694f
feat(py-sdk): add cli version to ingestion headers (#11847)
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: Shirshanka Das <shirshanka+github@gmail.com>
2024-11-18 16:55:40 +05:30
Shirshanka Das
3e128f4286
chore(structured-properties): add cli validation for entity types (#11863) 2024-11-16 13:45:39 -08:00
sagar-salvi-apptware
fd2da83ff4
feat(ingest/cassandra): Add support for Cassandra as a source (#11822) 2024-11-15 20:41:21 +05:30
skrydal
becda8fd34
docs(ingest): transformer docs and java example (#11859) 2024-11-15 20:19:45 +05:30
Jonny Dixon
ab0b0a2eb9
fix(ingest/dremio): Dremio software jobs retrieval SQL query fix query error (#11817)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-11-14 14:47:50 +05:30