Jonny Dixon
7e7f9de92d
format
2025-09-29 14:53:35 +01:00
Jonny Dixon
552847f6a8
format
2025-09-29 14:52:49 +01:00
Jonny Dixon
6cf04fdbbc
format
2025-09-29 14:51:46 +01:00
Jonny Dixon
b44c0365cf
Merge branch 'master' into fivetran-std-edition-support
2025-09-29 14:50:23 +01:00
Jonny Dixon
20370c8882
updates
2025-09-29 14:49:06 +01:00
Jonny Dixon
8ddee246c2
updates
2025-09-29 14:45:14 +01:00
Aseem Bansal
1e749d0c55
docs(ingest): decode strings for easier getting started ( #14830 )
2025-09-29 16:43:20 +05:30
Jonny Dixon
d88df1a847
Implement incremental lineage and improve job/lineage extraction debugging
...
✅ Incremental Lineage Implementation:
- Add IncrementalLineageConfigMixin to FivetranSourceConfig
- Implement auto_incremental_lineage processor in get_workunit_processors
- Add comprehensive test coverage for incremental lineage functionality
🔧 Job Extraction Improvements:
- Enhanced sync history extraction with better error messages
- Added alternative job extraction for connectors with recent activity
- Implement synthetic job creation from connector timestamps
- Better debugging for missing sync history and job extraction failures
🐛 Bug Fixes:
- Fix Pydantic v1/v2 compatibility issues with HiddenFromDocs
- Improve error handling and logging throughout job extraction pipeline
- Add detailed logging for schema and lineage extraction failures
📊 Enhanced Debugging:
- More informative error messages for sync history extraction failures
- Better logging for job timestamp parsing and validation
- Improved lineage extraction debugging with schema count information
2025-09-29 09:12:07 +01:00
Mayuri Nehate
e698f0bf1d
feat(sdk/search): add tags, glossary terms filter ( #14873 )
...
Co-authored-by: Mayuri N <mayuri.nehate@datahub.com>
2025-09-29 06:31:39 +00:00
Mayuri Nehate
8d13b03e85
feat(sdk/search): add owner filter ( #14649 )
...
Co-authored-by: Mayuri N <mayuri.nehate@datahub.com>
2025-09-29 04:35:29 +00:00
Chakru
0b75674ab3
free up disk space in quickstart verification CI ( #14879 )
2025-09-28 14:36:23 -05:00
Sergio Gómez Villamor
900d7fe244
docs: hide pydantic_removed_field marked fields from documentation ( #14829 )
...
Co-authored-by: Claude <noreply@anthropic.com>
2025-09-28 09:36:37 +00:00
Anush Kumar
c18b125a05
feat(ingestion): Enhanced column lineage extraction for Looker/LookML ( #14826 )
2025-09-26 09:27:18 -07:00
david-leifker
50c5841b50
fix(schema-registry): fix v1.2.0.1 schema registry bug ( #14846 )
2025-09-26 10:22:25 -05:00
Tamas Nemeth
7e9c525448
fix(ingestion): Fix for module level variable caching in sqllite check ( #14861 )
2025-09-26 14:24:51 +02:00
Jesse Jia
4bf3f0e66d
feat(Plugin Loader) Add config to control plugin loader when failure happens ( #14769 )
...
Co-authored-by: jjia <jjia@netflix.com>
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2025-09-26 08:56:51 +00:00
Michael Maltese
eb066dcf1e
fix(ingest/gcs): fix a number of issues and add integration tests ( #14857 )
2025-09-25 14:53:33 -04:00
david-leifker
a85f83d556
fix(): fix config value ( #14865 )
2025-09-25 13:45:42 -05:00
Michael Maltese
55d714e0cd
fix(ingest/mssql): don't split_statements on keywords inside bracketed identifiers ( #14863 )
2025-09-25 12:29:38 -04:00
Chris Collins
72ee770ae3
feat(ui) Update summary page editability ( #14822 )
2025-09-25 10:53:13 -04:00
Kevin Karch
941b3c725a
feat(ingest): add lowercase urn config option to metabase source ( #14850 )
2025-09-25 08:50:56 -04:00
Sergio Gómez Villamor
0fa4639857
fix(sdk): fixes imports for some SaaS classes ( #14843 )
...
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2025-09-25 14:32:55 +02:00
Aseem Bansal
a1abac5250
feat(ui/ingest): make filter params part of url for navigation ( #14852 )
2025-09-25 12:01:28 +05:30
david-leifker
bd0379b8cb
fix(security): disable akka dns ( #14858 )
2025-09-24 18:16:14 -05:00
Gabe Lyons
dac35550cc
feat(alchemy): updating input with maxSize and Helper Text ( #14856 )
2025-09-24 13:00:23 -07:00
Aseem Bansal
60d888412f
feat(ui/ingest): filter for status on run history ( #14851 )
2025-09-24 20:48:42 +05:30
Aseem Bansal
6677f7d7ea
fix(ui/ingest): system source save ( #14847 )
2025-09-24 20:44:34 +05:30
Tamas Nemeth
7e868493fe
fix(ingest/redshift): Fix for missing schema containers during ingestion ( #14845 )
2025-09-24 14:41:39 +02:00
Fabio Serragnoli
b6eab24406
refactor(ui): Fix typo in onboarding "Quality" pop-up message ( #14816 )
...
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2025-09-24 17:32:34 +09:00
Adrian Machado
30c16d2e6f
Update react readme instructions ( #14839 )
2025-09-23 12:32:56 -07:00
skrydal
b0c9662be7
feature(transformers): Introduce Set browsePathsV2 transformer ( #14825 )
2025-09-23 19:20:01 +00:00
Sergio Gómez Villamor
ec166abade
tests(snaplogic): fix tests ( #14848 )
2025-09-23 18:18:32 +00:00
Anush Kumar
0f69e96078
feat(sdk): Added support for Change Audit Stamps in Dashboard and Chart entities ( #14815 )
2025-09-23 07:07:52 -07:00
Michael Maltese
9be65bd971
feat(ingest/tableau): enable extract_lineage_from_unsupported_custom_sql_queries by default ( #14717 )
2025-09-23 09:39:56 -04:00
sabdul
6a97baeee4
feat(ingestion/snaplogic): Add snaplogic as a source for metadata ingestion ( #14231 )
2025-09-23 20:26:24 +09:00
Jonny Dixon
e03b96a5b0
Fix Pydantic v1/v2 compatibility issues
...
- Make pydantic_core import conditional for v2 only
- Fix field_validator usage for cross-version compatibility
- Comment out non-existent PydanticDeprecatedSince20 warning filter
- Add conditional handling for json_schema and BeforeValidator
2025-09-23 11:24:21 +01:00
Jonny Dixon
6329165c64
Fix mypy error: Add missing pre=False parameter to root_validator
2025-09-23 11:18:13 +01:00
Jonny Dixon
8f29ff821d
Merge branch 'master' into fivetran-std-edition-support
2025-09-23 11:02:30 +01:00
Jonny Dixon
01ef4eeac4
improved throughput
2025-09-23 10:41:31 +01:00
Aseem Bansal
ddaebfbde1
doc(datahub cloud): update recommended versions for cli, helm ( #14841 )
2025-09-23 14:55:10 +05:30
Adrian Machado
a379f21089
feat(ui/ingest): bring back exact start time in run history ( #14837 )
2025-09-23 13:52:21 +05:30
Sergio Gómez Villamor
77fa969b76
fix(ingestion): avoid pyarrow CVE-2023-47248 ( #14819 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Piotr Skrydalewicz <piotr.skrydalewicz@acryl.io>
2025-09-23 08:19:03 +00:00
Harshal Sheth
a17fc4e0a8
chore(python): drop pydantic v1 support ( #14014 )
...
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
Co-authored-by: Piotr Skrydalewicz <piotr.skrydalewicz@acryl.io>
2025-09-23 07:40:29 +00:00
Deepak Garg
00bc0db68c
feat(quickstart): bump min docker req ( #14827 )
2025-09-23 10:27:49 +05:30
Gabe Lyons
c130241c2a
fix(tests): removing flakey v1 test ( #14676 )
2025-09-22 16:36:45 -07:00
Gabe Lyons
d68b86c5d6
docs(teams): removing stale teams docs ( #14810 )
2025-09-22 14:03:46 -07:00
purnimagarg1
b654d93962
fix(ui): fix link in entity header flashing infinitely ( #14820 )
2025-09-22 12:19:00 -04:00
purnimagarg1
9778c10b1b
test: bring cypress tests for structured properties to OSS ( #14832 )
2025-09-22 11:26:19 -04:00
Jonny Dixon
e571099f32
Delete test_streaming_with_real_api.py
2025-09-22 10:36:59 -04:00
rahul MALAWADKAR
3b18fd2369
chore(deps): fix (org.postgresql:postgresql) ( #14831 )
2025-09-22 09:36:35 -05:00
