Jonny Dixon
2feaa39256
improved naming
2025-09-17 07:14:21 -04:00
skrydal
667b7cb12c
fix(sdk_v2/lineage): Fix handling of null platform ( #14784 )
2025-09-17 09:11:03 +02:00
Gabe Lyons
6d2501ba0a
Revert "docs(release): Add release notes for version 0.3.14" ( #14788 )
2025-09-16 16:04:25 -07:00
Gabe Lyons
bd8f335110
docs(release): Add release notes for version 0.3.14 ( #14732 )
...
Co-authored-by: Ben Blazke <benjiaming@users.noreply.github.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
Co-authored-by: Chakru <161002324+chakru-r@users.noreply.github.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2025-09-16 15:47:09 -07:00
Chris Collins
0c388dcfa1
feat(docs) Add feature guide doc for the new Custom Asset Summaries ( #14782 )
2025-09-16 18:34:08 -04:00
Chris Collins
8fafa22c68
feat(ui) Update home page template editability ( #14772 )
2025-09-16 15:04:07 -04:00
Chris Collins
e8e97beee6
fix(ui) Add collection of minor fixes for summary pages and home page ( #14771 )
2025-09-16 10:50:40 -04:00
Saketh Varma
4fd60c698c
fix(ui): Render the values instead of urns in Policies Modal ( #14613 )
2025-09-16 04:18:07 +00:00
Maggie Hays
e479ca59b7
docs(Ask DataHub) Update naming conventions for Ask DataHub ( #14746 )
2025-09-15 17:07:16 -07:00
Andrew Sikowitz
29f717b7d1
fix(ui/browse): Fix bug where browse would not paginate when leaving a nested container ( #14483 )
2025-09-15 13:41:41 -07:00
Andrew Sikowitz
f38c25dabb
refactor(ui): Prevent console warnings in Tabs.tsx and SidebarAboutSection.tsx ( #14144 )
2025-09-15 13:29:05 -07:00
andrewsrajasekar
f5f753343f
fix(web): Search results Scroll Issue with filters sidebar ( #14484 )
...
Co-authored-by: AndrewsRajasekar <andrajasekar@paypal.com>
Co-authored-by: Apple <apple@Apples-MacBook-Pro.local>
2025-09-15 14:10:47 -04:00
Sergio Gómez Villamor
d82ae8014e
feat(bigquery): add created and modified timestamps to dataset containers ( #14716 )
...
Co-authored-by: Claude <noreply@anthropic.com>
2025-09-15 18:24:58 +02:00
skrydal
36cf767d2d
Revert "chore(ingestion/iceberg): Safe-guard pyiceberg version before pydantic 1->2 transition ( #14736 )" ( #14767 )
2025-09-15 18:20:56 +02:00
Saketh Varma
229911a495
fix(ui): Increasing the 'Try your test' modal width ( #14612 )
2025-09-15 16:08:28 +00:00
Chris Collins
f8a401ddd1
fix(ui) Fix weird indents on schema table descriptions ( #14652 )
2025-09-15 11:53:20 -04:00
Alex
acd7236290
fixes to improve stability of the ci build ( #14752 )
2025-09-15 09:44:42 -05:00
Tamas Nemeth
2788b867c5
fix(ingest/pipeline): Fix BatchPartitionExecutor Shutdown Race Condition ( #14750 )
2025-09-15 14:59:16 +02:00
Jonny Dixon
92bcccd2bc
docs(ingestion/redshift): add required permissions for table and view discovery in pre-requisites documentation ( #14765 )
2025-09-15 12:55:20 +01:00
skrydal
b568eac9bc
chore(ingestion/iceberg): Include explicit extras in dependencies ( #14766 )
2025-09-15 11:47:04 +00:00
Jonny Dixon
e88ca21448
Merge branch 'master' into fivetran-std-edition-support
2025-09-15 09:49:28 +01:00
Sergio Gómez Villamor
492e28a938
feat(ingest/neo4j): migrate Neo4j source to DataHub Python SDK v2 ( #14591 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Claude <noreply@anthropic.com>
2025-09-15 08:42:54 +00:00
Jonny Dixon
50243cdeac
fixed tests
2025-09-15 04:19:56 -04:00
Jonny Dixon
21ebdffa04
Merge branch 'master' into fivetran-std-edition-support
2025-09-15 09:06:22 +01:00
Chakru
f706465a05
fix(ci): use correct path for cypress test result xmls ( #14756 )
2025-09-14 17:34:25 -05:00
Chakru
45ba15f4ac
fix(ci): revert workaround to enumerate image targets ( #14755 )
2025-09-14 17:34:07 -05:00
Jonny Dixon
62557841bc
test fixes
2025-09-13 11:39:03 +01:00
Jonny Dixon
0ba70347b8
adding test coverage
2025-09-12 23:28:55 +01:00
david-leifker
289c5c1184
fix(structured-properties): fix structured properties manage role ( #14751 )
2025-09-12 16:09:05 -05:00
Jonny Dixon
7e8049bfe6
docs(ingestion/redshift): update documentation to cover svv and stv system tables ( #14727 )
2025-09-12 19:48:50 +01:00
Jonny Dixon
fb8e3d9f0a
Merge origin/master into fivetran-std-edition-support
...
- Resolved conflict in config.py by removing KNOWN_DATA_PLATFORM_MAPPING
- Our dynamic service mapping approach is more robust and maintainable
- All tests pass, linting clean
2025-09-12 19:45:36 +01:00
Jonny Dixon
203e3126a6
Update fivetran.py
2025-09-12 19:42:40 +01:00
Jonny Dixon
e5591e8865
better formatting
2025-09-12 19:28:58 +01:00
Michael Maltese
10649f3f38
feat(ingest/fivetran): map google_cloud_postgresql => postgres ( #14742 )
2025-09-12 17:12:10 +00:00
dependabot[bot]
becfe19fee
chore(deps): bump actions/setup-python from 5 to 6 ( #14701 )
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2025-09-12 12:11:28 -05:00
Jonny Dixon
526f23be28
Merge origin/master into fivetran-std-edition-support
...
Resolved merge conflicts by:
- Keeping improved dynamic service mapping over hardcoded platform mappings
- Maintaining enhanced parallel processing and error handling
- Preserving comprehensive API validation and accessibility checks
- Using updated DataFlow/DataJob constructors with better parameter naming
- Keeping improved golden test expectations that reflect our enhancements
- Cleaned up unused imports (StructuredLogCategory, CorpUserUrn)
All 49 unit tests passing with comprehensive Fivetran connector improvements.
2025-09-12 17:42:27 +01:00
Jonny Dixon
b4b1d10590
feat: Improve Fivetran connector with dynamic service mapping and enhanced parallelization
...
- Remove unsupported platform mappings to only include DataHub-supported platforms
- Add dynamic service mapping using Fivetran API service field instead of hardcoded aliases
- Enhance parallel processing for connector and table-level operations
- Add connector accessibility validation with graceful error handling
- Improve column retrieval with better error handling and fallback mechanisms
- Add comprehensive API endpoint validation
- Update documentation with performance optimization details
- All 49 unit tests passing with comprehensive coverage
2025-09-12 17:30:38 +01:00
dependabot[bot]
d3e8139d53
chore(deps-dev): bump vite from 6.3.5 to 6.3.6 in /datahub-web-react ( #14720 )
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-12 16:24:33 +00:00
dependabot[bot]
46ac6c428a
chore(deps): bump aquasecurity/trivy-action from 0.33.0 to 0.33.1 ( #14699 )
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2025-09-12 16:04:49 +00:00
david-leifker
ef5a5b4fa2
fix(ci): cloudflare workflow cannot run without token ( #14749 )
2025-09-12 10:58:57 -05:00
dependabot[bot]
8fc449b45f
chore(deps): bump actions/stale from 9 to 10 ( #14697 )
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-12 10:52:50 -05:00
dependabot[bot]
17ec667af1
chore(deps): bump aws-actions/configure-aws-credentials from 4 to 5 ( #14698 )
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-12 10:52:40 -05:00
Chris Collins
87c2d14ea2
fix(ui) Improve flakiness of modules and templates cypress tests ( #14748 )
2025-09-12 11:51:44 -04:00
dependabot[bot]
e62719b207
chore(deps): bump actions/download-artifact from 4 to 5 ( #14700 )
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-12 10:51:34 -05:00
Jonny Dixon
6471c32457
feat(fivetran): Add parallel processing and optimize Standard API performance
...
- Add ThreadPoolExecutor for parallel column retrieval and connector processing
- Add max_workers configuration parameter for controlling parallelization
- Improve error handling for 400 Bad Request responses in column retrieval
- Fix per-table mode DPI generation to avoid excessive duplication
- Improve Fivetran edition auto-detection to prefer enterprise mode
- Fix GraphQL operation parameter naming issue
Performance improvements:
- Column retrieval now parallelized within batches
- Connector lineage extraction now parallelized across connectors
- Reduced unnecessary retries for 400 errors (permanent failures)
- Better error logging and handling
This significantly speeds up Standard API ingestion while maintaining reliability.
2025-09-12 15:02:37 +01:00
Abe
dede42d933
docs(dev-setup): Update IntelliJ setup instructions ( #14718 )
2025-09-11 23:52:13 +00:00
david-leifker
c3283ef314
docs(platform-instance): documentation refresh ( #14739 )
2025-09-11 20:17:06 +00:00
david-leifker
030b4ace93
chore(bump): bump msk-iam-auth ( #14744 )
2025-09-11 13:57:50 -05:00
david-leifker
f34abede15
fix(trivy): fix pattern ( #14743 )
2025-09-11 13:32:14 -05:00
Jonny Dixon
57250477bf
feat(access-request): enable groups to be granted to role and grey button when granted ( #14622 )
2025-09-11 19:15:01 +01:00
