11753 Commits

Author SHA1 Message Date
Vinícius Mello
7059874dec
feat(ingest/bigquery): Add BigQuery Views lineage extraction from Google Data Catalog API (#8100) 2023-05-25 08:37:46 -07:00
Andrew Sikowitz
d3cd4dbb0c
feat(ingest/unity): Allow ingestion without metastore admin role (#8091)
- Adds more detailed docs and connection test
- Fixes empty username queries
2023-05-24 15:36:22 -07:00
Tamas Nemeth
fb087c5e35
fix(ingest/redshift):fixing schema filter (#8119) 2023-05-24 22:35:28 +00:00
Mayuri Nehate
84270bcac8
feat(ingest/nifi): kerberos authentication (#8097)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
Co-authored-by: Indy Prentice <iprentic@users.noreply.github.com>
2023-05-24 15:09:01 -07:00
Andrew Sikowitz
fdbc4de695
refactor(ingest): Call source_helpers via new WorkUnitProcessors in base Source (#8101) 2023-05-24 13:36:19 -07:00
Amanda Hernando
0e0d8934ea
feat(ingest): Add GenericAspectTransformer (#7994)
Co-authored-by: Adrián Pertíñez <khurzak92@gmail.com>
2023-05-24 13:31:33 -07:00
Indy Prentice
c075c5e2df
fix(search): Transform _entityType/index output for scroll across entities as well (#8117)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-05-24 14:43:00 -05:00
jfrancos-mai
2c4a59b302
fix(ui): Open mailto link in new tab (#7982) 2023-05-24 13:38:37 -04:00
Mayuri Nehate
b3d80e57e8
feat(ingest/bigquery): usage for views (#8046)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-05-24 09:48:58 -07:00
Indy Prentice
1f67463778
fix(search): Update _entityType transform logic to work for entities containing _ (#8112)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-05-24 10:47:19 -05:00
Joshua Eilers
e60b827a50
fix logic for multiple entities found and clean up messy code (#8113) 2023-05-24 08:03:50 -07:00
Mayuri Nehate
798ce3d6c8
feat(classification): configurable sample size (#8096)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-24 00:07:01 -07:00
Andrew Sikowitz
8357fc8d64
feat(ingest): Browse Path v2 helper (#8012) 2023-05-23 23:46:46 -07:00
Tamas Nemeth
287a292fe7
fix(ingest/redshift): Making Redshift source more verbose (#8109) 2023-05-24 08:19:37 +02:00
pheianox
764e0530fb
docs(readme): adds PITS Global Data Recovery Services to the adopters list (#8080) 2023-05-23 21:13:52 -07:00
Chris Collins
2fe73038d2
feat(ui) Show documentation on Domain pages first (#8110) 2023-05-23 18:14:45 -05:00
Chris Collins
366f518901
docs(): Update updating-datahub.md with breaking changes (#7964) 2023-05-23 13:13:22 -07:00
Harshal Sheth
b0f8c3de1e
refactor(ingest): simplify stateful ingestion provider interface (#8104)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-05-23 12:57:57 -07:00
Harshal Sheth
afd65e16fb
feat(cli): delete cli v2 (#8068) 2023-05-23 14:43:44 -05:00
Chris Collins
3c0d720eb6
feat(ui) Add readOnly flag that disables profile URL editing (#8067) 2023-05-23 15:29:02 -04:00
Indy Prentice
0612c70a63
fix(sample data): Update timestamps in bootstrap_mce.json to more recent (#8103)
Co-authored-by: Indy Prentice <indy@Indys-MBP.hsd1.ca.comcast.net>
2023-05-23 14:09:27 -05:00
Harshal Sheth
4873a32e4a
fix(ingest): emitter bug fixes (#8093)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-05-23 12:04:16 -07:00
jfrancos-mai
d98ebd330c
fix(ui): SchemaDescriptionField 'read-more' doesn't affect table height (#7970) 2023-05-23 13:11:21 -04:00
RyanHolstien
530b9a6540
fix(jackson): increase max serialized string length default (#8053) 2023-05-23 11:38:58 -05:00
RyanHolstien
12517958f5
fix(upgrade): removes sleep from bootstrap process (#8016) 2023-05-23 09:52:59 -05:00
Tamas Nemeth
4ca7a9b50e
fix(ingest/build): setting typing extension <4.6.0 because it breaks tests (#8108) 2023-05-23 18:55:28 +05:30
Aseem Bansal
f70cb05d3f
fix(ci): add missing updates to restli-spec (#8106) 2023-05-23 15:08:41 +05:30
Tamas Nemeth
f8be9f6aee
feat(ingest/s3): type aware directory sorting (#8089) 2023-05-23 08:59:46 +02:00
ollisala
1185c6895a
feat: datahub-upgrade.sh to support old versions (#7891)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-23 03:37:33 +00:00
Harshal Sheth
fb9a35b58a
feat(cli): support datahub ingest mcps (#7871) 2023-05-22 17:48:51 -07:00
Andrew Sikowitz
a43903bf6d
refactor(ingest): Auto report workunits (#8061) 2023-05-22 17:06:31 -07:00
Sergio Gómez Villamor
423a4cb39c
doc(auth): fixes doc in DataHubSystemAuthenticator.java (#8071)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-22 14:45:47 -05:00
Indy Prentice
d35490941f
fix(ci): Fix checkstyle violations to turn master green (#8099) 2023-05-22 12:18:06 -07:00
Harshal Sheth
4e9c652707
feat(ingest): add env to container properties (#8027) 2023-05-22 12:07:16 -07:00
Pedro Silva
dd9613027b
feat(images): Add build processes for arm64v8 image variants (#7990)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-22 17:23:47 +01:00
Jeff Merrick
55ec223bad
feat(docs): Update markprompt (#8079)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-05-19 20:12:43 -07:00
Shubham Jagtap
e6371c8e94
fix(ingestion/powerbi): skip erroneous pages of a report (#8021)
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
2023-05-19 18:02:55 -07:00
RyanHolstien
dcc2ec112b
chore(vulnerability): add exclusions for json to prevent leaking dependency (#8090) 2023-05-19 16:39:30 -05:00
Indy Prentice
da33e27784
feat(search): Add AggregateAcrossEntities endpoint (#8000) 2023-05-19 21:26:50 +00:00
Andrew Sikowitz
2ca362e96c
fix(ingest/delta-lake): Walk through directory structure with full path; reduce resource creation (#8072) 2023-05-19 12:42:48 -07:00
Joshua Eilers
d3dc2f22a5
feat(embed): embed lookup route (#8033) 2023-05-19 18:42:46 +00:00
Gabe Lyons
72bcfc53af
feat(caching): skip cache on ownership tabs (#8082) 2023-05-19 09:38:24 -07:00
Harshal Sheth
d79b28c147
feat(sdk): better auth error messages in the rest emitter (#8025) 2023-05-19 16:16:03 +02:00
Harshal Sheth
98bba52c20
test(sdk): move cli tests into the unit dir (#8028) 2023-05-19 16:13:39 +02:00
Chris Collins
33c4ab7fda
fix(ui) Fix entity name styling to show deprecation and others properly (#8084) 2023-05-19 09:54:34 -04:00
alplatonov
999b997223
fix(ingest/s3_data_lake)_ingestor_skips_directories_with_similar_prefix (#8078)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-05-19 15:32:19 +02:00
Harshal Sheth
bd5f99b6ab
docs(ingest/snowflake): fix authentication type docs (#8059) 2023-05-19 13:19:10 +02:00
Tamas Nemeth
bdd4bc7b92
feat(ingest/s3) - Stateful ingestion and last-updated support (#8022) 2023-05-19 13:10:15 +02:00
Aseem Bansal
8c87ce1f30
doc(managed datahub): update release notes for 0.2.7 (#8088) 2023-05-19 15:50:24 +05:30
Harshal Sheth
00470acc02
test(sdk): better error messages in registry codegen test (#8081) 2023-05-19 11:18:50 +02:00