Tamas Nemeth
f8be9f6aee
feat(ingest/s3): type aware directory sorting ( #8089 )
2023-05-23 08:59:46 +02:00
ollisala
1185c6895a
feat: datahub-upgrade.sh to support old versions ( #7891 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-23 03:37:33 +00:00
Harshal Sheth
fb9a35b58a
feat(cli): support datahub ingest mcps ( #7871 )
2023-05-22 17:48:51 -07:00
Andrew Sikowitz
a43903bf6d
refactor(ingest): Auto report workunits ( #8061 )
2023-05-22 17:06:31 -07:00
Sergio Gómez Villamor
423a4cb39c
doc(auth): fixes doc in DataHubSystemAuthenticator.java ( #8071 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-22 14:45:47 -05:00
Indy Prentice
d35490941f
fix(ci): Fix checkstyle violations to turn master green ( #8099 )
2023-05-22 12:18:06 -07:00
Harshal Sheth
4e9c652707
feat(ingest): add env to container properties ( #8027 )
2023-05-22 12:07:16 -07:00
Pedro Silva
dd9613027b
feat(images): Add build processes for arm64v8 image variants ( #7990 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-22 17:23:47 +01:00
Jeff Merrick
55ec223bad
feat(docs): Update markprompt ( #8079 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-05-19 20:12:43 -07:00
Shubham Jagtap
e6371c8e94
fix(ingestion/powerbi): skip erroneous pages of a report ( #8021 )
...
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
2023-05-19 18:02:55 -07:00
RyanHolstien
dcc2ec112b
chore(vulnerability): add exclusions for json to prevent leaking dependency ( #8090 )
2023-05-19 16:39:30 -05:00
Indy Prentice
da33e27784
feat(search): Add AggregateAcrossEntities endpoint ( #8000 )
2023-05-19 21:26:50 +00:00
Andrew Sikowitz
2ca362e96c
fix(ingest/delta-lake): Walk through directory structure with full path; reduce resource creation ( #8072 )
2023-05-19 12:42:48 -07:00
Joshua Eilers
d3dc2f22a5
feat(embed): embed lookup route ( #8033 )
2023-05-19 18:42:46 +00:00
Gabe Lyons
72bcfc53af
feat(caching): skip cache on ownership tabs ( #8082 )
2023-05-19 09:38:24 -07:00
Harshal Sheth
d79b28c147
feat(sdk): better auth error messages in the rest emitter ( #8025 )
2023-05-19 16:16:03 +02:00
Harshal Sheth
98bba52c20
test(sdk): move cli tests into the unit dir ( #8028 )
2023-05-19 16:13:39 +02:00
Chris Collins
33c4ab7fda
fix(ui) Fix entity name styling to show deprecation and others properly ( #8084 )
2023-05-19 09:54:34 -04:00
alplatonov
999b997223
fix(ingest/s3_data_lake)_ingestor_skips_directories_with_similar_prefix ( #8078 )
...
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-05-19 15:32:19 +02:00
Harshal Sheth
bd5f99b6ab
docs(ingest/snowflake): fix authentication type docs ( #8059 )
2023-05-19 13:19:10 +02:00
Tamas Nemeth
bdd4bc7b92
feat(ingest/s3) - Stateful ingestion and last-updated support ( #8022 )
2023-05-19 13:10:15 +02:00
Aseem Bansal
8c87ce1f30
doc(managed datahub): update release notes for 0.2.7 ( #8088 )
2023-05-19 15:50:24 +05:30
Harshal Sheth
00470acc02
test(sdk): better error messages in registry codegen test ( #8081 )
2023-05-19 11:18:50 +02:00
Harshal Sheth
1902e7d4db
ci(ingest/clickhouse): don't use kernel ephemeral ports ( #8060 )
2023-05-19 11:17:41 +02:00
Harshal Sheth
4ecb459f1e
ci: prevent qodana from using all of our cache ( #8054 )
2023-05-19 14:16:26 +05:30
Hyejin Yoon
a8b622a016
feat: add docs on column-level linage ( #8062 )
2023-05-19 07:59:30 +09:00
david-leifker
820981072f
fix(metadata-io): remove assert in favor of exceptions ( #8035 )
2023-05-18 16:46:14 -05:00
Quentin FLEURENT NAMBOT
dc4a20301f
feat(web): update AWS logos ( #8057 )
2023-05-18 12:51:53 -07:00
Harshal Sheth
48b856ccf4
fix(ingest/looker): don't prematurely show connectivity success ( #8070 )
2023-05-17 22:27:56 -07:00
Mayuri Nehate
43bb84738b
fix(ingest/tableau): don't use unsupported sql condition field ( #8065 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-05-17 22:24:53 -07:00
matwalk
f2683203ab
fix(ingest/snowflake): lowercase user urn when using email ( #7767 )
...
Co-authored-by: mathilde.oustlant <mathilde.oustlant@cdiscount.com>
2023-05-17 22:09:36 -07:00
Andrew Sikowitz
2e1c3981aa
refactor(ingest): Move source_helpers.py from datahub/utilities -> datahub/api ( #8052 )
2023-05-17 20:51:06 -07:00
mohdsiddique
ae30be9c25
fix(ingestion/tableau): ingest parent project name in container properties ( #8030 )
...
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
2023-05-17 14:19:41 -07:00
Shubham Jagtap
8cc6606e68
feat(ingestion/kafka): add description in dataset properties ( #7974 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
2023-05-17 11:03:08 -07:00
Minjin Song
1a732f3e28
fix(gitignore): update gitignore for generated files ( #7940 )
2023-05-17 10:11:11 -07:00
david-leifker
b97e7a03e8
feat(system-update): remove datahub-update requirement on schema reg ( #7999 )
2023-05-17 10:32:23 -05:00
Shirshanka Das
151eab3628
fix(build): fix lint issue ( #8066 )
2023-05-17 08:17:52 -07:00
Shirshanka Das
b3c790aab6
feat: Add support for Data Products ( #8039 )
...
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2023-05-17 07:17:25 +00:00
Mayuri Nehate
20927e84c9
refractor(classification): simplify classification handler ( #8056 )
2023-05-16 23:27:02 -07:00
Andrew Sikowitz
7ba2d13087
refactor(ingest): Make get_workunits() return MetadataWorkUnits ( #8051 )
...
- Deprecates UsageAggregationClass, /usageStats?action=batchIngest, UsageStatsWorkUnit
- Removes parsing of UsageAggregationClass in file source, all sinks, and WorkUnitRecordExtractor
2023-05-17 00:01:57 -04:00
Hyejin Yoon
25450ac82c
feat(docs): add guide on integration ML system via SDKs ( #8029 )
...
Co-authored-by: socar-dini <dini@socar.kr>
2023-05-17 10:21:39 +09:00
Mayuri Nehate
a06c5aee2c
fix(ingest/bigquery): update usage audit log query to include create/drop operations ( #7995 )
2023-05-16 11:58:20 -07:00
Harshal Sheth
e70d0b3859
fix(ingest/dbt): fix dbt subtypes for sources ( #8048 )
2023-05-16 11:11:26 -07:00
Joshua Eilers
91caa0c2b9
fix(search): only show explore all btn on search and home ( #8047 )
2023-05-15 18:59:16 +00:00
xiphl
d619cc6b3f
feat(ingest): Allow csv-enricher to update more types ( #7932 )
...
Co-authored-by: xiphl <xiphlerl9@gmail.com>
2023-05-15 10:38:19 -07:00
Joshua Eilers
1cb425e9a7
fix(search): enter key with no query should search all ( #8036 )
2023-05-15 16:57:40 +00:00
Chris Collins
620df8b7d2
fix(es) Fix browseV2 index mappings ( #8034 )
2023-05-15 12:27:06 -04:00
Shubham Jagtap
7483d9a4de
fix(ingestion/metabase): metabase connector bigquery lineage fix ( #8042 )
...
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
2023-05-15 14:30:20 +02:00
Aditya Radhakrishnan
0fa983adc7
fix(ui): posts - fix formatting for posts where the title can get cut off ( #8001 )
2023-05-13 20:58:35 -07:00
david-leifker
ada78cb617
fix(platform): fix NPE in change event processing ( #8038 )
2023-05-13 20:57:06 -07:00
