Hyejin Yoon
f986315582
doc: Acryl to DataHub, datahubproject.io to datahub.com ( #13252 )
...
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2025-04-28 10:34:33 -04:00
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier ( #13220 )
2025-04-16 16:55:51 -07:00
Tamas Nemeth
f4fb89e799
feat(ingest/spark): Promote beta plugin ( #10881 )
...
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-25 14:46:32 +02:00
Hyejin Yoon
1ad4f961aa
feat: add ingestion overview pages ( #9210 )
2023-11-20 18:02:49 +09:00
Harshal Sheth
791e2e7bf5
feat(python): support custom models without forking ( #8774 )
2023-09-22 16:43:58 -07:00
Aseem Bansal
2b0952195b
doc(ingest/log): failure log at pipeline level document ( #8591 )
2023-08-09 10:18:14 +05:30
Pedro Silva
a4a8182001
feat(cli): Adds ability to upload recipes to DataHub's UI ( #8317 )
...
Co-authored-by: Indy Prentice <iprentic@users.noreply.github.com>
2023-08-01 17:35:42 -03:00
Hyejin Yoon
2bc0a781a6
fix: refactor toc ( #7862 )
2023-04-21 18:36:10 -07:00
Paul Logan
cebc583345
docs(): re-add sources summary page ( #7563 )
...
Co-authored-by: Jeff Merrick <jeff@wireform.io>
2023-03-13 11:37:24 -07:00
Harshal Sheth
2c3e3c203f
docs(ingest): add details about backwards compatibility guarantees ( #7439 )
2023-02-28 13:33:58 -08:00
Chris Collins
9978b74cef
fix(docs): Fix broken links in ingestion docs ( #7183 )
2023-01-30 16:19:31 -08:00
Harshal Sheth
3080b9e3ee
fix(ingest): only log vars if requested ( #6362 )
2022-11-03 20:16:07 -07:00
mohdsiddique
2f65e2f226
feat(transformers): Add semantics & transform_aspect support in transformers ( #5514 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-06 14:44:14 -07:00
Ravindra Lanka
228f3b50ea
feat(ingestion): send reports of ingestion runs to datahub ( #5639 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-19 09:08:17 -07:00
Aseem Bansal
d518b5a085
fix(cli): correct handling of env variables ( #5203 )
2022-06-20 20:53:47 +05:30
Tamas Nemeth
039e98e8cf
feat(docs): Updating example files with the new ingestion recipe suffix ( #5103 )
2022-06-07 15:52:26 -07:00
Shirshanka Das
a9ad138172
feat(ingest): docs - overhaul source connector docs to make it code driven ( #4798 )
...
Co-authored-by: MugdhaHardikar-GSLab <mugdha.hardikar@gslab.com>
2022-05-02 00:18:15 -07:00
Shirshanka Das
a55073036d
fix(cli): align default sink env variables across all cli commands ( #4739 )
2022-04-25 10:19:17 -07:00
Shirshanka Das
a518e3d13e
feat(cli): improve error reporting, make sink config optional ( #4718 )
2022-04-24 17:12:21 -07:00
Atul Saurav
e8e0067f23
fix(cli):Supress printing variables to logs during ingestion failure ( #4566 )
...
Currently when ingestion while running pipeline, stackprinter prints all vars to logs.
This may contain sensitive information. To prevent this from happening, a optional `safe`
flag is added to cli. If this flag is set while running ingestion, no variables are logged in
case of unexpected failures.
2022-04-15 10:30:48 -07:00
Maggie Hays
2534221d5d
remove source summary table ( #4670 )
2022-04-14 16:28:05 -05:00
Dexter Lee
57ea768e7f
fix(docs): fix logo links on ingestion docs ( #4564 )
2022-04-01 22:02:24 -07:00
Maggie Hays
0be0689093
docs: Ingestion Source Docs Template ( #4275 )
...
* testing img.shield for status
* update to hyperlink
* changing link format
* adding status options
* updating prerequisities and quickstart
* update to ingestion docs
* updating template with collapse details
* adding linebreak between pip install commands
* Removed incomplete sentence
* typo fix
* pushing current changes
* testing logos in markdown table
* markdown table fix
* markdown table fix
* adding in additional logos
* transposing markdown table
* settling on final table format
* adding commented-out source template to sidebar.js
* moving reference sidebar and adding trailing comma
* fixing docs build
2022-03-30 15:36:39 -07:00
Aseem Bansal
f36cf69360
feat(ingest): option for number of workunits in preview ( #4517 )
...
* feat(ingest): option for number of workunits in preview + documentation update
2022-03-29 07:10:22 -07:00
Aseem Bansal
6248a55edb
fix(docs): fix broken link ( #4242 )
2022-02-24 15:45:52 -08:00
Aseem Bansal
7fcc71ed81
fix(docs): make intro to metadata ingestion easier for beginners ( #4039 )
...
* fix(docs): fix sidebar titles for clarity
* re-arrange docs to make Intro to Metadata ingestion easier for beginners
* minor changes for readability
* add heading
* docs: add note for common question
2022-02-11 09:03:01 -08:00
John Joyce
2a9a076fc1
feat(ingest): Adding Tableau Source Connector [BETA] ( #4063 )
2022-02-08 14:26:44 -08:00
Nick Wu
149d2fa3d0
docs(ingest): add missing back tick for metadata-ingestion/README.md ( #4003 )
2022-01-27 22:51:48 -08:00
MugdhaHardikar-GSLab
c65609a84a
feat(datahub-client): add Java REST emitter ( #3781 )
2022-01-02 22:48:38 +05:30
Aseem Bansal
2770eb6813
docs(ingestion): Add details of sensitive info handling ( #3767 )
2021-12-19 11:37:32 -08:00
jawadqu
578590e795
feat(ingestion) : Add Metabase Source Connector ( #3602 )
...
Co-authored-by: Jawad Qureshi <jqureshi@petabloc.com>
2021-12-13 23:02:47 -08:00
Gabe Lyons
8394fc62b0
feat(mode): add mode analytics ingestion source ( #3710 )
2021-12-09 16:10:08 -08:00
mayurinehate
1d7ec8dba8
feat(ingest): add nifi source ( #3681 )
2021-12-08 14:56:31 -08:00
Aseem Bansal
b3ef5ee489
docs(scheduling): re-arrange docs related to scheduling, lineage, CLI ( #3669 )
2021-12-07 10:09:59 -08:00
Ravindra Lanka
f1045f817c
docs(ingestion): Emitter api examples + Documentation ( #3599 )
2021-11-18 23:30:25 -08:00
Tamas Nemeth
a36fefaa33
feat(ingest): Starburst Trino usage ( #3558 )
2021-11-18 09:56:24 -08:00
Ravindra Lanka
3a9ef61147
feat(ingestion): Adds --dry-run and --preview options to datahub ingest command. ( #3584 )
2021-11-17 09:24:58 -08:00
Vincenzo Lavorini
6cd31b5bdc
feat(ingest): adding openapi ingestion ( #2706 )
2021-11-09 21:22:15 -08:00
aseembansal-gogo
ebe0b3f7c1
feat(ingest): add mariadb as possible source ( #3245 )
2021-10-12 23:27:47 -07:00
Harshal Sheth
bd5e3b174a
feat(ingestion): support Airflow cluster config ( #3336 )
2021-10-06 15:01:59 -07:00
mayurinehate
d22d1c2795
feat(ingest): add trino source to datahub ( #3307 )
2021-10-06 11:57:06 -07:00
Shirshanka Das
88a3523fbb
feat(ingest): Add a business glossary source ( #3164 )
2021-09-01 15:10:12 -07:00
Dexter Lee
f63d9205e6
feat(airflow): add example docker setup for airflow ( #3176 )
2021-09-01 11:51:14 -07:00
taufiqibrahim
dd1b81b727
feat(ingest): adding redash source ( #2918 )
...
Co-authored-by: tibrahim <taufiq.ibrahim@bizzy.co.id>
2021-08-18 12:03:03 -07:00
rslanka
8844240328
feat: Adding support for nested schemas in ingestion and visualization ( #3079 )
2021-08-11 15:47:18 -07:00
Kevin Hu
f4fe4d3c65
feat(docs): add overrides for sidebar labels and S3 guide in sources dropdown ( #3068 )
2021-08-10 16:46:02 -07:00
Kevin Hu
45247083e3
docs(ingest): link to docs from recipes ( #3058 )
2021-08-09 10:00:47 -07:00
Kevin Hu
32b8fc6108
feat(docs): refactor source and sink ingestion docs ( #3031 )
2021-08-08 13:40:51 -07:00
aseembansal-gogo
ac345e0ade
feat(ingest): add underlying platform for glue ( #3035 )
2021-08-06 10:19:21 -07:00
Dexter Lee
283f6376d1
fix(ingestion): Safeguard against empty values for profile ingestion ( #3005 )
2021-08-02 10:42:40 -07:00
