Sriharsha Chintalapani
39ab552813
Fix SAML config indentation ( #15580 )
2024-03-18 11:58:02 -07:00
Aniket Katkar
e6b17a8f2f
fix broken links in the documentation ( #15599 )
2024-03-18 23:10:39 +05:30
Trs
4db9b775ea
#14169 : Support external_account type for GCP Auth ( #14166 )
2024-03-16 19:59:02 +05:30
IceS2
51e3d7a466
FIXES 15215: First draft implementation on extracting metadata incrementally. Done for Snowflake, BigQuery and Redshift ( #15201 )
...
* Initial incremental implementation for snowflake
* Initial unit test refactor for snowflake
* Fix linter complaints
* Propagate change on abstract create method
* Add missing argument to create
* Polish Snowflake incremental extraction
* Fix linters and make enabled required
* Initial proposal for incremental bigquery extraction
* BigQuery incremental tests
* Remove debugging override
* Fix linters
* Remove unused query
* Initial Redshift Incremental Extraction
* Add Incremental Extraction documentation
* Move the default to False
* Improve code based on sonarcloud input
* Apply suggestions
* Fix wrong path
* Change timestamp to be time aware as per sonar
* Move documentation to 1.4
* Move documentation to 1.4
* Fix linters
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-03-15 14:00:49 +01:00
Mayur Singal
88ab7475e7
MINOR: Restructure dbServiceName field in dashboard and pipeline ( #15548 )
2024-03-15 12:42:47 +05:30
Aniket Katkar
957e087937
Docs: Update connectors list for v1.3.x and v1.4.x ( #15562 )
...
* add missing cards for new connectors on connectors list page
* move storage connector list to partial
* fix storage connectors list partial path
* move dashboard connectors list for v1.3 and v1.4 to partials
* move database connectors list into partials
* move messaging connectors list to partials
* move metadata connectors list to partials
* move ML Model connectors list to partials
* move pipeline connectors list to partials
* move search connectors list to partials
* remove unnecessary spaces
2024-03-14 14:16:20 +05:30
Aniket Katkar
dcbb1dd0f8
Docs: Fix the wrong image references for connector details pages ( #15559 )
...
* fix the wrong image references for connector details pages
* Add ADLS and GCS Pages
* Add adls and gcs logos
---------
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2024-03-14 11:00:31 +05:30
Aniket Katkar
f601826f74
sync the documentation roadmap page with the getcollate roadmap ( #15551 )
2024-03-13 10:13:29 -07:00
Imri Paran
09813c23dd
removed docs 1.4.x ( #15550 )
2024-03-13 10:30:11 +00:00
Mayur Singal
2a3aa90faa
MINOR: postgres add ssl options in yaml ( #15538 )
2024-03-12 19:55:04 -07:00
Ayush Shah
1c2fbdd9f4
MINOR: Add / Fix GCS and ADLS - docs, bugs ( #15502 )
...
Add GCS and ADLS docs
2024-03-12 21:13:24 +05:30
Mayur Singal
8a2ee00fe3
Fix #15432 : make sample data external storage path configurable ( #15478 )
2024-03-12 15:02:28 +05:30
mgorsk1
98850ab5cc
feat: OpenLineage integration ( #15317 )
...
* 🎉 Init OpenLineage connector
Co-authored-by: dechoma <dominik.choma@gmail.com>
* MLH - make linter happy
* review fixes
* 🐛 Fix path for ol event in tests
* 🐛 Fix path for ol event in tests
* Update ingestion/setup.py
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
* Update ingestion/src/metadata/ingestion/source/pipeline/openlineage/metadata.py
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
* Update ingestion/src/metadata/ingestion/source/pipeline/openlineage/models.py
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
* review fixes 2
* linter
* review
* review
* make linter happy
* fix test_yield_pipeline_lineage_details test
* make linter happy
* fix tests
* fix tests 2
---------
Co-authored-by: dechoma <dominik.choma@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-03-12 08:39:25 +01:00
Imri Paran
aade838020
Fixes #15388 : Use native backup tools ( #15393 )
...
* feat: use native backup tools
1. added mysqldump 8.3 to the ingestion container.
2. documented how to use native tools to back up and restore.
3. added deprecated message on the cli backup and restore.
* added deprecation notice for 1.3 backup
* removed 1.3.x deprecation notice
* added another backup page in 1.3 introducing SQL dump tools
* added --set-gtid-purged=OFF to the mysql dump process
2024-03-12 06:23:05 +01:00
Imri Paran
67c57ec4f0
docs: 1.4.x-SNAPSHOT ( #15506 )
...
* docs: 1.4.x-SNAPSHOT
added partials
added images
updated paths
2024-03-11 09:42:26 +00:00
Onkar Ravgan
1f8e232487
Added alation conn arg docs ( #15495 )
2024-03-08 18:40:04 +05:30
Akash Jain
0896be2513
fix(docs): Unify Prerequisites of Kubernetes Deployment Docs ( #15480 )
...
* fix(docs): Unify Prerequisites for kubernetes deployments
* fix(docs): specify version as `higher` instead of `greater`
2024-03-08 12:54:01 +05:30
Pere Miquel Brull
1a3ba7fb3f
MINOR - Application Handler instance ( #15482 )
...
* Clean docs
* MINOR - AppHandler instance
* MINOR - AppHandler instance
* MINOR - AppHandler instance
2024-03-07 12:24:11 +01:00
Shilpa Vernekar
49d2378eec
1.3.1 Release Doc ( #15484 )
2024-03-07 16:37:05 +05:30
Pere Miquel Brull
68e6bcf82e
MINOR - Note on airflow docs ( #15472 )
2024-03-07 08:59:26 +01:00
Teddy
ceaf205f59
Fix #15299 - Handle Table metrics & test cases for Empty Tables ( #15469 )
...
* fix: add cli support for computePassedFailedRowCount
* fix: div zero error and improve empty table message
* doc: updated test case page
* style: ran python linting
2024-03-07 07:15:22 +01:00
Teddy
70e1643bd8
doc: added threshold details ( #15458 )
2024-03-05 18:16:48 +05:30
Teddy
b9e732c5cd
DOC - Updated custom sql documentation ( #15440 )
2024-03-05 17:30:25 +05:30
Aniket Katkar
7b5f36b374
fix the wrong link on kubernetes gke page ( #15431 )
2024-03-04 10:54:49 +05:30
Dhruvin Maniar
8960c159eb
Minor: Fix and update docs with links and new release 1.3.1 ( #15422 )
...
* Minor: fixing link on devOps docs
* applying
* updating doc with new release and links
* updating upgrade doc
2024-03-01 18:56:23 +05:30
IceS2
d7ac1812d7
Fix some links on ingestion docs ( #15417 )
2024-03-01 13:37:18 +05:30
Aniket Katkar
4a54cfa7cc
update the docs content to fix broken anchors ( #15415 )
2024-03-01 08:00:28 +01:00
Aniket Katkar
6a0750eb0c
Docs: Update connectors in the documentation ( #15384 )
...
* update the connectors lists in documentation pages
* add missing connector images
2024-02-28 08:14:11 +00:00
Mayur Singal
d2879ae232
MINOR: Improve Databricks Tags Ingestion ( #15248 )
2024-02-27 16:57:11 +05:30
Pere Miquel Brull
f6ba49a7dc
MINOR - Use new components in connector docs ( #15334 )
2024-02-26 09:10:54 +01:00
IceS2
22d0b08392
MINOR: Initial proposal for the 'developing a connector' user guide ( #15335 )
...
* Initial proposal for the 'developing a connector' user guide
* Add small introduction to the next steps before the link at the end
2024-02-26 07:10:11 +01:00
Imri Paran
7f111c7ed8
MINOR: add Mongodb profiler docs ( #15240 )
...
* docs(mongodb): added profiler docs
2024-02-23 10:28:10 +01:00
Teddy
358316917f
doc: updated test cases documentation ( #15325 )
2024-02-23 08:22:23 +00:00
Pere Miquel Brull
6ec468def7
Update external docs ( #15319 )
2024-02-23 08:53:10 +01:00
Mayur Singal
9e1c50bfa6
MINOR: Fix Unity Catalog & Roadmap Dates Docs ( #15306 )
2024-02-22 12:37:19 +05:30
Akash Jain
0628d01fe4
chore(docs): Update k8s snippet of Google SSO ( #15286 )
...
* chore(docs): Update k8s snippet of Google SSO
* chore: Update code snippets for jwks config url
* chore(docs): Add a note on JWKS Url Reachability
2024-02-21 09:30:17 +01:00
Pere Miquel Brull
35efd7d333
MINOR - Ingestion docs cleanup ( #15283 )
2024-02-21 12:14:40 +05:30
Pere Miquel Brull
62c0cc7563
#13985 - Azure KV Secrets Manager ( #15192 )
...
* #13985 - Azure KV Secrets Manager
* Format
* #13985 - Azure KV Secrets Manager
* #13985 - Azure KV Secrets Manager
* Simplify credentials loading
* Simplify credentials loading
* Simplify credentials loading
2024-02-20 07:18:35 +01:00
Sriharsha Chintalapani
3a7203707f
update spline docs to support lineage ( #15257 )
...
* update spline docs to support lineage
* Update yaml.md
2024-02-20 09:05:54 +05:30
Imri Paran
7036b3cbf7
MINOR: BigTable connector docs ( #15145 )
...
* feat(connector): add BigTable
* bigtable work
1. docstrings
2. tests
3. created a Row BaseModel
4. implemented a ClassConverter
* docs moved to separate PR
* format files
* docs(bigtable): added docs
* fix after merge
2024-02-19 08:11:29 +01:00
Shin-ichi Hashiba
95ff5620a5
update java version in ldap auth docs ( #15234 )
2024-02-17 09:29:24 -08:00
Onkar Ravgan
50dd74253a
MINOR: Added external workflow missing docs for usage/lineage ( #15223 )
...
* Added ext ing workflow docs
* Added dq run ext docs
* Nit
* Nit
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-02-16 16:59:39 +01:00
Sachin Chaurasiya
fcf7f363b3
doc: update node version requirement to 18.19.0 ( #15219 )
2024-02-16 11:38:41 +00:00
Mayur Singal
e6c2c36f11
MINOR: Add databricks configuration docs for spark agent ( #15182 )
2024-02-14 21:16:34 +05:30
Mayur Singal
c8adab60a7
MINOR: Fix Databricks pipeline lineage docs ( #15178 )
2024-02-14 10:40:02 +01:00
Shilpa Vernekar
d92bfed82c
Docs: Edits to Chrome Ext & Releases ( #15168 )
2024-02-13 11:10:03 +00:00
Onkar Ravgan
ddde065197
Added alation filter pattern docs ( #15036 )
2024-02-12 21:18:24 +05:30
Shilpa Vernekar
4b8b139b2b
Links replaced ( #15154 )
2024-02-12 13:51:27 +00:00
Shilpa Vernekar
ad23c76119
Changes to 1.3 Docs ( #15152 )
2024-02-12 18:41:11 +05:30
Mayur Singal
4b9b13b555
MINOR: Fix Mongodb Migration Issue ( #15115 )
...
* MINOR: Fix Mongodb Migration Issue
* checkstyle fix
* fix docs
2024-02-11 07:44:16 -08:00
