9 Commits

Author SHA1 Message Date
Keith Sirmons
97b58c65f5
Impalaconnection (#11151)
* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.

* added the ordinalPosition data point into the Column constructor.

* renamed variable to better describe its usage.

* updated profile errors.
Hive connections now comment columns by default.

* removed print statements

* Cleaned up code by pulling check into its own function

* Updated median function to return null when it is being used for first and third quartiles.

* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.

* added the ordinalPosition data point into the Column constructor.

* renamed variable to better describe its usage.

* updated profile errors.
Hive connections now comment columns by default.

* removed print statements

* Cleaned up code by pulling check into its own function

* Updated median function to return null when it is being used for first and third quartiles.

* removed print statements and ran make py_format

* updated to fix some pylint errors.
imported Dialects to remove string compare to "impala" engine

* moved huge comment into function docstring.
This comment shows us the sql to get quartiles in Impala

* added cast to decimal for column when running average in mean.py

* fixed lint error

* fixed ui ordering of precision and scale.
Precision should be ordred in front of scale since the precision is set first in decimal data types

* first pass for impala connector

* updated default auth_mechanism to be one of the enum values.

* updated UI documentation to match fields for the impalaconneciton.

refined impalaConnection to bring use_ssl to a boolean instead or relying on an extra connection option being manually added.

Removed reference to hive for type mapping

added impala to the pip setup

* py_format updates

* removed print statement

* Lints and fixes

* Updated database documentation to follow new style

* Flag as BETA

* Remove tests

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-21 09:57:13 +02:00
Onkar Ravgan
14fa96958f
Added dbt workflow docs (#9493)
* Added dbt workflow docs

* added dbt small case

* Fixed review comments
2022-12-22 13:11:18 +00:00
Ayush Shah
b3d7719289
Add Azure Datalake to the list (#9487)
* Add Azure Datalake to the list

* Put Yaml configs under the relevant sections
2022-12-22 11:15:57 +01:00
Meet Parita Munesh Shah
9c360fb61c
added docs for DOMO (#8543)
* added docs for DOMO

* Changed As Per Comment

* Change as per comment

* Changes as per comment

Co-authored-by: Meet <meet.s@deuexsolutions.com>
2022-11-09 16:44:02 +05:30
clueless-bot
68c3e0b8fe
FIX: Add postgres usage and lineage details (#8456) 2022-11-01 00:18:05 +05:30
Milan Bariya
23e4967eda
FIX: Add Databricks usage and lineage details (#8130) 2022-10-14 06:37:57 +02:00
Ayush Shah
f4240db2db
Add Missing Connectors from the list (#8120) 2022-10-12 23:20:47 +05:30
Ayush Shah
8427a0d280
Fix Bullet point (#7966) 2022-10-06 11:10:01 +05:30
Sriharsha Chintalapani
538e827f5f
Fix Menu , Connectors should've its own section after deployment (#7950)
* Fix Menu

* Fix broken links

* Fix config values

* Fix config values
2022-10-06 06:54:02 +02:00