* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.
* added the ordinalPosition data point into the Column constructor.
* renamed variable to better describe its usage.
* updated profile errors.
Hive connections now comment columns by default.
* removed print statements
* Cleaned up code by pulling check into its own function
* Updated median function to return null when it is being used for first and third quartiles.
* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.
* added the ordinalPosition data point into the Column constructor.
* renamed variable to better describe its usage.
* updated profile errors.
Hive connections now comment columns by default.
* removed print statements
* Cleaned up code by pulling check into its own function
* Updated median function to return null when it is being used for first and third quartiles.
* removed print statements and ran make py_format
* updated to fix some pylint errors.
imported Dialects to remove string compare to "impala" engine
* moved huge comment into function docstring.
This comment shows us the sql to get quartiles in Impala
* added cast to decimal for column when running average in mean.py
* fixed lint error
* ingestion/metadata - created client file and moved get request to client file
* moved code to client.py, created models.py
* added, self to MetabaseClient constructor
* added status_code in metabase client functions and handled Optional datatype in metabase metadata functions
* moved api calls to client
* passing service_connection and metabase_session from constructor to MetabaseClient
* renamed client to metabaseClient to avoid rewriting DashboardServiceSource.client
* moved post request from connection.py to client.py
* run make py_format
* moved client code to init constructor
* added Dashboard Model for Metabase
* updated client type to MetabaseClient and used get_dashboards_list() function in custom_executor
* updated client type to MetabaseClient and used get_dashboards_list() function in custom_executor
* make py_format
* pylint issues resolved
* pylint and run make py_format
* calling init method in Metabase source
* removed init method
* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.
* added the ordinalPosition data point into the Column constructor.
* renamed variable to better describe its usage.
* updated profile errors.
Hive connections now comment columns by default.
* removed print statements
* Cleaned up code by pulling check into its own function
* Updated median function to return null when it is being used for first and third quartiles.
* removed print statements and ran make py_format
* updated to fix some pylint errors.
imported Dialects to remove string compare to "impala" engine
* moved huge comment into function docstring.
This comment shows us the sql to get quartiles in Impala
* upgraded cypress to v12.9.0 and fixed service connection cypress
* fixing failing cypress
* updated cy setting
* fixed restore cy test
* added API wait for users spec
* fixed suspected specs
* Fix ES aligning suggests with Java
* separate the tag test for DatabaseSchema
* updated tags spec
* skip advance search
* fixed failing API's
* await on tags api
* debounce search api
* update numKeptInMemory flag to minimum
* fix unit tests and skip failed tests
* fixed failing cy test
* fixed redirection
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Test Connection Improvements: Use patch instead of put
* Update openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/WorkflowRepository.java
Co-authored-by: Nahuel <nahuel@getcollate.io>
---------
Co-authored-by: Nahuel <nahuel@getcollate.io>
* Use @Tag annotation to group APIs in the swagger documentation.
* Hide internal APIs
* Change API path events/subscription to events/subscriptions
* Change API path from automations/workflow to automations/workflows
* Change API path v1/testCase to v1/testCases
* Change API path v1/testDefinition to v1/testDefinitions
* Change API path v1/testSuite to v1/testSuites
* Rename Kpi and kpi in the documentation to KPI
* Change API path v1/testConnectionDefinition to v1/testConnectionDefinitions
* Update API section in the API documentation
* Fix test failures
* Correctly capitalize Test Cases and Test Suites in API docs
* feat: added auth logic for reportData endpoint
* feat: added permission logic for dataInsightChart and dataReport
* feat: ran mvn clean for code linting
* feat: changed endpoint name to `/reports`
* fix: renamed analytics API endpoints
* fix: eslint
* fix: updated data insight test collection path
* fix: description and changed dataInsight to dataInsights
* fix: logic for test suite config workflow
* fix: added caching for system metrics (snflk and bq)
* fix: linting
* fix: added tearDown logic for tests suite/case
* ISSUE 10343: Python SDK Glossary and GlossaryTerms
- Added methods to glossary_mixin to PATCH Glossary and GlossaryTerm
- Created in patch_mixin_utils a super class for mixins that PATCH entities
- Moved common Patch enums from patch.py to patch_mixin_utils.py
- Updated imports and super classes for mixins that PATCH entities
- Added tests for Glossary and GlossaryTerm mixins
* ISSUE #10343: Python SDK extensions for Glossary and GlossaryTerms
- Fixed an import
- Fixed two method signatures
* Issue #10343 - Fixed formatting
* fix: raise more informative error message when service is not found
* fix: profiling for struct table
* fix: linting
* fix: added tests for struct and nestedt struct for get_columns
* Added mark delete logic
* Final test and optimization
* After merge fixes
* Added include tags for dash pipelines dbt
* added docs and fixed test
* Fixed py tests
* Added UI changes for following newly added fields:
- markDeletedDashboards
- markDeletedMlModels
- markDeletedPipelines
- markDeletedTopics
- includeTags
* Fixed failing unit tests
* updated json files of localization for other languages
* Improved localization changes
* added localization changes for other languages
* Updated mark deleted desc
* updated the ingestion fields descriptions in the ingestion form for UI
* automated localization changes for other languages
* updated descriptions for includeTags field for dbtPipeline and databaseServiceMetadataPipeline json
* fixed issue where includeTags field was being sent in the dbtConfigSource
* Added flow to input taxonomy while adding BigQuery service.
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* Handle test connection for S3 and new status
* Remove exception
* Update endpoint
* Update endpoint
* Update endpoint
* chore: remove toast messages for test connection
* chore: change objectstoreService to objectStoreService
* minor fix
* Use the default service param for listing filters
* Format
* Format
* address comments
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* improvement in pii tagging
* fix conflict and changes as per comment
* Added confidence field
* changes as per comments
* Apply suggestions from code review
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
* Fix Sample data ingestion which have enum type columns
* Change based on comments
* Change based on comments
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Add a configurationto skip Snowflake transient and tmp tables
* Fix Python checkstyle
* add separate query for transient tables
* Move skipTempTables into SnowflakeConnection
* Fix merge conflict
* change skip word to include
* Add title in json file
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
