* Snowflake, Bigquery & Azuresql docs with superset migrations
* Superset Docs
* Auto PII is not a part of ingestion
* bigquery docs
* Azure SQL Docs
* Snowflake Docs
* Superset Docs
* Url to URL
* replace hr with ---
* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.
* added the ordinalPosition data point into the Column constructor.
* renamed variable to better describe its usage.
* updated profile errors.
Hive connections now comment columns by default.
* removed print statements
* Cleaned up code by pulling check into its own function
* Updated median function to return null when it is being used for first and third quartiles.
* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.
* added the ordinalPosition data point into the Column constructor.
* renamed variable to better describe its usage.
* updated profile errors.
Hive connections now comment columns by default.
* removed print statements
* Cleaned up code by pulling check into its own function
* Updated median function to return null when it is being used for first and third quartiles.
* removed print statements and ran make py_format
* updated to fix some pylint errors.
imported Dialects to remove string compare to "impala" engine
* moved huge comment into function docstring.
This comment shows us the sql to get quartiles in Impala
* added cast to decimal for column when running average in mean.py
* fixed lint error
* fixed ui ordering of precision and scale.
Precision should be ordred in front of scale since the precision is set first in decimal data types
* first pass for impala connector
* updated default auth_mechanism to be one of the enum values.
* updated UI documentation to match fields for the impalaconneciton.
refined impalaConnection to bring use_ssl to a boolean instead or relying on an extra connection option being manually added.
Removed reference to hive for type mapping
added impala to the pip setup
* py_format updates
* removed print statement
* Lints and fixes
* Updated database documentation to follow new style
* Flag as BETA
* Remove tests
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Deprecate location and old storage service
* Format
* Fix test
* Refactor
* Clean location
* Rename object store to storage
* Rename object store to storage
* Rename object store to storage
* Format
* Format
* Refactor object store for storage
* Refactor object store for storage
* Rename object store to storage
* Fix test
* Fix test
* Format
* chore(ui): change Objectstore to Storage
* Fixes
* Fix test
* Remove storage service from Glue cypress
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Organise calls
* Prepare skeleton
* Add looker model handling
* Parse files as sql
* Handle labels
* Linting
* Format
* Fix version
* Also check the API for explore lineage
* Supported DataModel in Dashboard Page
* url fqn changes
* Support Activity tab for DataModel Entity
* Remove dataModel resource descriptor
* Fix tasks for dashboard data models
* changes as per comments
* minor fix
* changes as per comments and minor improvements
---------
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
* Add ingestionIpInfoEnabled configuration
* Format
* hide ip address if api response if not 200
* removing dependancy on ip-modal and checking default state
* updated status code for ip to 204 to check default state
* fixed failing cypress
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
* Restructured Reindexing + Added Automated Reindexing on Glossary import
* Revert Openmetadata yaml
* Fix pending issues
* Fix stats
* Refactor to workflows and SearchIndex
* Fix Failing tests
* Get status for stream and push status with
* fix UI build failing
* replace all with entity list before hit api
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Use @Tag annotation to group APIs in the swagger documentation.
* Hide internal APIs
* Change API path events/subscription to events/subscriptions
* Change API path from automations/workflow to automations/workflows
* Change API path v1/testCase to v1/testCases
* Change API path v1/testDefinition to v1/testDefinitions
* Change API path v1/testSuite to v1/testSuites
* Rename Kpi and kpi in the documentation to KPI
* Change API path v1/testConnectionDefinition to v1/testConnectionDefinitions
* Update API section in the API documentation
* Fix test failures
* Correctly capitalize Test Cases and Test Suites in API docs
* chore(ui): add support for service documentation md file
* sync local
* chore: add method for fetching markdown file
* chore(ui): add support for service documentation
* chore: move fields to connections
* chore: update logic to fetch requirements
* chore: right panel component for service
* fix: key prop is not present in the skeleton component
* chore: only fetch md files when required fields are present
* chore: use hook for fetching airflow status
* chore: refactor add service component
* chore: remove id prefix and id separator prop from form builder
* fix: fieldName issue on right panel
* fix: active Field name issue
* fix:unit test
* test: add unit test
* chore: handle edit service form
* chore: add fallback logic
* fix: cy test
* chore: update service doc md files/folder structure,
* chore: push image example
* Athena docs
* Add glue docs
* Add hive related changes
* chore: take last field for fetching field doc
* add datalake
* Added connection information for oracle and redshift (english + french)
* fix: fallback logic
* Bigquery & Snowflake Requirements
* mysql and amundsen requirements (#10752)
* Revert removal of descriptions
* Add Doc For Mssql and Postgres
* Added powerbi conn md files
* Align requirements files
* Add Kafka and Redpanda
* refined powerbi docs
* Add Tableu requirements, move Athena and Glue fields, change footer some connectors
* Add missing connectors fields descriptions default
* re: datalake
* Add Tableau field descriptions
* fix: markdown styling
* chore: improve button styling
* chore: rename right panel to service right panel and move it to common
* fix: doc for select and list field , cy test.
* fix: unit test
* fix: test connection service type issue
* Added powerbi docs link in req
* Add info on hive
* Remove unused markdowns
* Add req for datalake
* add hive requirements header
* Snowflake & Biguqery
* Update Mssql and Postgres
* mysql and amundsen requirements updated
* Update Mssql and Postgres
* added username
* chore: fix cy expression issue
* chore: reset active field state on step change.
* fix: affix target container issue
* fix: unit test
* fix: cypress for postgres and glue
---------
Co-authored-by: Milan Bariya <52292922+MilanBariya@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: NiharDoshi99 <51595473+NiharDoshi99@users.noreply.github.com>
Co-authored-by: Milan Bariya <milanbariya12@gmail.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
Co-authored-by: Nihar Doshi <nihardoshi16@gmail.com>
* Added mark delete logic
* Final test and optimization
* After merge fixes
* Added include tags for dash pipelines dbt
* added docs and fixed test
* Fixed py tests
* Added UI changes for following newly added fields:
- markDeletedDashboards
- markDeletedMlModels
- markDeletedPipelines
- markDeletedTopics
- includeTags
* Fixed failing unit tests
* updated json files of localization for other languages
* Improved localization changes
* added localization changes for other languages
* Updated mark deleted desc
* updated the ingestion fields descriptions in the ingestion form for UI
* automated localization changes for other languages
* updated descriptions for includeTags field for dbtPipeline and databaseServiceMetadataPipeline json
* fixed issue where includeTags field was being sent in the dbtConfigSource
* Added flow to input taxonomy while adding BigQuery service.
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* Handle test connection for S3 and new status
* Remove exception
* Update endpoint
* Update endpoint
* Update endpoint
* chore: remove toast messages for test connection
* chore: change objectstoreService to objectStoreService
* minor fix
* Use the default service param for listing filters
* Format
* Format
* address comments
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* improvement in pii tagging
* fix conflict and changes as per comment
* Added confidence field
* changes as per comments
* Apply suggestions from code review
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
