* Fix#3659 Refactor Service Connection String to be specific to per service
* Simplify and centralize Airflow Pipeline info for REST (#3740)
* Remove code
* Modified Configs based on refactoring schema (#3816)
* Clean WorkflowContext
Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
* Use common entityName and fullyQualifiedEntityName type definition with DOT allowed
* Make EntityInterface abstract class and move building entity reference to the base class
* Entity separator is not longer hardcoded but uses a variable
* Minor Fixes - UTC timezone for usage, tag method modification, looker fix
* Modified core version
* Snowflake Usage Result limit and Makefile ignore env fix
* prepare snapshot version for 0.9.1
* prepare dev version for ingestion 0.9.1
* prepare dev version for ingestion-core 0.9.1
* prepare Docker CI workflows for 0.9.1
* Power BI Dashboard and Tiles added
* Added Powerbi dependency
* Modified Powerbi debug logs
* Bump up _version.py
* Modified Power BI - added failure status, resolved comments
* Support swapping default roles
Pseudocode:
```
A. patchRole(role1, default=True):
B. set role1.default = True
for all users:
add role1 to user.roles
C. for role in roles if role != role1:
set role.default = False
for all users:
delete role from user.roles
```
This ensures that changeDescription for the role(s) and user(s) are updated accordingly.
Potential optimization:
Adding role1 and removing role from user.roles could be considered/implemented as one change.
However, increases code complexity.
* Set DataConsumer as default role
* Fix tests
* Fix code smell
* Fix list typing
* Add sqlite service
* Add sqlite service
* Add sqlite service
* Refactor validation into class
* Refactor validation into class
* Prepare table simple profiler
* Add note
* test ORM conversion
* Prepare workflow config utilities
* Prepare workflow skeleton
* Use new core Validation
* Refactor workflow config parsing
* Add comment
* Simplify workflow validations
* Fix table metric check
* Add init for convenience, otherwise interpreter cries when trying to __call__ the get result
* Fix table metric check
* Format
* Format
* Fix table list and metrics init
* Prepare profiler workflow integration tests
* Bump version
* Fix pycharm imports
* format
* Fix#2811: Log level option for running metadata
* Fix#2819: Kafka connector security settings along with all configs to be retrieved
* Fix#2819: Kafka connector security settings along with all configs to be retrieved
Add getter and setter for `name` into EntityInterface
Refactor code in utility method.
Rename the escape method.
Fix webhook.
Fix pipeline tests
Fix airflowPipeline tests
Fix role, team, and user tests
Replace . with _DOT_ to keep compatibility with the past and avoid a migration.
Remove the Python code that was replacing the . with _DOT_.
Restore "no dots" for services and implement the JSON Schema rule.
** Entites escaping dots
1. AirflowPipeline
2. Chart
3. Dashboard
4. Database
5. Location
6. Metrics
7. MlModel
8. Pipeline
9. Table
10. Topic
** Entities rejecting dots
1. Database Service
2. Dashboard Service
3. Messaging Service
4. Pipeline Service
5. Storage Service
** Entities accepting dots
1. Bots
2. Policy
3. Report
4. Role
5. Team
6. User
7. Webhook
** Fields escaping dots
1. Column
2. Task
Add escape for Column and TableConstraints
Add escape to Task
Remove the Python code. It will be added in a follow-up PR.
Fix Pipeline entity tests
* Add pipeline & task status
* Bump core version
* Simplify validateColumn
* Add apiResponse
* Use enum and timestamp
* Simplify validate and use timestamp for executionDate
* mvn format