Pere Miquel Brull
43be01b92e
Fix #4091 & #3948 - Create services correctly ( #4101 )
2022-04-13 18:04:52 +02:00
Ayush Shah
1f3667b46f
Fix Python test ( #4095 )
2022-04-13 21:03:33 +05:30
Pere Miquel Brull
6a6507e754
Fix #3962 - Profiler uses DatabaseSchema & Sample Data fix ( #4056 )
2022-04-12 13:40:59 +05:30
Sriharsha Chintalapani
2e870669e3
Fix #4042 : Ingestion: Sample data ingestion is failing
2022-04-11 16:12:01 -07:00
Pere Miquel Brull
2732906059
Fix #4021 - Pipeline status sample data ( #4023 )
...
* Update connection arguments
* Pipeline status sample data
2022-04-11 16:57:06 +05:30
Sriharsha Chintalapani
4a572713a7
Fix #3865 : Service Connection & Schema Name - Fix ES indexes
2022-04-10 09:47:36 -07:00
Mayur Singal
7292695bd3
Sample Data Fix ( #3888 )
...
* Sample Data Fix
2022-04-06 18:26:54 +05:30
codingwithabhi
dbfe488a9e
Schema support fix ( #3856 )
...
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-04-05 10:51:42 -07:00
Sriharsha Chintalapani
7b3e459eb3
Fix #3659 Refactor Service Connection String to be specific to per service ( #3804 )
...
* Fix #3659 Refactor Service Connection String to be specific to per service
* Simplify and centralize Airflow Pipeline info for REST (#3740 )
* Remove code
* Modified Configs based on refactoring schema (#3816 )
* Clean WorkflowContext
Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-04-04 12:46:09 -07:00
Sriharsha Chintalapani
b14c8dc2c4
Issue-3685: Variable based separator used for fullyQualifiedName instead of hardcoded . for Python and make the separator to : ( #3778 )
...
* Issue-3685: Variable based separator used for fullyQualifiedName instead of hardcoded . for Python and make the sepearator to :
* Fix failing test
* Use colon for run_local_docker validation
* Update tests FQDN
* Update tests FQDN
Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
2022-03-31 19:20:27 +05:30
Ayush Shah
a87ed206c0
Fix Redshift Usage ( #3624 )
2022-03-23 22:07:25 -07:00
Pere Miquel Brull
94d7500216
Fix #3248 & #3251 - Update metrics and column profile ( #3262 )
...
Fix #3248 & #3251 - Update metrics and column profile (#3262 )
2022-03-08 11:44:39 +01:00
Teddy
6ee31eb21f
Issue-2538: Add Iceberg type for Glue Table + Location Entity ( #3210 )
2022-03-07 08:27:14 -08:00
Pere Miquel Brull
bd7b91b448
Fix #3112 - col profile safety & sample data ( #3142 )
...
Fix #3112 - col profile safety & sample data (#3142 )
2022-03-04 13:14:11 +01:00
Pere Miquel Brull
71207de362
Fix #2875 - Profiler API Sink ( #3011 )
...
Fix #2875 - Profiler API Sink
2022-03-02 16:46:28 +01:00
Pere Miquel Brull
4d928bab80
Fix #2965 - Additional Properties set to False ( #2976 )
2022-02-24 08:38:56 -08:00
Ayush Shah
d2c64007cb
Table Constraints Added - Ingestion ( #2854 )
2022-02-19 09:16:15 -08:00
Suresh Srinivas
28ba1a3c04
Fixes #2760 - Add entities for Glossary and initial API ( #2761 )
...
* Fixes #2760 - Add entities for Glossary and initial API
* Fixing merge issues
2022-02-15 20:54:46 -08:00
Mayur Singal
44cca4d020
fix #2663 : added table queries in sample data ( #2763 )
2022-02-15 15:45:58 +05:30
Ayush Shah
7013b070d2
Minor Data Type Display modification ( #2654 )
...
Characters modified from unicode for e.g. < to <
2022-02-07 18:07:08 +05:30
Sriharsha Chintalapani
10e71a7e09
Fix #2340 : Ingestion pipeline deployment refactor ( #2341 )
...
* Fix #2340 : Ingestion pipeline deployment refactor
2022-01-21 22:06:14 -08:00
Matt
2a80caa8fe
Add logic to initialize relationships from seed data during application startup ( #2307 )
...
* Add logic to initialize relationships from seed data during application startup
* Remove ingestion related code for access control policies
* Move PolicyEvaluator init to PolicyResource
2022-01-20 22:18:03 -08:00
Sriharsha Chintalapani
0d3ded0742
Data Profiler Integration ( #2235 )
...
* Fix 2234: Data profiler integration
2022-01-18 20:25:43 -08:00
Matt
276128e8b0
Add MetadataOperations RBAC support for PATCH APIs ( #2128 )
...
* Add RBAC for PATCH APIs
* Expand scope to all resources except a few (Policy, User, Role, Team, resources that doesn't support PATCH)
* Fix code smells
2022-01-16 09:24:26 -08:00
Matt
f323afe0cd
Support role ingestion from sample data ( #2167 )
2022-01-11 16:51:18 -08:00
Ayush Shah
6175053dd4
Sample Topics fixed ( #2005 )
2022-01-03 11:00:04 -08:00
Matt
ab4c9ede25
Add ingestion for access_control_policies to support RBAC ( #1969 )
2021-12-30 08:25:09 -08:00
Sriharsha Chintalapani
485fdea7b1
Fix #1854 : Support DBT 1.0 format ( #1855 )
...
* Fix #1854 : Support DBT 1.0 format
2021-12-20 12:25:26 -08:00
Ayush Shah
7263510124
Query Log fixed ( #1615 )
...
* Query Log fixed
* Wrong ColumnName fixed
* Added Service Name in usage configs
2021-12-08 07:36:45 -08:00
Alberto Miorin
f9436c65f0
Fix #1306 : Evolve Location entity integration ( #1442 )
2021-12-03 02:13:13 +01:00
Ayush Shah
0e205d93dd
Added DBT to airflow, modified tables.json - added profile data, fixed user's displayName ( #1501 )
...
* User's Name fixed, added profile data, added dbt pipeline under airflow
* service name changed
2021-12-01 08:32:29 -08:00
Ayush Shah
47a97e7be0
FQN changed from bigquery to bigquery_gcp
2021-11-29 16:57:39 +05:30
pmbrull
98066bf986
Rename FQN for bigquery
2021-11-28 16:09:32 +01:00
Sriharsha Chintalapani
f3054658f5
Fix #968 : Add DBT Connector ( #1200 )
2021-11-16 01:02:45 -08:00
Ayush Shah
fa3c9b1758
Reduced the sample-users to 100 ( #1156 )
2021-11-11 07:31:03 -08:00
Sriharsha Chintalapani
9b7d3e313f
Fix #1004 : Update Pipeline Ingestion and Indexing to accommodate new API changes ( #1005 )
2021-11-01 07:22:01 -07:00
Pere Miquel Brull
710675d51a
OpenMetadata High Level API ( #942 )
...
* update arg name for fqdn
* fix suite setup and teardown
* Update list logic
* Add Chart tests
* Add Dashboard tests
* Add pipeline tests
* Add table tests
* Simplify create API
* Formatting tests
* Update create API
* Add Tasks and Topics tests
* Rename OpenMetadata
* Add client close
* Use Optional for GET id and name
* Fix #931 fetching dashboards using client
* Add tests
* Fix sample users ingestion
* Remove lineage test
* Rename services for independence
2021-10-26 14:18:43 -07:00
Ayush Shah
759574a8de
Ingestion Optimization - Sample Users, Dockerfiles, Removal of Pandas ( #935 )
...
* Sample Profile Data for Sample Tables (#815 )
* Sample Profile Data for Sample Tables
* Disabling Profile as Default
* Added Sample Profile Data to 3 additional sample tables
* Sample Tables fixed (#850 )
* Pydantic fix, Docker update (#860 )
* Setup.py Modified with openmetadata-airflow package, docker update
* Setup.py Modified
* Update setup.py
* Removed Pandas from Sample Data
* Sample Users added under sample data
* Sample User Standalone pipelines and modules removed
* Docker release package updated
* Dockerfile updated, removed redundant files
* Setup.py removed from ingestion src directory
* User Resource failing check resolved
* Modifying Usage Columns Datatype
2021-10-26 09:14:24 -07:00
Ayush Shah
9cf3a4045f
Sample Profile Data for Sample Tables ( #815 )
...
* Sample Profile Data for Sample Tables
* Disabling Profile as Default
* Added Sample Profile Data to 3 additional sample tables
2021-10-17 17:24:39 -07:00
Pere Miquel Brull
3bf5999224
[Issue-759] - Model Entity Sample ( #797 )
...
* Fix typo
* Prepare sample data for Model Entity
* Clean print
* Prepare sample model data ingestion
* Allow fstring in logging for style unification
* Update sink status signature
* Update sink status signature
* Return Model in REST
* Update workflow status info for readability
2021-10-16 09:59:32 -07:00
Sriharsha Chintalapani
c28665bca7
Sample lineage ( #735 )
...
* Fix #727 : Add sample lineage data and ingestion support
2021-10-11 20:12:40 -07:00
James
d455409cc9
issue-696: Added trino support for Openmetadata ( #697 )
...
* issue-696: Added trino support for Openmetadata
* issue-696: fixed linting issues
* issue-696: not mentioning Trino for now as it will be part of 0.5 release
Co-authored-by: jbuoncri <jbuoncri@cisco.com>
2021-10-07 11:15:34 -07:00
Sriharsha Chintalapani
37796c655b
Fix #650 : Add support for pipelines in sample data & search integration ( #651 )
2021-10-04 17:48:45 +05:30
Sriharsha Chintalapani
ebfbd39cc2
Fix #624 : Ingestion: Fix REST API calls to get service and create service ( #625 )
...
* Fix metadata usage listing of tables
* Fix #624 : Ingestion: Fix REST API calls to get service and create service
2021-09-30 20:35:35 +05:30
Sriharsha Chintalapani
0983ec7f1f
Add nested types to sample data ( #601 )
...
* Add nested types to sample data
* Add nested types to sample data
2021-09-28 12:23:34 +05:30
Sriharsha Chintalapani
3d10347aec
Fix #596 : Update ingestion to new OpenMetadata column entity changes ( #597 )
2021-09-27 23:11:19 +05:30
Sriharsha Chintalapani
eb2717b0e3
Fix #587 : Ingestion: Add standalone report process to generate datasets, usage & profile and serve from standalone server ( #588 )
...
* Fix #587 : Ingestion: Add standalone report process to generate datasets, usage & profile and serve from standalone server
* add localhost
2021-09-27 08:43:38 -07:00
Ayush Shah
bdad904e82
Sample Data ingestion fix ( #437 )
2021-09-08 16:52:54 +05:30
Ayush Shah
2b61c8ea8c
fix Issue-404 replicationFactor and Message Maximum Byte added ( #419 )
...
* fix Issue-404 replicationFactor and Message Maximum Byte added
* Cleanup Policy values changed in sample topic data
2021-09-07 12:22:51 -07:00
Sriharsha Chintalapani
d0dbcc19b7
Fix #401 : Merge sample data generation into single connector ( #402 )
...
* Fix #401 : Merge sample data generation into single connector
* Path for datasets modified
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2021-09-05 22:35:02 +05:30
