79 Commits

Author SHA1 Message Date
Nahuel
ed58c27f76
Remove unused property extra_hosts from docker-compose files (#7096)
* Remove unused properties from docker-compose files

* Minor fix in run_local_docker script
2022-08-31 21:30:24 +02:00
Teddy
afd12cff04
added testResultValue to testCaseResult (#6881) 2022-08-23 18:32:15 +02:00
Sriharsha Chintalapani
821d70eae4
Fix #6782: Separate TableProfile and ColumnProfile api calls (#6783)
* Fix #6571: Add EntityLink for the testCase to ID columns

* Fix #6571: Add EntityLink for the testCase to ID columns

* Fix #6782: Separate TableProfile and ColumnProfile api calls

* Fix #6782: Separate TableProfile and ColumnProfile api calls - fix tests

* Fix #6782: Separate TableProfile and ColumnProfile api calls - fix tests

* Fix setFields

* Fix tests

* Update pipeline status endpoint

* updated ui side as per new schema for profiler tab

* updated profiler details with new API

* Fix Profiler tests and validation errors (#6827)

* add profilerSample field in TableProfile

* add profilerSample field in TableProfile

* get columnProfile with field profile

* get columnProfile with field profile

* Fixed sample data and python tests

* fixed date range filter change issue

* handled empty profiler case

* Added column level test case and results

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-08-22 21:31:24 +05:30
Shailesh Parmar
455c2d039e
(Feat) UI: Add Profiler Tab as per new mock (#6627)
* add initial setup and added profiler tab

* added unit test for tableprofiler component

* added more coverage for table profiler component

* added get and put request and functionality for profiler setting

* added unit test for new components

* miner fix

* added data-testid for profiler settings component

* changed input box to slider for profile sample

* updated setting model design

* replaced select with treeSelect

* added unit test for setting modal

* fixing flaky cypress related to resizeObserver loop limit

* fixed failed unit test and added selected sample profiler text

* addressing comments
2022-08-10 14:46:50 +05:30
Teddy
b37bca5471
Fixes #2954 -- Ingest sample data for profile, test suite and co. (#6586)
Fixes #2954 -- Ingest sample data for profile, test suite and co. (#6586)
2022-08-04 19:44:21 +02:00
Sriharsha Chintalapani
1a42428e42
Add time series extention (#6416)
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-08-04 07:22:47 -07:00
Milan Bariya
45e6c2c7d7
Sample Data Ingestion use Create request (#6546)
* Sample Data Ingestion use Create request

* Fix: Code smell

* Fix: make_pyformat

* Fix: Changed based on comments
2022-08-04 11:13:48 +02:00
Mayur Singal
bafca3b7b6
Fix #6387: Clean Ingestion (#6405)
* Fix #6387: Clean Ingestion

* postgres fix

* Fixed Location in Sample Data
2022-07-29 08:51:58 +02:00
Shailesh Parmar
04db051197
Revert "Pipeline lineage edge UI (#5891)" (#6159)
This reverts commit 4d898a120fd4410a8ed660db252bc270710e9323.
2022-07-19 18:07:46 +05:30
Onkar Ravgan
4d898a120f
Pipeline lineage edge UI (#5891)
Pipeline lineage edge UI (#5891)
2022-07-17 18:25:37 +02:00
Pere Miquel Brull
9ca7a75e2d
Add col lineage in sample usage (#5790) 2022-06-30 12:16:06 +02:00
Milan Bariya
338d1efe40
FIX 5419: Glue pipeline connector not working (#5467)
FIX 5419: Glue pipeline connector not working (#5467)
2022-06-27 11:38:41 +02:00
Pere Miquel Brull
0ecc9f0da6
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494)
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494)
2022-06-21 18:02:50 +02:00
Pere Miquel Brull
a14de6eee1
Fix #5367 - MlFlow connector & MLServices (#5446)
Fix #5367 - MlFlow connector & MLServices (#5446)
2022-06-21 14:54:36 +02:00
Pere Miquel Brull
8e9d0a73f6
Fix #3573 - Sample Data refactor & ORM converter improvements (#5265)
Fix #3573 - Sample Data refactor & ORM converter improvements (#5265)
2022-06-08 16:10:40 +02:00
Mayur Singal
f9bb54ed91
Fix #5162: Sample usage fixed (#5163)
* Fix #5162: Sample usage fixed

* Test Fix
2022-05-26 15:15:41 +02:00
Pere Miquel Brull
8e121fb306
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector (#5125)
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector (#5125)
2022-05-25 08:35:16 +02:00
Pere Miquel Brull
9effaa8037
Update mlmodel sample data (#5060) 2022-05-20 08:45:26 +02:00
Mayur Singal
f61ab495ff
Added sample query log file (#4996) 2022-05-17 18:01:00 +05:30
Pere Miquel Brull
52dac4ab37
Fix #4905 - Glue db and filters (#4907)
Fix #4905 - Glue db and filters (#4907)
2022-05-12 15:49:03 +02:00
Sriharsha Chintalapani
34858f3b32
Topics: Add Sample data (#4787)
* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data
2022-05-09 12:50:54 +02:00
Pere Miquel Brull
5700f6d68e
Fix #4768 - Add Location path (#4770)
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2022-05-07 21:10:13 -07:00
Pere Miquel Brull
a22ff4627f
Fix #4728 - Fix Kafka test connection (#4730)
* Fix Kafka connection

* Update defaults and required values

* Update test connection

* Add filter tests

* Fix kafka tests
2022-05-06 08:59:05 +02:00
Vivek Ratnavel Subramanian
1c68748618
Fix #4542. Tables with a slash (/) in their name aren't appearing (#4717) 2022-05-04 23:30:39 -07:00
Mayur Singal
450fb2b132
SampleData Usage Fix (#4398)
* SampleData Test Connection & Usage Fix

* Fixed Pytest
2022-05-04 16:45:49 +02:00
Pere Miquel Brull
ca0b26dded
Fix #4313 - Add title to connection schemas; Fix #4335 - AWS Credentials (#4338)
Fix #4313 - Add title to connection schemas; Fix #4335 - AWS Credentials (#4338)
2022-04-22 11:25:05 +02:00
Pere Miquel Brull
256b16d877
Fix #4032 - Bigquery properties & GCS Credentials (#4202)
Fix #4032 - Bigquery properties & GCS Credentials (#4202)
2022-04-19 12:31:34 +02:00
Pere Miquel Brull
63415952e3
Fix sample data (#4200)
Fix sample data (#4200)
2022-04-18 19:00:36 +02:00
Pere Miquel Brull
2aecebd595
Fix #4189 - Fix airflow lineage callback (#4191)
Fix #4189 - Fix airflow lineage callback (#4191)
2022-04-18 15:13:26 +02:00
Pere Miquel Brull
43be01b92e
Fix #4091 & #3948 - Create services correctly (#4101) 2022-04-13 18:04:52 +02:00
Ayush Shah
1f3667b46f
Fix Python test (#4095) 2022-04-13 21:03:33 +05:30
Pere Miquel Brull
6a6507e754
Fix #3962 - Profiler uses DatabaseSchema & Sample Data fix (#4056) 2022-04-12 13:40:59 +05:30
Sriharsha Chintalapani
2e870669e3 Fix #4042: Ingestion: Sample data ingestion is failing 2022-04-11 16:12:01 -07:00
Pere Miquel Brull
2732906059
Fix #4021 - Pipeline status sample data (#4023)
* Update connection arguments

* Pipeline status sample data
2022-04-11 16:57:06 +05:30
Sriharsha Chintalapani
4a572713a7 Fix #3865: Service Connection & Schema Name - Fix ES indexes 2022-04-10 09:47:36 -07:00
Mayur Singal
7292695bd3
Sample Data Fix (#3888)
* Sample Data Fix
2022-04-06 18:26:54 +05:30
codingwithabhi
dbfe488a9e
Schema support fix (#3856)
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-04-05 10:51:42 -07:00
Sriharsha Chintalapani
7b3e459eb3
Fix #3659 Refactor Service Connection String to be specific to per service (#3804)
* Fix #3659 Refactor Service Connection String to be specific to per service

* Simplify and centralize Airflow Pipeline info for REST (#3740)

* Remove code

* Modified Configs based on refactoring schema (#3816)

* Clean WorkflowContext


Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-04-04 12:46:09 -07:00
Sriharsha Chintalapani
b14c8dc2c4
Issue-3685: Variable based separator used for fullyQualifiedName instead of hardcoded . for Python and make the separator to : (#3778)
* Issue-3685: Variable based separator used for fullyQualifiedName instead of hardcoded . for Python and make the sepearator to :

* Fix failing test

* Use colon for run_local_docker validation

* Update tests FQDN

* Update tests FQDN

Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
2022-03-31 19:20:27 +05:30
Ayush Shah
a87ed206c0
Fix Redshift Usage (#3624) 2022-03-23 22:07:25 -07:00
Pere Miquel Brull
94d7500216
Fix #3248 & #3251 - Update metrics and column profile (#3262)
Fix #3248 & #3251 - Update metrics and column profile (#3262)
2022-03-08 11:44:39 +01:00
Teddy
6ee31eb21f
Issue-2538: Add Iceberg type for Glue Table + Location Entity (#3210) 2022-03-07 08:27:14 -08:00
Pere Miquel Brull
bd7b91b448
Fix #3112 - col profile safety & sample data (#3142)
Fix #3112 - col profile safety & sample data (#3142)
2022-03-04 13:14:11 +01:00
Pere Miquel Brull
71207de362
Fix #2875 - Profiler API Sink (#3011)
Fix #2875 - Profiler API Sink
2022-03-02 16:46:28 +01:00
Pere Miquel Brull
4d928bab80
Fix #2965 - Additional Properties set to False (#2976) 2022-02-24 08:38:56 -08:00
Ayush Shah
d2c64007cb
Table Constraints Added - Ingestion (#2854) 2022-02-19 09:16:15 -08:00
Suresh Srinivas
28ba1a3c04
Fixes #2760 - Add entities for Glossary and initial API (#2761)
* Fixes #2760 - Add entities for Glossary and initial API

* Fixing merge issues
2022-02-15 20:54:46 -08:00
Mayur Singal
44cca4d020
fix #2663: added table queries in sample data (#2763) 2022-02-15 15:45:58 +05:30
Ayush Shah
7013b070d2
Minor Data Type Display modification (#2654)
Characters modified from unicode for e.g. &lt; to <
2022-02-07 18:07:08 +05:30
Sriharsha Chintalapani
10e71a7e09
Fix #2340: Ingestion pipeline deployment refactor (#2341)
* Fix #2340: Ingestion pipeline deployment refactor
2022-01-21 22:06:14 -08:00