Mayuri Nehate
5377943d8b
feat(ingest): great-expectations - attach logging handler to write logs to stdout ( #6192 )
2022-10-14 18:52:12 -07:00
Harshal Sheth
fbe4b7278a
fix(ingest): only restrict GE version for hive ( #6170 )
2022-10-14 17:17:56 -07:00
Mayuri Nehate
3fc6364979
fix(ingest): catch errors when profiling for sample values ( #6194 )
2022-10-14 17:15:56 -07:00
Harshal Sheth
43f7b568e3
build: upgrade gradle wrapper ( #6203 )
2022-10-14 17:04:11 -07:00
Harshal Sheth
1b2b2827df
fix(ingest): use corpGroup instead of corpgroup ( #6202 )
2022-10-14 17:02:30 -07:00
Harshal Sheth
d08f5f7cdd
feat(ingest): replace base85's pickle with json ( #6178 )
2022-10-14 14:48:44 -07:00
Tamas Nemeth
5a2bdea77e
docs: dataset usage and query history feature guide ( #5900 )
2022-10-14 21:43:50 +02:00
Arne Laponin
bbdc185ac2
feat(ingest): add platform instance to tableau ( #5978 )
...
Co-authored-by: Arne Laponin <arne.laponin@thoughtworks.com>
Co-authored-by: Amanda Hernando <110099762+amanda-her@users.noreply.github.com>
Co-authored-by: amanda-her <912amandahernando@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-10-13 18:44:06 -07:00
Harshal Sheth
521e61d3bf
fix(ingest): Closeable as a context manager ( #6067 )
2022-10-13 12:49:50 -07:00
Harshal Sheth
3f17408fe8
fix(ingest): report warning/error counts correctly ( #6128 )
2022-10-13 12:49:08 -07:00
Harshal Sheth
82d480dfad
feat(ingest): support self-signed certs in Tableau ( #6172 )
2022-10-13 12:48:51 -07:00
Harshal Sheth
8030ac83bc
feat(ingest/tableau): emit status aspects + streamline stateful ingestion ( #6188 )
2022-10-13 12:48:28 -07:00
Harshal Sheth
380d0e86cc
fix(ingest): add lower bound for ujson dep version ( #6189 )
2022-10-13 12:48:05 -07:00
Harshal Sheth
09616ee2b3
feat(ingest): include instance in container dataPlatform when provided ( #6083 )
2022-10-13 11:29:54 -07:00
Tamas Nemeth
0162074a37
fix(ingest) - bigquery-beta - Using table ref instead of table id ( #6193 )
2022-10-13 10:03:33 +02:00
Tamas Nemeth
6e34cd6001
feat(ingest): bigquery-beta - Parsing view ddl definition for lineage ( #6187 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-12 18:24:04 -07:00
Harshal Sheth
c7cc0af6ae
feat(ingest/tableau): support dashboard tags ( #6185 )
2022-10-12 15:34:35 -07:00
Harshal Sheth
e70c0ac4b6
feat(ingest): include raw s3 paths if s3 source ( #6168 )
2022-10-11 15:55:00 -07:00
Amanda Hernando
ffa838e00e
feat(ingestion): Tableau stateful ingestion ( #6094 )
2022-10-11 15:52:15 -07:00
Harshal Sheth
95d1e01195
feat(ingest): infer aspect name from type in get_aspect ( #6033 )
2022-10-11 13:35:41 -07:00
Harshal Sheth
0427122f5d
fix(ingest): allow hiding some fields from the schema ( #6077 )
2022-10-10 20:46:59 -07:00
Tamas Nemeth
128e3a8970
fix(ingest): bigquery-beta - turning sql parsing off in lineage extraction ( #6163 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-10 20:30:29 -07:00
Harshal Sheth
d569734193
refactor(ingest): Tableau cleanup ( #6131 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-10 15:52:34 -07:00
Harshal Sheth
879894d702
feat(ingest): airflow - support enabled flag for airflow config ( #6089 )
2022-10-11 00:42:13 +02:00
Mayuri Nehate
7b88de89d5
fix(ingest): snowflake - allow profiling to work with geography type ( #6162 )
2022-10-10 08:05:09 -07:00
Harry Nguyen
e9f615442b
fix(ingest): bigquery - Fix syntax error in get_all_schema_tables_query ( #6159 )
...
Co-authored-by: Nguyen Tri Hieu <nhieu@fossil.com>
2022-10-10 10:39:30 +02:00
Shirshanka Das
e9c4c823d8
fix(ingest): bigquery-beta - ensure that status aspect is emitted for… ( #6154 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-10-08 16:00:45 -07:00
Harshal Sheth
30014072ad
feat(ingest): lookml - add support for local/remote dependencies ( #6150 )
2022-10-07 13:14:21 -07:00
Tamas Nemeth
0f04cd6431
fix(ingest): bigquery-beta - eliminate the need for data.read permission for table schema ( #6146 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-07 10:19:16 -07:00
Mayuri Nehate
b8513ae492
fix(ingest): fetch workbook tags in workbooks graphql query ( #6102 )
2022-10-07 15:04:03 +02:00
Pablo Takara
485d56982a
fix(ingestion): add fallback to trino ( #6044 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-10-06 14:14:45 -07:00
Harshal Sheth
f446ccef2e
fix(ingest): snowflake - use approx count distinct for columns, fix quoting ( #6107 )
2022-10-06 13:56:29 -07:00
Harshal Sheth
3f84a2050a
fix(ingest): trino - add trino package max version restriction ( #6137 )
2022-10-06 13:30:28 -07:00
Shirshanka Das
3106e42e89
fix(ingest): file - add configurability for counting all elements before starting ingestion ( #6136 )
2022-10-06 10:24:23 -07:00
Tamas Nemeth
6db0925b26
fix(ingest): bigquery-beta - fix for missing key error if dataset was empty ( #6133 )
2022-10-06 09:20:49 -07:00
Shirshanka Das
5fa8818dd3
docs(tableau): adding an ingestion video ( #6124 )
2022-10-05 14:50:44 -07:00
Harshal Sheth
164e47a2e9
refactor(ingest): remove typing workarounds ( #6108 )
...
Possible now that we're on mypy 0.980.
2022-10-04 21:12:05 -07:00
Mayuri Nehate
4ee3ef14ef
fix(ingest): ignore usage and operation for snowflake datasets without schema ( #6112 )
2022-10-04 21:01:11 -07:00
Tamas Nemeth
2f79b50c24
fix(ingest): presto-on-hive - not failing on Hive type parsing error ( #6118 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-04 20:54:38 -07:00
Harshal Sheth
95afc1d73f
refactor(ingest): use pydantic utilities for NamingPattern ( #6013 )
...
* refactor(ingest): use pydantic utilities for NamingPattern
* clean up replacement logic
* flatten config hierarchy
2022-10-04 20:53:18 -07:00
Ravindra Lanka
055e4082da
fix(ingestion): fix percent change computation in stale_entity_removal ( #6121 )
2022-10-04 20:40:59 -07:00
Harshal Sheth
feb9d59b4d
fix(ingest): remove unused mysql golden file ( #6106 )
2022-10-04 20:26:51 -07:00
Harshal Sheth
3c0f63c50a
fix(ingest): hide deprecated path_spec option from config ( #5944 )
2022-10-04 12:14:00 -07:00
Thomas Tauber-Marshall
6b83cab82c
feat(ingest): add CorpUser and CorpGroup to the Python SDK ( #5930 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-10-04 12:13:38 -07:00
Gabe Lyons
ce90310dd0
feat(advanced-search): Complete Advanced Search: backend changes & tying UI together ( #6068 )
...
* stashing progress
* adding remove option
* more progress
* editing
* further in
* additional rendering improvements
* stashing adv search progress
* stashing more progress
* propagating not filters back to UI
* more frontend progress
* more filters working
* getting ready for data platform selector
* add platform select functionality
* locking out switching btwn advanced and standard filters
* final polish
* remove unneeded code
* added unit and cypress tests
* resolutions after merge
* adding documentation
* cleaning up & refactoring
* removing console.log
* minor ui fix & removing unneeded code
* fixing lineage search
* fixing lints
* fix display of degree
* fixing test
* fixing lint
* responding to comments
* fixing tests
* fix smoke tests
* fixing cypress
* fixing cypress test
* responding to comments
2022-10-04 10:20:04 -07:00
Roko Gudić
d52fde126f
feat(ingest): salesforce - add sandbox support ( #6105 )
...
Co-authored-by: rgudic <roko.gudic@infobip.com>
2022-10-04 09:05:53 -07:00
RyanHolstien
bfb903cfb8
feat(ingest): add async option to ingest proposal endpoint ( #6097 )
...
* feat(ingest): add async option to ingest proposal endpoint
* small tweak to validate before write to K, also keep existing path for timeseries aspects
* avoid double convert
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-03 19:56:19 -05:00
Tamas Nemeth
05f5c123bc
fix(ingest): bigquery-beta - Lowering a bit memory footprint of bigquery usage ( #6095 )
...
* Lowering a bit memory footprint of bigquery usage
* Filtering out not seen tables from usage generation
2022-10-01 14:39:04 +02:00
Shirshanka Das
3d8d8c6f8e
fix(ingest): lookml - extract column correctly ( #6093 )
2022-09-30 10:03:22 +02:00
Harshal Sheth
446b10dcc3
fix(ingest): bump lkml version ( #6091 )
2022-09-29 20:46:03 -07:00
