8166 Commits

Author SHA1 Message Date
Amanda Hernando
ffa838e00e
feat(ingestion): Tableau stateful ingestion (#6094) 2022-10-11 15:52:15 -07:00
Harshal Sheth
95d1e01195
feat(ingest): infer aspect name from type in get_aspect (#6033) 2022-10-11 13:35:41 -07:00
Ankit keshari
21c1d37d13
feat(ui): Add warning banner to looker and lookml UI ingestion forms (#6111) 2022-10-11 11:19:20 -04:00
Harshal Sheth
0427122f5d
fix(ingest): allow hiding some fields from the schema (#6077) v0.9.0 2022-10-10 20:46:59 -07:00
Tamas Nemeth
128e3a8970
fix(ingest): bigquery-beta - turning sql parsing off in lineage extraction (#6163)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-10 20:30:29 -07:00
Harshal Sheth
d569734193
refactor(ingest): Tableau cleanup (#6131)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-10 15:52:34 -07:00
Harshal Sheth
879894d702
feat(ingest): airflow - support enabled flag for airflow config (#6089) 2022-10-11 00:42:13 +02:00
Mayuri Nehate
7b88de89d5
fix(ingest): snowflake - allow profiling to work with geography type (#6162) 2022-10-10 08:05:09 -07:00
Harry Nguyen
e9f615442b
fix(ingest): bigquery - Fix syntax error in get_all_schema_tables_query (#6159)
Co-authored-by: Nguyen Tri Hieu <nhieu@fossil.com>
2022-10-10 10:39:30 +02:00
Shirshanka Das
e9c4c823d8
fix(ingest): bigquery-beta - ensure that status aspect is emitted for… (#6154)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-10-08 16:00:45 -07:00
Gabe Lyons
37a2858e28
Update README.md (#6155) 2022-10-07 16:56:37 -07:00
Gabe Lyons
1939116002
fixing filtering on impact analysis + cypress tests (#6152) 2022-10-07 15:09:23 -07:00
Aditya Radhakrishnan
73a3aa3a3d
fix(auth): fix login endpoint to respect session expiration env var (#6151) 2022-10-07 14:08:43 -07:00
Harshal Sheth
30014072ad
feat(ingest): lookml - add support for local/remote dependencies (#6150) 2022-10-07 13:14:21 -07:00
Chris Collins
2f285b7470
fix(lineage) Fix batching to ES for impact analysis (#6149) 2022-10-07 15:16:23 -04:00
Tamas Nemeth
0f04cd6431
fix(ingest): bigquery-beta - eliminate the need for data.read permission for table schema (#6146)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-07 10:19:16 -07:00
Chris Collins
2e2ef536d8
fix(lineage) Fix possible null pointer exception in UpstreamLineagesMapper (#6147) 2022-10-07 10:38:38 -04:00
Mayuri Nehate
b8513ae492
fix(ingest): fetch workbook tags in workbooks graphql query (#6102) 2022-10-07 15:04:03 +02:00
Gabe Lyons
1193e41955
docs(approvals): update approval permission docs (#6143)
* Update approval-workflows.md

* Update approval-workflows.md
2022-10-06 19:33:09 -07:00
Aditya Radhakrishnan
e8259788a3
feat(tracking): add telemetry for frontend events (#6129) 2022-10-06 18:56:32 -07:00
Chris Collins
1f1398605c
feat(lineage) Add Column-Level to Lineage Visualization (#6138) 2022-10-06 19:41:18 -04:00
Gabe Lyons
5f0216cfda
temporarily disable fetching input fields for search results (#6139) 2022-10-06 16:23:24 -07:00
Pablo Takara
485d56982a
fix(ingestion): add fallback to trino (#6044)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-10-06 14:14:45 -07:00
Harshal Sheth
f446ccef2e
fix(ingest): snowflake - use approx count distinct for columns, fix quoting (#6107) 2022-10-06 13:56:29 -07:00
david-leifker
3dc25c14e0
test(KafkaEmitter): Enable ability to run test locally (#6123) 2022-10-06 13:34:11 -07:00
Harshal Sheth
3f84a2050a
fix(ingest): trino - add trino package max version restriction (#6137) 2022-10-06 13:30:28 -07:00
Ankit keshari
11092c73cf
feat(groups & owners) Add ability to edit group name + assign creator as owner of metadata (#6047)
Adds ability to edit user group names from the UI. Also sets the creator or Glossary Terms, Glossary Nodes, and Domains to be the owner of said item.
2022-10-06 15:36:39 -04:00
Shirshanka Das
3106e42e89
fix(ingest): file - add configurability for counting all elements before starting ingestion (#6136) 2022-10-06 10:24:23 -07:00
Tamas Nemeth
6db0925b26
fix(ingest): bigquery-beta - fix for missing key error if dataset was empty (#6133) 2022-10-06 09:20:49 -07:00
david-leifker
928f29438a
build: Update JNA for M1 Mac (#6116) 2022-10-05 14:53:38 -07:00
Paul Logan
cc236f5ca2
docs: sending "getting started" direct to quickstart (#6125) 2022-10-05 14:52:04 -07:00
Shirshanka Das
5fa8818dd3
docs(tableau): adding an ingestion video (#6124) 2022-10-05 14:50:44 -07:00
Gabe Lyons
864e64de8f
feat(lineage): show fully qualified task name in lineage UI (#6126)
* showing fully qualified task name in lineage UI

* slight refactor

* use display name

* fix test
2022-10-05 13:54:26 -07:00
PrashantKhadke
395d7ea2f5
docs(okta): Added information about AUTH_OIDC_EXTRACT_GROUPS_ENABLED (#6120)
* Added information about AUTH_OIDC_EXTRACT_GROUPS_ENABLED

* Update configure-oidc-react-okta.md

Co-authored-by: Aditya Radhakrishnan <aditya.radhakrish@gmail.com>
2022-10-04 21:13:14 -07:00
Harshal Sheth
164e47a2e9
refactor(ingest): remove typing workarounds (#6108)
Possible now that we're on mypy 0.980.
2022-10-04 21:12:05 -07:00
Mayuri Nehate
4ee3ef14ef
fix(ingest): ignore usage and operation for snowflake datasets without schema (#6112) 2022-10-04 21:01:11 -07:00
Tamas Nemeth
2f79b50c24
fix(ingest): presto-on-hive - not failing on Hive type parsing error (#6118)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-04 20:54:38 -07:00
Harshal Sheth
95afc1d73f
refactor(ingest): use pydantic utilities for NamingPattern (#6013)
* refactor(ingest): use pydantic utilities for NamingPattern

* clean up replacement logic

* flatten config hierarchy
2022-10-04 20:53:18 -07:00
Ravindra Lanka
055e4082da
fix(ingestion): fix percent change computation in stale_entity_removal (#6121) 2022-10-04 20:40:59 -07:00
Harshal Sheth
feb9d59b4d
fix(ingest): remove unused mysql golden file (#6106) 2022-10-04 20:26:51 -07:00
Aditya Radhakrishnan
ee1a1ef45b
feat(posts): add posts feature to DataHub (#6110) 2022-10-04 15:37:28 -07:00
Harshal Sheth
3c0f63c50a
fix(ingest): hide deprecated path_spec option from config (#5944) 2022-10-04 12:14:00 -07:00
Thomas Tauber-Marshall
6b83cab82c
feat(ingest): add CorpUser and CorpGroup to the Python SDK (#5930)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-10-04 12:13:38 -07:00
Gabe Lyons
1325b8ad71
feat(search): improved search snippet FE logic (#6109)
* starting improvements on search snippet

* flesh out ranking logic

* adding tests

* responding to comments
2022-10-04 11:27:46 -07:00
Gabe Lyons
ce90310dd0
feat(advanced-search): Complete Advanced Search: backend changes & tying UI together (#6068)
* stashing progress

* adding remove option

* more progress

* editing

* further in

* additional rendering improvements

* stashing adv search progress

* stashing more progress

* propagating not filters back to UI

* more frontend progress

* more filters working

* getting ready for data platform selector

* add platform select functionality

* locking out switching btwn advanced and standard filters

* final polish

* remove unneeded code

* added unit and cypress tests

* resolutions after merge

* adding documentation

* cleaning up & refactoring

* removing console.log

* minor ui fix & removing unneeded code

* fixing lineage search

* fixing lints

* fix display of degree

* fixing test

* fixing lint

* responding to comments

* fixing tests

* fix smoke tests

* fixing cypress

* fixing cypress test

* responding to comments
2022-10-04 10:20:04 -07:00
Peter Szalai
396fd31ddc
fix(mae-consumer): use JAVA_TOOL_OPTIONS instead of JDK_JAVA_OPTIONS (#6114) 2022-10-04 09:07:44 -07:00
Roko Gudić
d52fde126f
feat(ingest): salesforce - add sandbox support (#6105)
Co-authored-by: rgudic <roko.gudic@infobip.com>
2022-10-04 09:05:53 -07:00
John Joyce
e2c5d2a4ce
feat(ui): bump max recommendations for Platforms (#6113) 2022-10-04 18:35:04 +05:30
Shirshanka Das
bea5a0751e
chore(deps): upgrade opentelemetry dependencies (#6100)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-10-03 22:38:09 -07:00
RyanHolstien
bfb903cfb8
feat(ingest): add async option to ingest proposal endpoint (#6097)
* feat(ingest): add async option to ingest proposal endpoint

* small tweak to validate before write to K, also keep existing path for timeseries aspects

* avoid double convert

Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-03 19:56:19 -05:00