12004 Commits

Author SHA1 Message Date
Brian
5c88f7624a
feat(react): use default entity icon if lineageentity has no icon (#2406) 2021-04-16 09:46:02 -07:00
Harshal Sheth
91a2f69310
fix(ingest): properly handle fieldDiscriminator with restli (#2408) 2021-04-16 09:42:52 -07:00
Harshal Sheth
777c05973f
fix(ingest): add sqlalchemy extra (#2409) 2021-04-16 09:41:23 -07:00
G-nther
177161a850
feat(kafka-setup): add option for SSL and topic partition config via environment (#2398) 2021-04-16 09:40:39 -07:00
Dexter Lee
379c2e1c0c
feat(k8s): add extraEnvs to setup jobs (#2404) 2021-04-16 09:39:40 -07:00
Brian
ed3c3b236b
feat(react): add footer buttons in lineage sidebar (#2407) 2021-04-15 11:47:32 -07:00
Thomas Larsson
89fb538fa5
feature(ingestion): Make origin/fabric_type configurable (#2405)
Fixes: #2394

Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
2021-04-15 10:47:28 -07:00
Brian
82791008c3
feat(react): add padding between tags and description on datasets profile page (#2384) 2021-04-14 19:35:21 -07:00
Gabe Lyons
1e11851a90
feat(sample): adding sample mces for dataflows and datajobs (#2396) 2021-04-14 19:27:01 -07:00
Harshal Sheth
ffe03e6758
fix(ingest): streamline codegen init methods (#2400) 2021-04-14 19:25:57 -07:00
Brian
9a48e11b7b
feat(react): update schema table to have fixed description column, set line break with max description width (#2382) 2021-04-14 19:22:19 -07:00
Dexter Lee
f018dd6f3e
fix: Fix env variable setup for kafka, mysql-setup docker containers (#2402) 2021-04-14 19:07:50 -07:00
Harshal Sheth
9c2a30c3a1
fix(ingest): add db name to postgres URNs (#2401) 2021-04-14 15:04:13 -07:00
Harshal Sheth
2af4603e49
fix(ingest): enable mypy disallow_incomplete_defs and disallow_untyped_decorators (#2393) 2021-04-14 13:40:24 -07:00
Gabe Lyons
c57d5a3731
fix(react): fix access to pictureLink in charts and dashboards (#2395) 2021-04-14 13:23:53 -07:00
Gabe Lyons
a9f4f3797a
fix(tags): check description existence on tags (#2399) 2021-04-14 13:20:51 -07:00
Brian
6a5f065448
feat(react): fix long descriptions overflow issue in lineage side panel (#2383) 2021-04-13 18:21:41 -07:00
Harshal Sheth
a11329d5b8
refactor(ingest): update test harness to use a compose file per test (#2392) 2021-04-13 17:30:24 -07:00
Brian
dfc99d6b6a
feat(react): fix browse link of last breadcrumb linked to unknown page (#2391) 2021-04-13 14:22:43 -07:00
Dexter Lee
7c54004b93
feat(mysql-setup): Add the ability to specify database name for mysql-setup (#2385) 2021-04-13 08:03:50 -07:00
Harshal Sheth
fb6f74b1da
feat(ingest): add generic sqlalchemy source (#2389) 2021-04-13 08:01:38 -07:00
Dexter Lee
3ddf163a91
feat(k8s): Add ability to add service accounts to setup jobs (#2390) 2021-04-13 07:59:18 -07:00
Dexter Lee
fa015c5aaa
fix(kafka-topic-convention): Fix DAOs that do not refer to TopicConvention (#2387) 2021-04-13 07:58:31 -07:00
Dexter Lee
1fc532d831
feat(index): Add index naming convention for elasticsearch (#2386) 2021-04-13 07:56:31 -07:00
Harshal Sheth
eeee8aa34e
fix(ingest): report correct version status in dev mode (#2388) 2021-04-12 19:35:40 -07:00
Harshal Sheth
41cd52f9e2
feat(ingest): add Airflow lineage backend (#2368) 2021-04-12 17:40:15 -07:00
Junqiu Zheng
cadcdd936c
fix(docs): fix config example for file sink (#2380) 2021-04-12 11:37:17 -07:00
Dexter Lee
f293add5b1
feat(k8s): Update pods with correct probes and remove unnecessary dependencies (#2362) 2021-04-09 17:49:12 -07:00
Thomas Larsson
6610666496
fix(ingestion): dont crash on non-RecordSchema topics (#2372)
Fixes: #2371

Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
2021-04-09 17:36:01 -07:00
Harshal Sheth
011ab9a09a
docs(ingestion): remove outdated data-source-onboarding.md docs (#2360) 2021-04-09 17:33:09 -07:00
Brian
98813ed2b5
feat(react): hide Owned By label in card if no owners (#2376) 2021-04-09 17:08:55 -07:00
shubham garg
0b01c7d9dc
fix(react): ownership rendering (#2373)
Co-authored-by: shubham.garg <shubham.garg@thoughtworks.com>
2021-04-09 16:56:42 -07:00
Brian
a19085094a
feat(react): add null state indicator in user profile when no entities (#2377) 2021-04-09 16:55:05 -07:00
Brian
fefcdd949c
feat(react): update avatar to use initial if no image, refactor all avatars with custom one (#2379) 2021-04-09 16:53:04 -07:00
Gabe Lyons
83c9f744ad
feat(lineage): support arbitrary entity types in lineage viz (#2369) 2021-04-09 11:55:25 -07:00
Thomas Larsson
e02a17aecf
fix(ingestion): Support mapping from avro "boolean" and "map" types t… (#2364)
Fixes: #2363

Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
2021-04-08 14:23:12 -07:00
Thomas Larsson
4215dcd53c
fix(ingestion): properly detect optional fields in avro schemas (#2343)
Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
2021-04-08 14:00:01 -07:00
Brian
4a47abf605
feat(react): add empty state UI for browse when no entities (#2370) 2021-04-08 13:41:12 -07:00
Fredrik Sannholm
fd0923c445
feat(datajob): Datajob graphql query (#2242) 2021-04-08 13:40:16 -07:00
Brian
172d914ceb
feat(react): add dropdown menu links, menu styling, removed warnings (#2367) 2021-04-08 12:30:13 -07:00
Fredrik Sannholm
f837360b9a
chore(dependabot): Update pyyaml version (#2365) 2021-04-08 11:43:19 -07:00
Brian
caad3f8d0e
feat(react): add icons on entities, updated styling in LineageViz (#2366) 2021-04-08 10:24:33 -07:00
Harshal Sheth
bfe345da42
fix(ingest): add test for avro serialization and deserialization (#2351) 2021-04-07 21:30:21 -07:00
Harshal Sheth
e29082bf55
feat(cli): Add support for checking docker memory usage (#2361) 2021-04-07 16:26:21 -07:00
Brian
dca0eb312b
feat(react): original description shows in edit modal even when the description has been updated (#2358) 2021-04-07 15:02:29 -07:00
Gabe Lyons
f6e2317eef
feat(react): improving error logging on dataset entity (#2357) 2021-04-07 15:01:33 -07:00
Dexter Lee
1c6f1d7a86
fix(elasticsearch): Fix inconsistencies between documents and elasticsearch mappings (#2356) 2021-04-07 14:59:43 -07:00
Harshal Sheth
518de354d9
fix(ingest): support python3 -m datahub (#2359) 2021-04-07 14:58:58 -07:00
Harshal Sheth
455c078773
chore(ingest): remove unused plugin_requirements.txt file (#2353) 2021-04-06 18:37:39 -07:00
Harshal Sheth
b0d8f70354
fix(ingest): bump pybigquery version (#2352) 2021-04-06 18:34:06 -07:00