131 Commits

Author SHA1 Message Date
Hyejin Yoon
aaeeaa7ff5
feat: update lineage feature guide (#10401) 2024-05-22 15:18:33 +09:00
Hyejin Yoon
e3f27c8b91
feat: add keywords for SEO (#10358) 2024-04-30 08:12:32 +09:00
Harshal Sheth
f38b626d3d
fix(build): avoid nested gradle commands (#10198) 2024-04-04 12:46:00 -07:00
Mayuri Nehate
0361f2463d
feat(ingest/dynamodb): add support for classification (#10138) 2024-03-27 11:28:58 -07:00
Harshal Sheth
1598070899
fix(ci): simplify python release process (#10133) 2024-03-25 21:46:57 -04:00
Harshal Sheth
05930560cc
feat(ingest/s3): set default spark version (#10057) 2024-03-18 14:27:01 -07:00
Harshal Sheth
20e15ffc58
feat(ingest): improve custom package metadata (#9985) 2024-03-11 14:14:59 -07:00
Hyejin Yoon
67406aa218
docs: archive old version before 0.12.0 & fix broken links (#9957)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-05 16:05:26 +09:00
Harshal Sheth
4c83f10cdb
feat(ingest): throw codegen error on duplicate class names (#9960) 2024-02-29 16:13:43 -08:00
david-leifker
62f2789724
feat(structured-properties): soft delete (#9812) 2024-02-21 18:16:42 -06:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
Harshal Sheth
be329986ab
feat(ingest): rename custom package path from models to metadata (#9502) 2023-12-21 20:30:36 -05:00
Harshal Sheth
ca518d6c78
feat(ingest): remove librdkafka hacks (#9507) 2023-12-21 20:28:45 -05:00
Harshal Sheth
08a9b9b6de
fix(ingest): bug fixes and docs updates (#9422) 2023-12-08 16:18:34 -05:00
Harshal Sheth
d52f0305eb
fix(ingest): fix metadata for custom python packages (#9391) 2023-12-08 13:13:49 -05:00
Harshal Sheth
a7dc9c9d22
feat(sdk): autogenerate urn types (#9257) 2023-11-30 18:11:36 -05:00
Harshal Sheth
906a5b91a8
chore(ingest): cleanup various methods (#9221) 2023-11-13 21:51:11 -05:00
Harshal Sheth
89dff8f7bd
chore(ingest): start working on pydantic v2 support (#9220) 2023-11-10 09:34:08 -08:00
Andrew Sikowitz
8a80e858a7
build(ingest): Bump avro pin: security vulnerability (#9042) 2023-10-25 13:06:12 -04:00
Hyejin Yoon
52156193b6
docs(lineage): Lineage docs refactoring (#8899) 2023-10-04 08:43:59 +00:00
Harshal Sheth
791e2e7bf5
feat(python): support custom models without forking (#8774) 2023-09-22 16:43:58 -07:00
Harshal Sheth
f7fee743bf
fix(ingest): use epoch 1 for dev build versions (#8824) 2023-09-12 13:11:01 -07:00
Mayuri Nehate
303a2d0863
build(ingest): upgrade to sqlalchemy 1.4, drop 1.3 support (#8810)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-09-12 11:30:24 -07:00
Hyejin Yoon
065a290bd5
fix:change global graph url to static-assets (#8742) 2023-09-04 15:49:00 +09:00
Harshal Sheth
393b5a3039
ci(docs): add missing deps for lxml package for vercel (#8372) 2023-07-05 15:21:27 -07:00
Andrew Sikowitz
6bad15be5c
fix(ingest): Fix modeldocgen; bump feast to relax pyarrow constraint (#8178) 2023-06-06 13:12:10 -07:00
Andrew Sikowitz
802c91a0a7
feat(ingest): Create Browse Paths V2 under flag (#8120) 2023-06-02 12:50:38 -07:00
Mayuri Nehate
84270bcac8
feat(ingest/nifi): kerberos authentication (#8097)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
Co-authored-by: Indy Prentice <iprentic@users.noreply.github.com>
2023-05-24 15:09:01 -07:00
Harshal Sheth
4873a32e4a
fix(ingest): emitter bug fixes (#8093)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-05-23 12:04:16 -07:00
Shirshanka Das
b3c790aab6
feat: Add support for Data Products (#8039)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2023-05-17 07:17:25 +00:00
Harshal Sheth
1ebc88caf2
fix: build vercel python from source (#7972) 2023-05-05 17:10:05 +02:00
Harshal Sheth
a33153c1f6
feat(sdk): add DataHubGraph.get_entity_semityped method (#7905) 2023-04-26 13:44:13 -07:00
Harshal Sheth
af566e1184
feat(model): fully populate the entity registry (#7818) 2023-04-15 13:33:05 -07:00
Harshal Sheth
342830c68c
fix(cli): use correct ingestion image in script (#7826) 2023-04-14 23:47:08 -07:00
Harshal Sheth
82dc2b6393
feat(docs): clear up source configs (#7720) 2023-04-04 18:40:19 +05:30
Harshal Sheth
575909e41c
feat(docs): support inlining code snippets from files (#7712) 2023-03-30 00:02:21 +00:00
Harshal Sheth
d9231addd2
feat(docs-website): add vercel preview environment (#7644) 2023-03-22 12:28:52 -07:00
Shirshanka Das
104c9811f5
fix(ingest/docs): improve matcher to include types with spaces in them (#7631) 2023-03-18 12:59:43 -07:00
Shirshanka Das
41d4c0b074
feat(ingest/docs): json-schema fixes, improvements to ingestion doc generation (#7615) 2023-03-17 15:58:14 +01:00
Harshal Sheth
89734587f7
feat(ingest): add urn modification helper (#7440)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-03-16 13:27:08 -07:00
Harsha Mandadi
bf36c935fa
feat(ingest/s3): support path_specs of different S3 buckets in the same recipe (#7514) 2023-03-14 21:55:57 -07:00
Andrew Sikowitz
8fd2cc5f20
fix(ingest/snowflake): Improve memory usage of metadata extraction (#7349) 2023-02-20 14:46:10 +01:00
Felix Lüdin
da2b0c9e1b
fix(docs): sort sources by display name in doc's sidebar (#7322) 2023-02-13 12:39:54 -08:00
Harshal Sheth
bc9adfa441
ci(ingest): add flag to skip tests but run codegen during release (#7067) 2023-01-18 11:55:07 +01:00
Harshal Sheth
f39ed5244c
fix(ingest): support multiple entity_registry sections (#7066) 2023-01-18 15:12:08 +05:30
Harshal Sheth
cb12910b6b
feat(ingest): add entity registry in codegen (#6984)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-01-17 19:41:43 -08:00
Harshal Sheth
62a2aa94f6
feat: remove jq requirement + tweak modeldocgen args (#6904)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-12-30 14:02:57 -05:00
Harshal Sheth
dfc5c6bfce
chore(ingest): remove inferred args to MCPW, part 1 (#6819) 2022-12-30 01:26:47 -05:00
Harshal Sheth
7d63399d00
fix(ingest): fix serde for empty dicts in unions with null (#6745)
The code changes in https://github.com/acryldata/avro_gen/pull/16, but tests are written here.
2022-12-13 08:17:24 +01:00
Harshal Sheth
3e907ab0d1
feat(ingest): loosen sqlalchemy dep & support airflow 2.3+ (#6204)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-11-11 15:04:36 -05:00