mirror of
https://github.com/datahub-project/datahub.git
synced 2025-08-14 12:16:52 +00:00
311 lines
14 KiB
Markdown
311 lines
14 KiB
Markdown
# Town Hall History
|
|
|
|
A list of previous Town Halls, their planned schedule, and the recording of the meeting.
|
|
|
|
## 12/17/2021
|
|
[Full YouTube video](https://youtu.be/rYInKCwxu7o)
|
|
|
|
## Agenda
|
|
- Community & Roadmap Updates by Maggie Hays (Acryl Data)
|
|
- Project Updates by Shirshanka Das (Acryl Data)
|
|
- 2021 DataHub Community in Review by Maggie Hays
|
|
- DataHub Basics -- Users, Groups, & Authentication 101 by Pedro Silva (Acryl Data)
|
|
- Sneak Peek: UI-Based Ingestion by John Joyce (Acryl Data)
|
|
- Case Study — DataHub at Grofers by Shubham Gupta
|
|
- Top DataHub Contributors of 2021 - Maggie Hays
|
|
- Final Surprise! We Interviewed a 10yo and a 70yo about DataHub
|
|
|
|
## 11/19/2021
|
|
[Full YouTube video](https://youtu.be/to80sEDZz7k)
|
|
|
|
## Agenda
|
|
- Community & Roadmap Updates by Maggie Hays (Acryl Data)
|
|
- Project Updates by Shirshanka Das (Acryl Data)
|
|
- DataHub Basics -- Lineage 101 by John Joyce & Surya Lanka (Acryl Data)
|
|
- Introducing No-Code UI by Gabe Lyons & Shirshanka Das (Acryl Data)
|
|
- DataHub API Authentication by John Joyce (Acryl Data)
|
|
- Case Study: LinkedIn pilot to extend the OSS UI by Aikepaer Abuduweili & Joshua Shinavier
|
|
|
|
## 10/29/2021
|
|
[Full YouTube video](https://youtu.be/GrS_uZhYNm0)
|
|
|
|
## Agenda
|
|
- DataHub Community & Roadmap Update - Maggie Hays (Acryl Data)
|
|
- October Project Updates - Shirshanka Das (Acryl Data)
|
|
- Introducing Recommendations - John Joyce & Dexter Lee (Acryl Data)
|
|
- Case Study: DataHub @ hipages - Chris Coulson (hipages)
|
|
- Data Profiling Improvements - Surya Lanka & Harshal Sheth (Acryl Data)
|
|
- Lineage Improvements & BigQuery Dataset Lineage by Gabe Lyons & Varun Bharill (Acryl Data)
|
|
|
|
## 9/24/2021
|
|
[Full YouTube video](https://youtu.be/nQDiKPKnLLQ)
|
|
|
|
## Agenda
|
|
- Project Updates and Callouts by Shirshanka
|
|
- GraphQL Public API Annoucement
|
|
- Demo: Faceted Search by Gabe Lyons (Acryl Data)
|
|
- Stateful Ingestion by Shirshanka Das & Surya Lanka (Acryl Data)
|
|
- Case-Study: DataHub @ Adevinta by Martinez de Apellaniz
|
|
- Recent Improvements to the Looker Connector by Shirshanka Das & Maggie Hays (Acryl Data)
|
|
- Offline
|
|
- Foreign Key and Related Term Mapping by Gabe Lyons (Acryl Data) [video](https://www.loom.com/share/79f27c2d9f6c4a3b8aacbc48c19add18)
|
|
|
|
## 8/27/2021
|
|
[Full YouTube video](https://youtu.be/3joZINi3ti4)
|
|
|
|
## Agenda
|
|
- Project Updates and Callouts by Shirshanka
|
|
- Business Glossary Demo
|
|
- 0.8.12 Upcoming Release Highlights
|
|
- Users and Groups Management (Okta, Azure AD)
|
|
- Demo: Fine Grained Access Control by John Joyce (Acryl Data)
|
|
- Community Case-Study: DataHub @ Warung Pintar and Redash integration by Taufiq Ibrahim (Bizzy Group)
|
|
- New User Experience by John Joyce (Acryl Data)
|
|
- Offline
|
|
- Performance Monitoring by Dexter Lee (Acryl Data) [video](https://youtu.be/6Xfr_Y9abZo)
|
|
|
|
|
|
## 7/23/2021
|
|
[Full YouTube video](https://www.youtube.com/watch?v=rZsiB8z5rG4)
|
|
|
|
[Medium Post](https://medium.com/datahub-project/datahub-project-updates-f4299cd3602e?source=friends_link&sk=27af7637f7ae44786ede694c3af512a5)
|
|
|
|
## Agenda
|
|
|
|
- Project Updates by Shirshanka
|
|
- Release highlights
|
|
- Deep Dive: Data Observability: Phase 1 by Harshal Sheth, Dexter Lee (Acryl Data)
|
|
- Case Study: Building User Feedback into DataHub by Melinda Cardenas (NY Times)
|
|
- Demo: AWS SageMaker integration for Models and Features by Kevin Hu (Acryl Data)
|
|
|
|
|
|
## 6/25/2021
|
|
[Full YouTube video](https://www.youtube.com/watch?v=xUHOdDfdFpY)
|
|
|
|
[Medium Post](https://medium.com/datahub-project/datahub-project-updates-ed3155476408?source=friends_link&sk=02816a16ff2acd688e6db8eb55808d31)
|
|
|
|
### Agenda
|
|
|
|
- Project Updates by Shirshanka
|
|
- Release notes
|
|
- RBAC update
|
|
- Roadmap for H2 2021
|
|
- Demo: Table Popularity powered by Query Activity by Harshal Sheth (Acryl Data)
|
|
- Case Study: Business Glossary in production at Saxo Bank by Sheetal Pratik (Saxo Bank), Madhu Podila (ThoughtWorks)
|
|
- Developer Session: Simplified Deployment for DataHub by John Joyce, Gabe Lyons (Acryl Data)
|
|
|
|
|
|
## 5/27/2021
|
|
[Full YouTube video](https://www.youtube.com/watch?v=qgW_xpIr1Ho)
|
|
|
|
[Medium Post](https://medium.com/datahub-project/linkedin-datahub-project-updates-ed98cdf913c1?source=friends_link&sk=9930ec5579299b155ea87c747683d1ad)
|
|
|
|
### Agenda
|
|
|
|
- Project Updates by Shirshanka - 10 mins
|
|
- 0.8.0 Release
|
|
- AWS Recipe by Dexter Lee (Acryl Data)
|
|
- Demo: Product Analytics design sprint (Maggie Hays (SpotHero), Dexter Lee (Acryl Data)) - 10 mins
|
|
- Use-Case: DataHub on GCP by Sharath Chandra (Confluent) - 10 mins
|
|
- Deep Dive: No Code Metadata Engine by John Joyce (Acryl Data) - 20 mins
|
|
- General Q&A and closing remarks
|
|
|
|
## 4/23/2021
|
|
[Full YouTube video](https://www.youtube.com/watch?v=dlFa4ubJ9ho)
|
|
|
|
[Medium Digest](https://medium.com/datahub-project/linkedin-datahub-project-updates-2b0d26066b8f?source=friends_link&sk=686c47219ed294e0838ae3e2fe29084d)
|
|
|
|
### Agenda
|
|
|
|
- Welcome - 5 mins
|
|
- Project Updates by Shirshanka - 10 mins
|
|
- 0.7.1 Release and callouts (dbt by Gary Lucas)
|
|
- Product Analytics design sprint announcement (Maggie Hayes)
|
|
- Use-Case: DataHub at DefinedCrowd ([video](https://www.youtube.com/watch?v=qz5Rpmw8I5E)) by Pedro Silva - 15 mins
|
|
- Deep Dive + Demo: Lineage! Airflow, Superset integration ([video](https://www.youtube.com/watch?v=3wiaqhb8UR0)) by Harshal Sheth and Gabe Lyons - 10 mins
|
|
- Use-Case: DataHub Hackathon at Depop ([video](https://www.youtube.com/watch?v=SmOMyFc-9J0)) by John Cragg - 10 mins
|
|
- Observability Feedback share out - 5 mins
|
|
- General Q&A and closing remarks - 5 mins
|
|
|
|
|
|
## 3/19/2021
|
|
[YouTube video](https://www.youtube.com/watch?v=xE8Uc27VTG4)
|
|
|
|
[Medium Digest](https://medium.com/datahub-project/linkedin-datahub-project-updates-697f0faddd10?source=friends_link&sk=9888633c5c7219b875125e87a703ec4d)
|
|
|
|
### Agenda
|
|
|
|
* Welcome - 5 mins
|
|
* Project Updates ([slides](https://drive.google.com/file/d/1c3BTP3oDAzJr07l6pY6CkDZi5nT0cLRs/view?usp=sharing)) by [Shirshanka](https://www.linkedin.com/in/shirshankadas/) - 10 mins
|
|
* 0.7.0 Release
|
|
* Project Roadmap
|
|
* Demo Time: Themes and Tags in the React App! by [Gabe Lyons](https://www.linkedin.com/in/gabe-lyons-9a574543/) - 10 mins
|
|
* Use-Case: DataHub at [Wolt](https://www.linkedin.com/company/wolt-oy/) ([slides](https://drive.google.com/file/d/1za7NKbnXpFV2bBDblP35CbQEIDwc9tog/view?usp=sharing)) by [Fredrik](https://www.linkedin.com/in/fredriksannholm/?originalSubdomain=fi) and Matti - 15 mins
|
|
* Poll Time: Observability Mocks! ([slides](https://drive.google.com/file/d/1Ih2EGf-76jhbNAjr2EsBLb7n8bra2WIz/view?usp=sharing)) - 5 mins
|
|
* General Q&A from sign up sheet, slack, and participants - 10 mins
|
|
* Closing remarks - 5 mins
|
|
|
|
|
|
## 2/19/2021
|
|
[YouTube video](https://www.youtube.com/watch?v=Z9ImbcsAVl0)
|
|
|
|
[Medium Digest](https://medium.com/datahub-project/linkedin-datahub-project-updates-february-2021-edition-338d2c6021f0)
|
|
### Agenda
|
|
|
|
* Welcome - 5 mins
|
|
* Latest React App Demo! ([video](https://www.youtube.com/watch?v=RQBEJhcen5E)) by John Joyce and Gabe Lyons - 5 mins
|
|
* Use-Case: DataHub at Geotab ([slides](https://docs.google.com/presentation/d/1qcgO3BW5NauuG0HnPqrxGcujsK-rJ1-EuU-7cbexkqE/edit?usp=sharing),[video](https://www.youtube.com/watch?v=boyjT2OrlU4)) by [John Yoon](https://www.linkedin.com/in/yhjyoon/) - 15 mins
|
|
* Tech Deep Dive: Tour of new pull-based Python Ingestion scripts ([slides](https://docs.google.com/presentation/d/15Xay596WDIhzkc5c8DEv6M-Bv1N4hP8quup1tkws6ms/edit#slide=id.gb478361595_0_10),[video](https://www.youtube.com/watch?v=u0IUQvG-_xI)) by [Harshal Sheth](https://www.linkedin.com/in/hsheth2/) - 15 mins
|
|
* General Q&A from sign up sheet, slack, and participants - 15 mins
|
|
* Closing remarks - 5 mins
|
|
|
|
|
|
## 1/15/2021
|
|
[Full Recording](https://youtu.be/r862MZTLAJ0)
|
|
|
|
[Slide-deck](https://docs.google.com/presentation/d/e/2PACX-1vQ2B0iHb2uwege1wlkXHOgQer0myOMEE5EGnzRjyqw0xxS5SaAc8VMZ_1XVOHuTZCJYzZZW4i9YnzSN/pub?start=false&loop=false&delayms=3000)
|
|
|
|
Agenda
|
|
|
|
- Announcements - 2 mins
|
|
- Community Updates ([video](https://youtu.be/r862MZTLAJ0?t=99)) - 10 mins
|
|
- Use-Case: DataHub at Viasat ([slides](demo/ViasatMetadataJourney.pdf),[video](https://youtu.be/2SrDAJnzkjE)) by [Anna Kepler](https://www.linkedin.com/in/akepler) - 15 mins
|
|
- Tech Deep Dive: GraphQL + React RFCs readout and discussion ([slides](https://docs.google.com/presentation/d/e/2PACX-1vRtnINnpi6PvFw7-5iW8PSQoT9Kdf1O_0YW7QAr1_mSdJMNftYFTVCjKL-e3fpe8t6IGkha8UpdmoOI/pub?start=false&loop=false&delayms=3000) ,[video](https://www.youtube.com/watch?v=PrBaFrb7pqA)) by [John Joyce](https://www.linkedin.com/in/john-joyce-759883aa) and [Arun Vasudevan](https://www.linkedin.com/in/arun-vasudevan-55117368/) - 15 mins
|
|
- General Q&A from sign up sheet, slack, and participants - 15 mins
|
|
- Closing remarks - 3 mins
|
|
- General Q&A from sign up sheet, slack, and participants - 15 mins
|
|
- Closing remarks - 5 minutes
|
|
|
|
## 12/04/2020
|
|
[Recording](https://linkedin.zoom.us/rec/share/8E7-lFnCi_kQ8OvXR9kW6fn-AjvV8VlqOO2xYR8b5Y_UeWI_ODcKFlxlHqYgBP7j.S-c8C1YMrz7d3Mjq)
|
|
|
|
Agenda
|
|
|
|
- Quick intro - 5 mins
|
|
- [Why did Grofers choose DataHub for their data catalog?](demo/Datahub_at_Grofers.pdf) by [Shubham Gupta](https://www.linkedin.com/in/shubhamg931/) - 15 minutes
|
|
- [DataHub UI development - Part 2](demo/Town_Hall_Presentation_-_12-2020_-_UI_Development_Part_2.pdf) by [Charlie Tran](https://www.linkedin.com/in/charlie-tran/) (LinkedIn) - 20 minutes
|
|
- General Q&A from sign up sheet, slack, and participants - 15 mins
|
|
- Closing remarks - 5 minutes
|
|
|
|
## 11/06/2020
|
|
|
|
[Recording](https://linkedin.zoom.us/rec/share/0yvjZ2fOzVmD8aaDo3lC59fXivmYG3EnF0U9tMVgKs827595usvSoIhtFUPjZCsU.b915nLRkw6iQlnoD)
|
|
|
|
Agenda
|
|
|
|
- Quick intro - 5 mins
|
|
- [Lightning talk on Metadata use-cases at LinkedIn](demo/Metadata_Use-Cases_at_LinkedIn_-_Lightning_Talk.pdf) by [Shirshanka Das](https://www.linkedin.com/in/shirshankadas/) (LinkedIn) - 5 mins
|
|
- [Strongly Consistent Secondary Index (SCSI) in GMA](demo/Datahub_-_Strongly_Consistent_Secondary_Indexing.pdf), an upcoming feature by [Jyoti Wadhwani](https://www.linkedin.com/in/jyotiwadhwani/) (LinkedIn) - 15 minutes
|
|
- [DataHub UI overview](demo/DataHub-UIOverview.pdf) by [Ignacio Bona](https://www.linkedin.com/in/ignaciobona) (LinkedIn) - 20 minutes
|
|
- General Q&A from sign up sheet, slack, and participants - 10 mins
|
|
- Closing remarks - 5 minutes
|
|
|
|
|
|
## 09/25/2020
|
|
|
|
[Recording](https://linkedin.zoom.us/rec/share/uEQ2pRY0BHbVqk_sOTVRm05VXJ0xM_zKJ26yzfCBqNZItiBht__k_juCCahJ37QK.IKAU9qA_0qdURX4_)
|
|
|
|
Agenda
|
|
|
|
- Quick intro - 5 mins
|
|
- [Data Discoverability at SpotHero](demo/Data_Discoverability_at_SpotHero.pdf) by [Maggie Hays](https://www.linkedin.com/in/maggie-hays/) (SpotHero) - 20 mins
|
|
- [Designing the next generation of metadata events for scale](demo/Designing_the_next_generation_of_metadata_events_for_scale.pdf) by [Chris Lee](https://www.linkedin.com/in/chrisleecmu/) (LinkedIn) - 15 mins
|
|
- General Q&A from sign up sheet, slack, and participants - 15 mins
|
|
- Closing remarks - 5 mins
|
|
|
|
## 08/28/2020
|
|
|
|
[Recording](https://linkedin.zoom.us/rec/share/vMBfcb31825IBZ3T71_wffM_GNv3T6a8hicf8_dcfzQlhfFxl5i_CPVKcmYaZA)
|
|
|
|
|
|
Agenda
|
|
- Quick intro - 5 mins
|
|
- [Data Governance look for a Digital Bank](https://www.slideshare.net/SheetalPratik/linkedinsaxobankdataworkbench) by [Sheetal Pratik](https://www.linkedin.com/in/sheetalpratik/) (Saxo Bank) - 20 mins
|
|
- Column level lineage for datasets demo by [Nagarjuna Kanamarlapudi](https://www.linkedin.com/in/nagarjunak/) (LinkedIn) - 15 mins
|
|
- General Q&A from sign up sheet and participants - 15 mins
|
|
- Closing remarks - 5 mins
|
|
|
|
## 07/31/20
|
|
|
|
[Recording](https://bluejeans.com/s/wjnDRJevi5z/)
|
|
|
|
Agenda
|
|
* Quick intro - 5 mins
|
|
* Showcasing new entities onboarded to internal LinkedIn DataHub (Data Concepts, Schemas) by [Nagarjuna Kanamarlapudi](https://www.linkedin.com/in/nagarjunak) (LinkedIn) - 15 mins
|
|
* Showcasing new Lineage UI in internal LinkedIn DataHub By [Ignacio Bona](https://www.linkedin.com/in/ignaciobona) (LinkedIn) - 10 mins
|
|
* New [RFC Process](./rfc.md) by [John Plaisted](https://www.linkedin.com/in/john-plaisted-49a00a78/) (LinkedIn) - 2 mins
|
|
* Answering questions from the signup sheet - 13 mins
|
|
* Questions from the participants - 10 mins
|
|
* Closing remarks - 5 mins
|
|
|
|
## 06/26/20
|
|
|
|
[Recording](https://bluejeans.com/s/yILyR/)
|
|
|
|
Agenda
|
|
* Quick intro - 5 mins
|
|
* Onboarding Data Process entity by [Liangjun Jiang](https://github.com/liangjun-jiang) (Expedia) - 15 mins
|
|
* How to onboard a new relationship to metadata graph by [Kerem Sahin](https://github.com/keremsahin1) (Linkedin) - 15 mins
|
|
* Answering questions from the signup sheet - 15 mins
|
|
* Questions from the participants - 10 mins
|
|
* Closing remarks - 5 mins
|
|
|
|
## 05/29/20
|
|
|
|
[Recording](https://bluejeans.com/s/GCAzY)
|
|
|
|
Agenda
|
|
* Quick intro - 5 mins
|
|
* How to add a new aspect/feature for an existing entity in UI by [Charlie Tran](https://www.linkedin.com/in/charlie-tran/) (LinkedIn) - 10 mins
|
|
* How to search over a new field by [Jyoti Wadhwani](https://www.linkedin.com/in/jyotiwadhwani/) (LinkedIn) - 10 mins
|
|
* Answering questions from the signup sheet - 15 mins
|
|
* Questions from the participants - 10 mins
|
|
* Closing remarks - 5 mins
|
|
|
|
## 04/17/20
|
|
|
|
[Recording](https://bluejeans.com/s/eYRD4)
|
|
|
|
Agenda
|
|
* Quick intro - 5 mins
|
|
* [DataHub Journey with Expedia Group](https://www.youtube.com/watch?v=ajcRdB22s5o&ab_channel=ArunVasudevan) by [Arun Vasudevan](https://www.linkedin.com/in/arun-vasudevan-55117368/) (Expedia) - 10 mins
|
|
* Deploying DataHub using Nix by [Larry Luo](https://github.com/clojurians-org) (Shanghai HuaRui Bank) - 10 mins
|
|
* Answering questions from the signup sheet - 15 mins
|
|
* Questions from the participants - 10 mins
|
|
* Closing remarks - 5 mins
|
|
|
|
## 04/03/20
|
|
|
|
[Recording](https://bluejeans.com/s/vzYpa)
|
|
|
|
[Q&A](https://docs.google.com/document/d/1ChF9jiJWv9wj3HLLkFYRg7NSYg8Kb0PT7COd7Hf9Zpk/edit?usp=sharing)
|
|
|
|
- Agenda
|
|
* Quick intro - 5 mins
|
|
* Creating Helm charts for deploying DataHub on Kubernetes by [Bharat Akkinepalli](https://www.linkedin.com/in/bharat-akkinepalli-ba0b7223/) (ThoughtWorks) - 10 mins
|
|
* How to onboard a new metadata aspect by [Mars Lan](https://www.linkedin.com/in/marslan) (LinkedIn) - 10 mins
|
|
* Answering questions from the signup sheet - 15 mins
|
|
* Questions from the participants - 10 mins
|
|
* Closing remarks - 5 mins
|
|
|
|
## 03/20/20
|
|
|
|
[Recording](https://bluejeans.com/s/FSKEF)
|
|
|
|
[Q&A](https://docs.google.com/document/d/1vQ6tAGXsVafnPIcZv1GSYgnTJJXFOACa1aWzOQjiGHI/edit)
|
|
|
|
Agenda
|
|
* Quick intro - 5 mins
|
|
* Internal DataHub demo - 10 mins
|
|
* What's coming up next for DataHub (what roadmap items we are working on) - 10 mins
|
|
* Answering questions from the signup sheet - 15 mins
|
|
* Questions from the participants - 10 mins
|
|
* Closing remarks - 5 mins
|
|
|
|
## 03/06/20
|
|
|
|
[Recording](https://bluejeans.com/s/vULMG)
|
|
|
|
[Q&A](https://docs.google.com/document/d/1N_VGqlH9CD-54LBsVlpcK2Cf2Mgmuzq79EvN9qgBqtQ/edit)
|
|
|