Optimizing JobTarget’s Data Lake: Migrating to Hudi, a Serverless Architecture, and Templated Glue Jobs‍

Optimizing JobTarget’s Data Lake: Migrating to Hudi, a Serverless Architecture, and Templated Glue Jobs‍

by
Floyd Smith
In this talk from Open Source Data Summit, Soumil Shah of JobTarget shares how his team implemented Apache Hudi-based data lakes, templated AWS Glue jobs, and a serverless architecture to manage scale, resources, and performance in the face of rapid growth.

Filters

Clear All
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Meet the Residents of Onehouse - Andy Walner!
Residents

Meet the Residents of Onehouse - Andy Walner!

Andy Walner
July 26, 2023
Apply Pre-Commit Validation for Data Quality in Apache Hudi 
Hudi

Apply Pre-Commit Validation for Data Quality in Apache Hudi 

Aditya Goenka
July 20, 2023
The Ultimate Data Lakehouse for Streaming Data Using Onehouse + Confluent
Product

The Ultimate Data Lakehouse for Streaming Data Using Onehouse + Confluent

Andy Walner
July 18, 2023
Knowing Your Data Partitioning Vices on the Data Lakehouse
Hudi

Knowing Your Data Partitioning Vices on the Data Lakehouse

Bhavani Sudha Saktheeswaran
July 12, 2023
The Road to an Open and Interoperable Lakehouse
Announcements

The Road to an Open and Interoperable Lakehouse

Kyle Weller
July 10, 2023
Integrating Onehouse with the Amazon Sagemaker Machine Learning Ecosystem
Solutions

Integrating Onehouse with the Amazon Sagemaker Machine Learning Ecosystem

Chandra Krishnan
July 7, 2023
Optimize Costs by Migrating ELT from Cloud Data Warehouses to Data Lakehouses
Solutions

Optimize Costs by Migrating ELT from Cloud Data Warehouses to Data Lakehouses

Po Hong
June 30, 2023
Exploring New Frontiers: How Apache Flink, Apache Hudi and Presto Power New Insights at Scale
Hudi

Exploring New Frontiers: How Apache Flink, Apache Hudi and Presto Power New Insights at Scale

Nadine Farah
June 16, 2023
Building a Data Lakehouse: Managed vs. Do-it-Yourself
Product

Building a Data Lakehouse: Managed vs. Do-it-Yourself

Andy Walner
June 8, 2023

No result found.

Subscribe to the Blog

Be the first to read new posts

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Try it Free

Meet with us to start your trial.
‍
Oops! Something went wrong while submitting the form.
Resources
GlossarySolution GuidesWebinars
Contact
info@onehouse.ai
2550 Sand Hill Rd, Suite 200
Menlo Park, CA, 94025
© 2024 Onehouse. All rights reserved.