From Backend Services to Data Pipelines: Choosing the Right Architecture for the Job

Ever wondered what the opposite of a highly distributed, high-load service looks like? My team owned a backend service performing royalty calculations under low load but with heavy memory usage. It was still poor fit for a traditional service architecture so we migrated it to a data pipeline, reducing resource overhead and aligning better with its workload. In this talk, I'll share how we identified the misalignment, the trade-offs we considered, and the benefits of the migration.
 
Key Takeaways:

• What are the differences between backend services and data pipelines
• When should you use them
• Tips and tricks to improve performance 

This session is for... Beginners to backend or data pipelines, engineers with backend services under heavy load, engineers deciding on their new architecture.