Sujit J FulseSpark In Depth: Group by with Case statementI recently encountered a complex problem while working on my project. I needed to group the data for a my use case, which involved several…2 min read·Feb 24, 2024--2--2
Sujit J FulseMastering Data Engineering: A breakdown of Data Pipeline Stages and ToolsThe market is flooded with numerous data engineering tools due to the exponential increase in data volumes. Starting a career as a Data…7 min read·Feb 13, 2024--2--2
Sujit J FulseOptimise an Already Optimised Heavy Spark Job with Long Lineage.Upon receiving the initial requirement to write a Spark job , you inquired about the volume of data that the job would be processing. The…5 min read·Jan 27, 2024--2--2
Sujit J FulseEvaluating KPI Dashboards to Increase ROI for Data Engineering Products — I“Uncover the ROI: Evaluating Data Processing and Storage Costs for KPI Dashboards” -3 min read·Jan 27, 2024----