Sujit J FulseSpark In Depth: Group by with Case statementI recently encountered a complex problem while working on my project. I needed to group the data for a my use case, which involved several…Feb 242Feb 242
Sujit J FulseMastering Data Engineering: A breakdown of Data Pipeline Stages and ToolsThe market is flooded with numerous data engineering tools due to the exponential increase in data volumes. Starting a career as a Data…Feb 134Feb 134
Sujit J FulseOptimise an Already Optimised Heavy Spark Job with Long Lineage.Upon receiving the initial requirement to write a Spark job , you inquired about the volume of data that the job would be processing. The…Jan 273Jan 273
Sujit J FulseEvaluating KPI Dashboards to Increase ROI for Data Engineering Products — I“Uncover the ROI: Evaluating Data Processing and Storage Costs for KPI Dashboards” -Jan 27Jan 27