Major Swiss Bank

Creating a new data pipeline for collateral risk calculations to improve the quality of data information and reporting for end users

Challenge

• Risk calculations on collaterals provided daily to end-users through dashboard
• Need to leverage this risk calculation data model for reporting purposes
• Difficult to identify which data would be required for reporting, and to accurately provide it through previously-built pipeline that wasn’t sustainable

Solution

• Initial discussion to fully understand data sources and existing data flows
• Created new pipeline to extend the already existing data model by including specific information
• Identifying- and providing solutions to issues in the current codebase which introduce data quality issues
• Provide guidelines to prevent similar issues from reoccurring

Business Impact

• Improved data quality of the reports by onboarding the data on the main data processing platform through the newly built pipeline
• Enabled client team to improve and learn by giving tips and providing guidelines
• Reduced disk spillage per TB of data from 50GB to less than 100MB