Database data processing and space usage optimization

Project goals:

• Remediate space shortage for a 120+ TB database
• Optimize data processing in the database, tune the system performance
• Develop DB backup solution

Accomplishments:

• The database size has been reduced by 60% by reclaiming unusable space
• The data processing approach has been changed, implementing External Tables, to avoid unnecessary DB operations. This allowed to speed up data ingestion processes by 40%
• A logical backup solution has been developed to suit the company’s target KPIs

Technologies:

• Oracle Database
• Oracle Linux
• Oracle PL/SQL

Workload:

• 50 hours

Project team:

• Senior Oracle DBA