Posts

Showing posts with the label data purge

A New Collection of Thoughtful Learning Apps — Now Available on iOS & Android

Image
I’m excited to share a set of mobile apps I’ve recently completed and published on both the Google Play Store and the Apple App Store. These apps are designed with a simple goal in mind: to make meaningful, structured content more accessible, whether you’re studying theology or improving your English vocabulary. 📱 Now Available on Both Platforms All apps are live and available for download: Google Play Developer Page: https://play.google.com/store/apps/dev?id=5835943159853189043 Apple App Store Developer Page: https://apps.apple.com/ca/developer/q-z-l-corp/id1888794100 📖 Theology & Confession Study Apps For those interested in Reformed theology and classical Christian teachings, I’ve developed a series of apps that present foundational texts in a clean, focused reading format: The Belgic Confession Canons of Dort Heidelberg Catechism Westminster Shorter Catechism Each app is designed to provide a distraction-free experience, making it easier to read, reflect, and revisit these im...

A Lesson Learned: Slow DELETE Caused by Missing FK Indexes

Image
A Lesson Learned: Slow DELETE Caused by Missing FK Indexes Recently, I was working on a data purge task. The logic itself was simple: delete old records based on certain conditions. I had done similar work before, so I did not expect any major issues. However, this time the DELETE operation got stuck . No errors were reported, but the SQL just kept running without making progress. What Happened? With help from our DBA, we started investigating the issue at the database level. After some analysis, we identified the root cause: Several foreign key (FK) columns were missing supporting indexes. Because of this, every DELETE on a parent table forced Oracle to perform full table scans on related child tables to validate referential integrity. As data volume increased, the performance impact became severe. The Fix After adding indexes on the missing foreign key columns (across related tables), the results were immediate: DELETE operations completed much faster ...

Safe Data Purge: How We Remove Old Records in Large Oracle Tables

Image
Safe Data Purge: How We Remove Old Records in Large Oracle Tables At our company, we periodically purge old data to comply with data retention regulations. Deleting millions of rows from production databases requires careful planning. Here's how we do it. Step 1: Catalog and Plan Catalog all tables and identify retention periods. Review retention schedule with legal team. Coordinate with other teams to identify downstream dependencies. Step 2: Backup Tables Always backup affected tables before deleting. This ensures quick recovery in case of unexpected issues. Step 3: Understand Table Structure Identify child tables and parent tables. Delete child tables first to avoid foreign key violations. Step 4: Batch Deletes vs Direct Deletes We tested batch deletes in our PT environment and it worked fine. However, in production: Tables have 7M+ rows and 1M+ rows to delete Batch of 20K rows...