From "data dump" to managed asset
In modern enterprise environments, accumulating data without clear rules leads to storage sprawl—uncontrolled cloud cost growth and increased compliance complexity. According to the FinOps Framework, effective cost management requires shared responsibility between IT, finance, and business units. Moving away from reactive approaches toward declarative policies allows for the automation of the information lifecycle, transforming data from a costly "data dump" into a structured asset.
Archive as code architecture: a declarative approach
The "Archive as Code" concept implies that retention policies, access rights, and audit requirements are defined directly as metadata. This enables the implementation of automated tiering strategies: moving data between "hot" and "cold" storage levels based on its relevance. As AWS experts note, automation allows for efficient data lifecycle management, ensuring recovery on demand while maintaining controlled costs. Microsoft also emphasizes that modeling costs at the design stage is significantly more effective than attempting optimization after resources have been deployed.
UnityBase as a foundation for automation
The UnityBase platform, developed by the Intecracy Group alliance of independent companies, provides the technical foundation for implementing an Archive as Code approach. Since UnityBase is based on domain metadata modeling, retention policies, role-based access control (RBAC), and row-level security (RLS) are integral parts of the system architecture rather than external configurations. Products built on this platform, such as Megapolis.DocNet, utilize these mechanisms to automatically manage archives, including setting retention periods and restricting access to historical records, which is critical for meeting regulatory requirements.
Control and audit compliance
Automating the deletion of data once its retention period has expired minimizes the footprint of "dark data" and reduces security risks. In systems based on UnityBase, declarative policies allow access to audit logs to be restricted to authorized personnel only, ensuring infrastructure integrity. When audit rules are integrated into the data model, it creates a transparent and secure audit trail, simplifying the audit process without requiring manual intervention from engineers.
| Maturity level | Data management characteristics |
|---|---|
| Level 1: Manual management | Indefinite storage, high audit risk. |
| Level 2: Reactive optimization | Episodic cleanup, manual access configuration. |
| Level 3: Automated lifecycle | Automated data movement (hot/cold/archive). |
| Level 4: Archive as Code | Policies in metadata, automated compliance execution. |
FAQ
How to calculate ROI from implementing an Archive as Code strategy?
ROI is determined by reducing storage costs for "dark data," decreasing man-hours spent on manual archive management, and mitigating risks associated with audit non-compliance.
Can data deletion be automated without violating audit requirements?
Yes, if retention periods are clearly defined in object metadata. The system performs deletion automatically after the expiration date, logging the event in the audit trail.
How to integrate retention policies into an existing architecture without migration?
You can overlay the UnityBase metadata model onto the current data structure via the platform's ORM layer, gradually implementing retention rules for new objects.
Data sources
- FinOps Foundation: FinOps Framework
- Microsoft: Azure Well-Architected — Cost Optimization
- aws.amazon.com: Automated cost-effective archiving and on-demand data restoration | AWS Storage Blog
- vertexaisearch.cloud.google.com: ПРОЦЕСИ ТА МЕТОДИ ОПТИМІЗАЦІЇ ВИТРАТ У СИСТЕМІ ЗАВДАНЬ УПРАВЛІННЯ ПІ
- hsdl.org: Security Guidance for 5G Cloud Infrastructures Part IV: Ensure Integrity of Cloud Infrastructure - Homeland Security