Submit feedback on
Duplicate Storage of Logs in Cloud Logging
We've received your feedback.
Thanks for reaching out!
Oops! Something went wrong while submitting the form.
Close
Duplicate Storage of Logs in Cloud Logging
Yuval Goldstein
CER:
GCP-Other-9482
Service Category
Other
Cloud Provider
GCP
Service Name
GCP Cloud Logging
Inefficiency Type
Redundant Log Routing Configuration
Explanation

Duplicate log storage occurs when multiple sinks capture the same log data — for example, organization-wide sinks exporting all logs to Cloud Storage and project-level sinks doing the same. This redundancy results in paying twice (or more) for identical data. It often arises from decentralized logging configurations, inherited policies, or unclear ownership between teams. The problem is compounded when logs are routed both to Cloud Logging and external observability platforms, creating parallel ingestion streams and double billing.

Relevant Billing Model

Cloud Logging charges separately for data ingestion and for storage in each destination. When logs are routed to multiple sinks with overlapping filters, organizations pay duplicate ingestion and storage costs for the same log entries. These costs scale linearly with the number of redundant destinations.

Detection
  • Analyze log sink filters across projects, folders, and the organization to identify overlapping export scopes
  • Review log destinations to confirm whether the same log types are stored in multiple buckets or BigQuery datasets
  • Assess whether central and project-level teams maintain independent sinks that duplicate the same data
  • Determine if redundant routing exists between Cloud Logging and external observability or SIEM platforms
Remediation
  • Consolidate log routing and ensure filters define mutually exclusive export scopes
  • Remove or disable redundant sinks that replicate the same logs to multiple destinations
  • Implement centralized governance for sink management to avoid overlapping configurations across projects
  • Periodically audit all sinks at the organization level to ensure routing remains efficient and non-duplicative
Relevant Documentation
  • Managing Sinks in Cloud Logging
Submit Feedback