Insights

    AI Security

    Cloudflare's log transformers move data minimisation to the export boundary

    Devence Lab

    · 2 min read

    Share
    Cloudflare's log transformers move data minimisation to the export boundary
    Photograph · Unsplash, https://unsplash.com/photos/1558494949-ef010cbdcc31

    Cloudflare's new Logpush transformations can redact and filter events before export. Security teams must validate what disappears, preserve investigative context and govern every change.

    Cloudflare has introduced Transformers for Logpush, allowing customers to filter, reshape and redact log events before export using SQL. The company says the feature is powered by Apache DataFusion. This changes where security teams can apply data minimisation: instead of shipping every field to a downstream analytics platform and cleaning it later, they can enforce selected transformations at the point of delivery.

    That placement is useful for high-volume security telemetry, but it also creates a new control plane. A mistaken filter can silently remove the evidence needed for an investigation. A redaction rule can protect personal information while also obscuring the identifiers needed to correlate a malicious session. The operational question is not whether transformation is available, but who controls it and how its effects are tested.

    Export-time controls change the evidence boundary

    Traditional log pipelines often ingest broadly and transform centrally. Moving processing upstream can reduce bandwidth, storage and exposure of sensitive fields. It can also make the exported dataset intentionally incomplete. Incident responders must know which fields were removed and whether an unmodified authoritative source still exists within an approved retention period.

    Treat every export transformation as a versioned policy. Record its owner, purpose, affected log sources, SQL expression and approval. Maintain a documented mapping between original event fields and the destination schema so detection engineers can distinguish genuine absence from deliberate suppression.

    A smaller log stream is only a security improvement when its missing evidence is intentional, measured and reversible where required.

    Test detections before changing production exports

    Run candidate transformations against representative historical events, including known attacks, benign administrative actions and edge cases. Compare event counts, key-field completeness and detection outcomes before and after processing. Include joins that rely on identity, device, network and request identifiers, because a field that looks expendable in isolation may be essential to correlation.

    Monitor pipeline health after rollout. Track source-versus-destination volumes, schema changes, parse failures and unexpected drops by log type. Alert on transformation changes themselves. Where supported, deploy new policies to a test destination first and retain a rollback path for production.

    Make privacy and forensics requirements explicit

    Redact secrets and unnecessary personal data before sending logs to external services, but avoid blanket removal of fields without a defined investigative use case. Agree retention and access rules with privacy, security operations and platform owners. If raw events must be preserved for legal or incident-response reasons, store them under stricter access rather than assuming a transformed export is sufficient.

    Cloudflare's announcement is a product capability, not evidence that any organisation's telemetry is automatically compliant or complete. Teams should validate supported sources, SQL semantics and failure behaviour against their own deployment before adopting it as a security control.

    Produced through Devence Lab's automated research and publishing workflow, without prepublication human review. Devence Lab retains editorial responsibility. Sources are linked; report factual errors to contact@devencelab.com.

    Sources

    1. Filter, reshape, and redact logs before export with Transformers · Cloudflare

    Written by the Devence Lab research team.

    Share