LogoLogo
  • Overview
    • Overview
    • Integration Modes
    • Minimum Required Dataset
    • Customer Service Desk
  • Netacea Plugin Information
    • Accessing Your Integration Settings
    • Akamai
      • Akamai Plugin Logic
      • Monitoring Configuration
      • Installation and Configuration
        • Proxy Property Configuration
        • EdgeWorker Installation
        • Property Configuration
          • Optional Integration Configuration
    • Cloudflare
      • Cloudflare Plugin Logic
      • Monitoring Configuration
      • Installation and Configuration
        • Installation via Wrangler (CLI)
        • Installation via Cloudflare UI
    • CloudFront
      • CloudFront Plugin Logic
      • Monitoring Configuration
      • Installation and Configuration
    • Fastly
      • Fastly Plugin Logic
      • Monitoring Configuration
      • Installation and Configuration
        • Advanced Configuration
        • Deployment via Terraform
    • Fastly Magento
      • Fastly/Magento Plugin Logic
      • Monitoring Configuration
      • Installation and Configuration
        • Advanced Configuration
    • F5
      • F5 Plugin Logic
      • Monitoring Configuration
      • Installation and Configuration
    • Vercel
      • Vercel Plugin Logic
      • Monitoring Configuration
      • Installation and Configuration
    • API Direct Integration
      • How to Build a Netacea Plugin
  • Netacea | Offline PoV Guide
    • Getting Started
    • Akamai DataStream 2
    • Amazon CloudFront
  • Fastly
  • Cloudflare
  • Universal Log Transfer
  • Netacea Data Sync
    • Data Sync
    • Recommendations
  • Captcha
    • reCAPTCHA User Journey
    • hCaptcha User Journey
    • Custom reCAPTCHA Page Guide
    • Custom hCaptcha Page Guide
Powered by GitBook

Copyright Netacea 2023

On this page
  • Cloudflare Logpush Setup
  • Prerequisites
  • Step-by-Step Configuration (Cloudflare Dashboard)
  • Netacea Minimum Dataset
  • Final Steps

Cloudflare

How to configure Cloudflare Logpush to deliver logs to Netacea for PoV analysis

Cloudflare Logpush Setup

To send real-time access logs from Cloudflare to an Amazon S3 bucket, you can configure Cloudflare Logpush, which enables efficient, near real-time delivery of batched HTTP request logs. Below are the documented steps required to set up Logpush streaming to a Netacea-hosted S3 bucket, using a field configuration that meets Netacea’s data requirements.

Prerequisites

To successfully stream web traffic logs to Netacea using Cloudflare Logpush, please ensure the following:

  • You are on a Cloudflare Enterprise plan.

  • You have access to the Cloudflare Dashboard for the relevant domain.

  • You have received the necessary AWS S3 bucket details (bucket name, region, path, and credentials) from Netacea. These can be found here.

  • You have shared your Cloudflare account details with Netacea, if requested, to support token validation.

  • You are aware of the minimum required dataset fields Netacea requires for analysis.

Step-by-Step Configuration (Cloudflare Dashboard)

  1. Log in to the Cloudflare Dashboard.

  2. Select the Enterprise domain you want to configure.

  3. Go to Analytics & Logs > Logpush.

  4. Click Create a Logpush Job.

Destination Setup

  • For Destination, choose Amazon S3.

  • Enter the following destination details (provided via the Netacea Portal):

    • Bucket name

    • Path (recommended: organise logs into daily subfolders)

    • Bucket Region (e.g., eu-west-1)

Bucket Access Policy

Netacea will configure and manage the S3 bucket and apply the required access policy to allow Cloudflare to upload logs.

No changes to the bucket policy are needed from your side.

Ownership Token Verification

  • Cloudflare will verify the destination by uploading an ownership token.

  • Netacea will retrieve this token from the bucket and return it to you.

  • Once received, paste the token into the Cloudflare Dashboard and click Continue.

Select Dataset and Fields

  • Choose HTTP Requests as the dataset.

  • Configure the job with the following details:

Job Name: Use a descriptive name (e.g., Netacea_Logpush).

  • Fields to Include:

    • EdgeEndTimestamp

    • ClientIP

    • ClientRequestUserAgent

    • ClientRequestMethod

    • ClientRequestPath

    • ClientRequestURI

    • EdgeResponseStatus

    • ClientRequestReferer

    • EdgeResponseBytes

    • JA3Hash

    • ClientRequestURI

    • ClientRequestProtocol

    • OriginResponseTime

JA3Hash is only available to Cloudflare Bot management customers

  • Click Submit to activate the job.

Netacea Minimum Dataset

The above log format will allow Netacea to collect the following minimum dataset for analysis

Required Fields
Description

Timestamp

The time at which the request was received

IP Address

The IP address from which the request was made

User Agent

The user agent string sent in the header by the client

Method

The HTTP method of the request

Path

The path of the requested resource

Query

The query string of the request

Status

The HTTP status code returned by the server

Referrer

The web page the user followed a link from

Bytes Sent

The Bytes sent as part of the servers response

Client JA3

Clients JA3 fingerprint

X-Forwarded-For*

Original IP address of a client request

CF-Connecting-IP*

Cloudflare’s trusted source of the original client IP

Host

The destination host of the request

Protocol

The protocol of the request

Request Time

The complete amount of time it took to process the request

* Useful for when proxies are in the line of traffic from client > origin

Final Steps

Once log delivery is active, notify your Netacea Solutions Engineer. This allows us to:

  • Confirm receipt of data

  • Validate the dataset format and completeness

  • Begin analysis once a sufficient volume of data has been collected

If you require support during setup, the Netacea SE team is here to help — don’t hesitate to reach out.

PreviousFastlyNextUniversal Log Transfer

Last updated 6 days ago