Description du poste
Experience with Apache Iceberg (or a comparable open table format) on object storage such as R2 or S3 Experience with ClickHouse or a comparable columnar analytical database Strong SQL, including window functions, query optimization, and performance tuning on large datasets Strong Python for data engineering, including testing and maintainable, well-structured code Hands-on experience with Apache Airflow in production, including Kubernetes-hosted deployments Clear communication and the ability to turn ambiguous requirements from researchers and analysts into well-defined data products Experience with CI/CD, version control, and containerized deployments Proven experience building analytical data stores and data marts, including data modeling, partitioning, and schema evolution Experience with distributed data processing (e.g. Spark or similar) at large scale 7+ years of experience designing, building, and operating scalable production data pipelines Experience using AI-assisted development tools as part of your workflow Experience with Cloudflare’s developer platform (Workers, R2, R2 Data Catalog) Trino/Presto or other distributed query engines Experience supporting data science or ML workflows (feature stores, training datasets) Solid understanding of how the Internet works (DNS, HTTP, TLS, BGP) Experience with security, threat intelligence, fraud, or trust & safety / abuse data
Cloudforce One is Cloudflare’s threat operations and research team, responsible for identifying and disrupting cyber threats ranging from sophisticated cyber criminal activity to nation-state sponsored advanced persistent threats (APTs) Members of Cloudforce One are at the helm of leveraging an incredibly vast and varied set of data points that only one of the world’s largest global networks can provide The team is able to analyze these unique data points, at massive scale and efficiency, synthesizing findings into actionable threat intelligence to better protect our customers You will join the data science team within Cloudforce One. We power much of the insight and intelligence delivered in Cloudflare’s Threat Events product, which customers can use to better protect themselves — for example, by turning our threat indicators into real-time WAF rules We own data pipelines that power analysis of Cloudflare’s DDoS and WAF data, including Cloudflare’s quarterly DDoS Threat Report. We also support internal Trust & Safety initiatives such as identifying and addressing network abuse, and collaborate directly with the Threat Intelligence team As a Data Engineer, you will build the data foundation that makes this possible: designing and operating the scalable pipelines, analytical data stores, and data marts that turn raw Cloudflare telemetry into trusted, well-modeled datasets for threat researchers, data scientists, analysts, and customers This role may require flexibility to be on-call outside of standard working hours to address technical issues as needed Design, build, and operate scalable batch data pipelines on Kubernetes-hosted Airflow and Spark clusters that extract, enrich, and publish threat and abuse signals from Cloudflare’s network and platform telemetry Build and evolve our data stores in Apache Iceberg (R2) and the curated data marts that serve Threat Events, Trust & Safety initiatives, and Threat Intelligence investigations Model datasets deliberately — choosing grain, partitioning, and schema evolution strategies that keep data correct, queryable, and cost-efficient Write and optimize SQL against large-scale analytical data in ClickHouse, balancing completeness, performance, and cost Make pipelines safe to retry, resume, and backfill, so downstream consumers receive exactly the data we intend to publish Build data quality checks, reconciliation, and monitoring that catch problems before they reach analysts, detections, or customers Treat privacy and data minimization as design requirements from the start Enable Threat Intelligence and Trust & Safety partners with the data they need for tooling and investigations, translating ad hoc requests into reusable datasets Partner with data scientists to turn exploratory analysis into repeatable, production-quality data products and ML-ready datasets Raise the team’s engineering bar through code review, testing, CI/CD, and documentation Benefits Competitive pay: We offer a competitive total rewards package, where every employee is an owner of our stock. Take-what-you-need vacation: We encourage employees to find a comfortable work-life balance by taking as many days off as they need while still being able to perform their jobs satisfactorily. (We really mean it!) Paid maternity & paternity leave: Our global parental leave policy allows up to sixteen paid weeks of bonding leave time for all qualifying new parents. Employee benefits: We offer a comprehensive benefits package including healthcare, life insurance, short- and long-term disability, pension plans in