About this role
In this role, you will:
Build and maintain the Behavior Evaluation data pipelines (PySpark/zspark medallion architecture on Databricks, EMR Serverless and Airflow) that produce weekly per-geofence estimates.
Turn the statistical method (sampling, triage weights, mileage sharing, projections) into tested, reproducible code with checks that fail loudly when the data is bad.
Build tools that cut the manual work in each weekly run.
Work with cross functional stakeholders so the methodology is applied consistently in code and in clearance reports.
Help adapt to new release methodologies and new geofences.
Qualifications:
7 - 9 Years of experience or 5+ years with a strong data-platform track record
Expert Python, with production experience in PySpark/Spark and Pandas
Experience designing scalable batch data pipelines: orchestration, Delta/lakehouse tables, idempotent backfills
Solid grounding in applied statistics: sampling, weighting, estimators, confidence intervals
Strong testing and CI habits for data code
Bonus Qualifications:
Experience with autonomous-vehicle simulation, safety metrics or triage workflows
Experience putting ML models into production in a data pipeline
Experience with Databricks and AWS (EMR Serverless, S3)
