Nov 2021 - Present | Bellevue, WA
- Designed and ran large-scale A/B and quasi-experiments to evaluate new product features, directly informing multi-billion-dollar revenue decisions.
- Defined and operationalized north-star metrics for ad quality and user experience that became standards across product and engineering teams.
- Built production data pipelines in SQL and Python to integrate surveys with experimentation, enabling self-serve analytics at org scale.
- Partnered with product and engineering on trust and safety systems to balance fraud risk, implementation cost, and customer experience.
- Deployed large language model pipelines to classify millions of pieces of user feedback, creating new quality signals for ranking models.
- Delivered dashboards that merged behavioral data, surveys, and ML outputs, adopted by hundreds of stakeholders for decision-making.
- Served on the Ads core leadership team, shaping strategy and execution for a group responsible for a significant share of company revenue.