AB Test Principal

Papaya is a mobile games company looking for a sharp and passionate AB Test Principal to join our top-notch Analytics Department.

As an AB Test Principal at Papaya, you will work with our data teams to identify key opportunities for AB testing, optimize our testing methodologies, and enhance our decision-making processes through rigorous experimentation. You will devise, implement, and execute initiatives and strategies to grow our AB testing capabilities to maximize Papaya's potential.

This role is embedded within our Analytics department and requires a blend of analytical prowess, creative thinking, cross-functional collaboration, and the responsibility to challenge and innovate upon current AB testing methods. Success in this role directly impacts our product, monetization & marketing goals, and we reward results-driven performance.

To ensure success, you should be skilled at designing and analyzing AB tests, writing & debugging SQL & Python scripts, implementing advanced statistical methodologies, and passionate about optimizing business processes across all departments. You should also be able to lead & instruct other Analytics personnel to tailor AB testing solutions to different markets, scenarios, products, and goals.

Requirements:

At least 5+ years of hands-on work experience analyzing large datasets in data-related roles.
Significant experience in SQL & BI Visualization tools (Tableau/Looker).
Significant experience in AB testing analysis and leadership, preferably in a B2C company.
Experience with Python Analysis (Pandas, SciPy, NumPy, Matplotlib, Seaborn).
2+ years of direct management experience of Business Analysts - Advantage.
2+ years of work experience in a project/product management role - Advantage.
B.A. / B.Sc. in Industrial Engineering, Math, Statistics, Computer Science, or an equivalent background.
Previous experience in the gaming industry – Big Advantage.

Responsibilities:

Standardization & Optimization:

Establish contingency plans and backup strategies to mitigate unforeseen challenges or failures during AB testing, ensuring the smooth execution of planned tests.
Conduct training sessions and workshops to disseminate technical knowledge and foster a culture of analytical excellence in AB testing across the department.
Lead the implementation of standardized AB testing processes and systems to ensure collaboration and synergy (Pycharm & BQ, Mixpanel, Jira, AppEvents Structure, etc.).
Establish quality assurance protocols for AB testing and reporting, ensuring consistency and accuracy throughout the company's analytics practices.
Facilitate the documentation of AB testing methodologies, frameworks, and best practices to promote knowledge sharing within the department (Confluence, Showcase, User Stories, etc.).

Hands-On Complex Cross-Department Projects:

Lead AB testing projects across various departments, ensuring alignment with organizational objectives and timelines.
Design, implement, and analyze complex AB tests to extract meaningful insights and trends, leveraging various analytics tools and methodologies.
Provide technical guidance and support to all data professionals in navigating complex technical and analytical challenges related to AB testing, enabling them to deliver high-quality solutions.

Innovation:

Drive innovation within the AB testing framework by exploring emerging technologies and methodologies, recommending their adoption where appropriate to enhance efficiency and effectiveness.
Collaborate closely with all department teams to understand their unique data requirements, ensuring that AB testing solutions are tailored to the diverse business needs.