Member of Technical Staff, Post-Training
San Francisco, United States · Hybrid · Full-time
- Posted 2w ago
- From Handshake’s careers page
- Location
- San Francisco, United States
- Work mode
- Hybrid
- Type
- Full-time
- Experience
- 3+ years
- Department
- Engineering
Opens the listing on jobs.ashbyhq.com
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
The Role
We are hiring a Member of Technical Staff, Post-Training to help define and build this new organization. This is a broad, high-ownership role for researchers who build. You may come from research science, research engineering, machine learning engineering, or a closely related background; what matters is the ability to reason deeply about model improvement and turn that reasoning into reliable systems.
You will partner with researchers, domain experts, and customers to turn ambiguous post-training questions into experiments, evaluation frameworks, data pipelines, and products. Early members of the team will have unusual influence over our technical direction, operating culture, and the reusable systems we build.
We care more about demonstrated research capability, technical judgment, and a builder’s mindset than a specific title, degree, or career path.
What you’ll do
-
Design post-training systems and methodologies for frontier models, including supervised fine-tuning, reinforcement learning, preference optimization, reward modeling, and related approaches.
-
Translate open-ended research or partner needs into clear hypotheses, experiments, evaluation plans, and production-quality implementations.
-
Build and improve evaluation frameworks, benchmarks, training environments, data-processing pipelines, and quality-control systems.
-
Run fast, rigorous iteration loops: prototype, evaluate, interpret results, and turn learnings into the next system or product.
-
Partner directly with AI researchers and domain experts to develop high-signal data, feedback, and evaluation methods.
-
Identify repeatable patterns across engagements and productize them into reusable software and platforms.
-
Raise the technical bar through strong design judgment, clear communication, code quality, and mentorship.
-
Contribute to the field through benchmarks, open-source tools, research, and technical writing where it creates leverage.
What we’re looking for
-
3+ years of demonstrated strength in post-training, fine-tuning, or model-evaluation work. Relevant experience may include RL, SFT, LoRA/PEFT, full fine-tuning, RLHF, DPO, PPO, reward modeling, or training environments.
-
Strong Python skills and the ability to write clean, efficient, scalable software.
-
Hands-on experience with modern ML tooling, particularly PyTorch and large-scale data, training, or evaluation workflows.
-
Sound experimental judgment: you can form hypotheses, choose meaningful metrics, diagnose failures, and distinguish signal from noise.
-
Experience designing systems—not only implementing specifications—including the ability to make tradeoffs around quality, scale, reliability, and reuse.
-
Comfort operating in an ambiguous, fast-moving environment with substantial ownership.
-
Collaborative, low-ego communication and the ability to work effectively with researchers, engineers, domain experts, and customers.
Skills they ask for
Pick one to see other roles that ask for it.
About Handshake
The career network for the AI economyHandshake operates a career network connecting job seekers, employers and career centers, with a focus on the AI economy.
See all 64 roles at HandshakeMore roles at Handshake
See all 64- Member of Technical Staff, Coding AgentsSan FranciscoResearch and Development (R&D)San Francisco, United States8h
- Partnerships Lead - Integrations & EcosystemUnited States · Lead · RemoteBusiness Development · Lead · RemoteUnited States9h
- Member of Technical Staff, Post-Training (India)Bengaluru · On-siteResearch and Development (R&D) · On-siteBengaluru, India10h
- Member of Technical Staff, AI Engineering (India)Bengaluru · On-siteEngineering · On-siteBengaluru, India10h
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.