About the role
Headquarters:
Overview
A fast-growing AI evaluation company is building expert-level benchmarks that test how well AI agents handle real professional work in the terminal. We are hiring cryptography experts to turn real, paid tasks from their own work into end-to-end challenges for AI agents, each with a working solution and a check that proves the result is correct.
***THIS IS A TASK BASED COMPENSATION MODEL. PLEASE CHECK THE APPLICATION QUESTIONS FOR MORE DETAILS.***
Responsibilities
• Design expert-level Terminal-Bench cryptography tasks by turning real, paid work from your own experience into challenges that an AI agent must solve end to end.
• Define the task environment, including files, systems, ciphertexts and data, so the challenge is realistic, self-contained and reproducible in a Linux command-line setup.
• Write a working reference solution in Python or SageMath that proves the task is solvable, for example by recovering a key or decrypting a secret.
• Build automated checks and tests that objectively verify the final result is correct, and explain how a mistake or a partial answer would be detected.
• Calibrate task difficulty so a typical expert needs about 60-75 minutes to solve it, keeping it hard for AI agents while still fair and unambiguous.
• Package each task with Docker and Git where applicable, document instructions clearly, and revise based on reviewer feedback until it meets the required quality bar.
Skills/Experience
• 3+ years of hands-on cryptanalysis or applied cryptography; GRC, audit-only, policy, sales or management roles do not count, nor does coursework only
• Did the work in the last 3 years and can name the systems, tools, data and rules used
• Uses the low-level tools of the subfield, such as SageMath and Python, and works comfortably on the Linux command line
• Can show how a finding is proven, such as a decrypted secret or a recovered key, and explain how a mistake would be caught
• Technical fluency with files, CSV/JSON, APIs or databases
• Available to start around November 2026
Nice-to-have
• Published write-ups or research on cryptanalysis
• Strong CTF results, especially in crypto categories
• CVEs discovered in cryptographic implementations
• Experience with Docker, Git and writing automated tests
• Proficiency in C for low-level cryptographic work
Process
• Task vetting: complete a vetting task instead of a live interview
• Work is paid per task, with each task taking roughly 60-75 minutes
• Expected start around early November 2026
To apply: https://weworkremotely.com/remote-jobs/toptal-cryptography-specialist-for-ai-lab