Senior Software Engineer (Risk)

Join Replit, a leading AI-native platform, as a Senior Software Engineer in the Risk team. In this role, you will be at the forefront of defending the platform from exploitation, detecting and shutting down phishing deployments, preventing cryptomining, and stopping LLM token farming. You will own problems end-to-end, from identifying emerging abuse patterns to shipping the systems that stop them at scale. This is a unique opportunity to work on adversarial problems that barely exist elsewhere, using AI as a defensive tool against abuse.

• Concevoir et mettre en œuvre des garde-fous pour les modèles de langage (LLM) qui détectent les scénarios d'abus dans le code généré par l'IA et les interactions des agents.
• Construire des systèmes de détection alimentés par l'IA qui utilisent les LLM pour identifier les modèles malveillants, classifier les menaces et automatiser les décisions de réponse.
• Posséder l'ensemble du cycle de vie de la réponse aux abus : détection, enquête, application et gestion des appels en collaboration avec le support et le juridique.
• If you want hands-on experience applying AI to security problems, this is one of the few places you can do it in production with real attackers
• Ability to investigate complex abuse patterns and translate findings into automated defenses
• Experience building or fine-tuning ML/LLM-based classifiers for security or abuse detection
• Familiarity with common attack patterns: phishing infrastructure, account takeover, credential stuffing, resource abuse
• Experience with SQL and data analysis at scale (BigQuery, Snowflake, or similar)
• Clear communication skills for working across Security, Support, Legal, and Engineering teams
• Familiarity with prompt injection, jailbreaking, and other LLM-specific attack vectors
• 4+ years of experience in security engineering, anti-abuse, trust & safety, or fraud detection
• Strong programming skills in Python and/or TypeScript for building detection systems and automation
• Experience at a platform company dealing with user-generated content or compute abuse (hosting providers, cloud platforms, developer tools)
• Familiarity with device fingerprinting, IP reputation, and email validation services
• Background in fraud detection, payment abuse, or financial crime
• Knowledge of container security, Linux internals, or cloud infrastructure (GCP preferred)
• Experience with CI/CD security tooling (SAST, SCA, Dependabot, Snyk)
• Prior work with abuse reporting pipelines, trust & safety tooling, or content moderation systems