Software Engineer – AI Code Evaluation & LLM Training

About Us We are a Canadian-built technology company operating in the CRM and marketing technology space. Our platform helps businesses manage, analyze, and activate customer data at scale. We build solutions that process millions of records, enabling organizations to improve customer engagement, marketing automation, and data-driven decision-making. As we expand our AI capabilities, we are looking for talented Software Engineers to help shape the future of AI-powered development tools and enterprise software solutions. Role Overview We are seeking experienced Software Engineers to support cutting-edge AI model training and evaluation projects. You will work closely with AI researchers and engineering teams to improve large language models (LLMs) by creating high-quality coding datasets, evaluating AI-generated solutions, and developing benchmarks for software engineering capabilities. This role is ideal for engineers who have designed, built, and shipped high-impact, production-grade systems in fast-moving technology environments. Experience at companies such as Stripe, Airbnb, Cloudflare, Datadog, Coinbase, or similar high-growth engineering organizations is highly valued. Real-world engineering experience, technical depth, and demonstrated impact matter most. Responsibilities Create and curate high-quality software engineering datasets for LLM training and benchmarking. Develop, review, and improve code examples across: Python C/C++ Rust Go Java JavaScript / ReactJS Evaluate AI-generated code for: Correctness Performance Scalability Reliability Maintainability Analyze systems-level, backend, and infrastructure code to identify: Bugs Performance bottlenecks Design issues Improvement opportunities Develop evaluation frameworks and verification methods to measure AI coding capabilities. Design automated approaches to validate software engineering solutions. Collaborate with AI researchers and engineers to improve AI-driven coding systems. Evaluate software engineering workflows across the full development lifecycle: Prototyping Architecture design API design Production implementation Testing and experimentation Monitoring and operational maintenance Typical Day Your work may include: Reviewing AI-generated code and providing detailed technical evaluations. Creating challenging software engineering problems and reference implementations. Improving benchmark datasets for coding agents and AI assistants. Designing verification workflows to measure code quality and reliability. Partnering with research teams to identify model limitations and improve AI performance. Required Qualifications 3+ years of professional software engineering experience. Strong background in backend engineering, infrastructure, distributed systems, or systems programming. Strong proficiency in one or more of the following: Python C/C++ Rust Go Java JavaScript / ReactJS Experience designing and deploying scalable, production-grade software. Strong understanding of: Software architecture System design Debugging Code review practices Engineering best practices Ability to communicate complex technical reasoning clearly through written evaluations and documentation. Preferred Qualifications Experience building large-scale distributed systems or developer infrastructure. Experience with performance optimization and low-level programming. Experience working with: AI/ML systems Large Language Models (LLMs) AI coding assistants Developer productivity tools Experience reviewing complex enterprise production codebases. Background working at high-growth technology companies or engineering-intensive environments. Experience with CRM, marketing technology, customer data platforms, or enterprise SaaS is a plus.