Immiland Canada

Research Engineer, Large Language Models

Canada full-time Mid Salary not listed
full-time Mid level Technology & IT Curated
Sign in to apply Free account — we bring you straight back to this role.

About the role

About the Role

We are hiring a Research Engineer to help train our next generation of large language models. You will design, run, and scale training experiments on thousands of GPUs, and turn research ideas into production-grade models.

You will join a small team of researchers and engineers who own the full model lifecycle: data, pre-training, post-training, and evaluation. Research and engineering are not separate here: you will write the code, run the experiments, and shape the conclusions.

Key Responsibilities – What You'll Do

Design and run large-scale pre-training and fine-tuning experiments, from small ablations to full training runs.

Study scaling laws to choose model size, data mix, and hyperparameters under a fixed compute budget.

Improve training efficiency through parallelism strategies (data, tensor, pipeline, FSDP), mixed precision, and custom CUDA or Triton kernels.

Diagnose and fix training instabilities such as loss spikes, divergence, and hardware failures.

Build and improve data pipelines, including filtering, deduplication, quality scoring, and dataset mixing.

Implement ideas from recent research papers and test whether they hold at scale.

Build evaluations that measure real model capabilities and track results rigorously.

Work closely with the alignment, infrastructure, and product teams, and share findings through clear write-ups.

Required Qualifications – What We're Looking For

3+ years of hands-on experience training deep learning models, or a PhD in a related field (computer science, mathematics, or physics).

Strong Python skills and deep expertise in PyTorch or JAX.

Practical experience with Transformer architectures, including attention, tokenization, embeddings, and positional encodings.

Experience with distributed training on multi-node GPU clusters (FSDP, DeepSpeed, Megatron-LM, or similar).

Solid foundations in linear algebra, probability, statistics, and optimization.

Ability to read a research paper, implement it from scratch, and judge whether it works.

Rigorous experimental habits, including clean baselines, ablations, reproducible results, and experiment tracking.

Clear written and verbal communication skills, and comfort working in a fast-moving, ambiguous environment.

Preferred Qualifications – Nice to Have

Publications at top venues (NeurIPS, ICML, ICLR, ACL) or well-known open-source contributions.

Experience pre-training an LLM from scratch, at any scale.

Post-training experience, including supervised fine-tuning, RLHF, DPO, or other preference-optimization methods.

GPU performance work involving CUDA, Triton, FlashAttention-style kernels, and profiling.

Experience with efficient inference, including quantization, distillation, and optimized model serving.

Cluster and infrastructure experience with Slurm, Kubernetes, or cloud GPU platforms.

Large-scale data engineering experience (Spark, Ray, dataset curation for multilingual or domain-specific corpora).

Please apply only if your experience and technical background align with the required qualifications for this position.

Thank you for your interest!

Originally posted on Himalayas

Interview prep

Walk in with sharper answers.

Use these suggested prompts to prepare. They are not questions supplied by the employer.

Mid
Technology & IT Python Sales Mid level full-time

Practice questions

  1. Tell us about work you have done that is close to the Research Engineer, Large Language Models role.
  2. How would you approach your first 30 days at Immiland Canada?
  3. Which of Python and Sales have you used recently, and what did it help you achieve?
  4. Describe a time you solved a problem without waiting to be told exactly what to do.
  5. How do you handle busy days, changing priorities, or pressure at work?

Prepare before the call

  • A recent example that proves your experience with Python and Sales.
  • One short story with a problem, your action, and the result.
  • Two examples that show the strengths listed on your CV.
  • A clear reason why this role and company interest you.
  • Your availability, preferred work style, and salary expectations.

Ask them

  • What would success look like in the first 90 days?
  • What are the main problems this hire should help solve?
  • How does the team give feedback and measure good work?
  • What does a normal working week look like for this role?
Practice line

I am interested in the Research Engineer, Large Language Models role at Immiland Canada. My relevant experience is [your example], where I [your action] and achieved [your result].

Related jobs.

More roles from this company or category.