ANCILE Solutions, Inc.

Lead AI Engineer

United States full-time Senior Salary not listed
full-time Senior level Technology & IT Curated
Sign in to apply Free account — we bring you straight back to this role.

About the role

Lead AI Engineer

uPerform – the fastest and easiest solution to help enterprises and health care organizations rapidly create, manage, and distribute targeted learning content – is looking for an experienced and driven Lead AI Engineer to join our Software Development & Innovation Group (SDIG).

The ideal candidate is a hands-on technical leader who has shipped generative AI features to production and led the engineers who build them. This individual will split their time evenly between building and leading, setting technical direction for our AI products – conversational search, AI analytics, and adaptive learning – while maintaining uPerform’s standards of quality and excellence.

Duties and Responsibilities:

Lead and mentor the AI engineering team in an agile environment, balancing hands-on development with team leadership

Design, build, and operate LLM-powered features on Amazon Bedrock, including RAG pipelines and agentic workflows

Drive conversational search to general availability, including quality evaluation, latency, and cost

Build dashboards on Amazon Redshift to measure AI feature usage and performance

Shape the architecture for adaptive learning, rebuilding uPerform courses to adapt to each learner using AI

Own technical decisions on model selection, retrieval design, evaluation, and cost-quality trade-offs

Establish evaluation practices, including golden datasets, offline evals, and LLM-as-judge

Provision resources with infrastructure as code (CloudFormation) and partner with operations on production deployments

Drive adoption of AI coding tools such as Cursor and Claude Code across the team

Contribute to agile team performance through planning, standups, sprint reviews, and retrospectives

Required Skills:

8+ years of professional software engineering experience, including 2+ years building generative AI features in production

Hands-on production experience with Amazon Bedrock or Azure AI Foundry

Experience building agentic systems, including tool use and multi-step workflows

Experience with retrieval-augmented generation (RAG), embeddings, and vector or hybrid search (OpenSearch or Elasticsearch)

Demonstrated experience leading a team of 3–5+ engineers as a tech lead or lead engineer

Strong Python skills and experience with AWS-native services (Lambda, S3, DynamoDB, Step Functions)

Daily use of AI coding tools such as Cursor or Claude Code

Excellent communication skills, including explaining AI concepts to technical and non-technical audiences

Experience working within Agile software methodologies

Preferred Skills:

Healthcare or regulated-data experience (HIPAA, PHI, SOC 2)

Experience building LLM evaluation frameworks and modeling cost per query

Infrastructure as code with CloudFormation, CDK, or Terraform

Data warehousing and dashboarding on Redshift or Snowflake

Edtech, learning platform, or adaptive learning background

Location:

Remote, United States (uPerform HQ in Elkridge, MD)

Originally posted on Himalayas

Interview prep

Walk in with sharper answers.

Use these suggested prompts to prepare. They are not questions supplied by the employer.

Senior
Technology & IT Data Analysis Operations Project Management Python Remote Collaboration Senior level

Practice questions

  1. Tell us about work you have done that is close to the Lead AI Engineer role.
  2. How would you approach your first 30 days at ANCILE Solutions, Inc.?
  3. Which of Data Analysis, Operations and Project Management have you used recently, and what did it help you achieve?
  4. How have you led people, improved a process, or made a hard decision in a previous role?
  5. How do you handle busy days, changing priorities, or pressure at work?

Prepare before the call

  • A recent example that proves your experience with Data Analysis, Operations and Project Management.
  • One short story with a problem, your action, and the result.
  • Two examples that show the strengths listed on your CV.
  • A clear reason why this role and company interest you.
  • Your availability, preferred work style, and salary expectations.

Ask them

  • What would success look like in the first 90 days?
  • What are the main problems this hire should help solve?
  • How does the team give feedback and measure good work?
  • What does a normal working week look like for this role?
Practice line

I am interested in the Lead AI Engineer role at ANCILE Solutions, Inc.. My relevant experience is [your example], where I [your action] and achieved [your result].

Related jobs.

More roles from this company or category.