Data Scientist - Health AI

Location: Remote, Canada
Language: English, advanced written and verbal communication required
Duration: Permanent
Background Check Requirement: May be required as part of the hiring process

About the Opportunity

Are you passionate about shaping the future of healthcare through responsible AI? We are recruiting for a Senior Applied Data Scientist to join a global organization at the forefront of artificial intelligence, where you'll help ensure that cutting-edge healthcare AI solutions are clinically accurate, safe, and trusted. Working at the intersection of healthcare, data science, and machine learning, you'll play a key role in developing the datasets and evaluation frameworks that support next-generation AI technologies.

In this highly collaborative role, you'll partner with research scientists, machine learning engineers, technical architects, clinicians, and healthcare subject matter experts to design rigorous evaluation methodologies for large language models and multimodal AI systems. Your work will directly influence how AI is applied across patient care, clinical documentation, medical research, and healthcare operations while ensuring solutions meet the highest standards of quality, compliance, and clinical relevance.

What's In It for You

Join a highly collaborative, research-driven environment where innovation and continuous learning are encouraged. You'll work alongside leading experts in healthcare and artificial intelligence, contribute to meaningful projects with global impact, and help shape emerging best practices in one of the fastest-growing areas of technology. This is an opportunity to solve complex challenges while working with a team that values curiosity, collaboration, and responsible AI.

Your Responsibilities

• You'll design high-quality datasets, annotation guidelines, evaluation rubrics, and sampling strategies to support the training and evaluation of healthcare AI models.

• You'll develop statistically rigorous methodologies to measure model performance, fairness, reliability, and clinical accuracy across diverse healthcare use cases.

• You'll collaborate with clinicians, biomedical experts, researchers, and engineering teams to ensure datasets and evaluation frameworks reflect real-world clinical workflows.

• You'll evaluate large language models, retrieval-augmented generation (RAG) systems, and multimodal AI solutions for safety, factual accuracy, guideline adherence, and overall clinical performance.

• You'll establish quality assurance processes, governance standards, and documentation supporting compliant handling of regulated healthcare data.

• You'll contribute to reusable evaluation frameworks, healthcare taxonomies, and best practices that support future AI development initiatives.

Skills and Qualifications

• 5+ years of progressive data science experience, including at least 2 years working with healthcare, clinical, biomedical, pharmaceutical, payer, provider, or other regulated health data.

• Strong proficiency with Python, SQL, pandas, scikit-learn, statsmodels, and modern AI or LLM evaluation tools.

• Experience designing machine learning datasets, annotation guidelines, quality assurance processes, and statistical evaluation methodologies.

• Working knowledge of healthcare standards and terminology, including ICD-10, CPT, SNOMED CT, LOINC, RxNorm, and familiarity with FHIR or HL7.

• Demonstrated experience evaluating Generative AI, large language models, retrieval-augmented generation (RAG), prompt engineering, or related AI evaluation frameworks.

• Strong statistical foundation, including sampling methodologies, bias and fairness analysis, inter-annotator agreement metrics, confidence intervals, and error analysis.

• Excellent communication skills with the ability to collaborate effectively with clinicians, researchers, engineers, and technical stakeholders.

Note from the Hiring Manager

"We're looking for someone who enjoys solving complex problems and isn't satisfied with surface-level answers. If you're passionate about improving healthcare through responsible AI, thrive in collaborative environments, and can bridge clinical expertise with data science, you'll make a meaningful impact on our team."

Why Partner with Altis

If you’ve never worked with a staffing agency before, we make it easy. We work with top employers across Canada who have great jobs to fill, each vetted and verified by our team. When you apply for a job with Altis, we get to know you as a candidate and learn what your strengths are. Then, if you’re a solid match, we handle all the logistics, advocating for you as a candidate for the role, providing access to coaching and connecting you directly with the hiring manager. And rest assured, all our services are free of cost for candidates.

We appreciate the time and effort all applicants invest in their submissions. Please note that only candidates shortlisted for this role will be contacted directly. However, your profile will remain under consideration for future opportunities that align with your experience and career goals. All qualified applicants will receive fair consideration for employment. We welcome individuals of all backgrounds, experiences, and identities including those who identify as women, members of racialized groups, Indigenous Peoples, persons with disabilities, and 2SLGBTQIA+ communities. If you require an accommodation, please review our accessibility policy and reach out to our accessibility officer with any questions. Our human recruiters review all applications and always make the final hiring decision. On occasion, we also use AI-assisted tools to help review applications.