Data Engineer, Python & PySpark (Contract)
Location: Remote, Canada
Language: English, strong written and verbal communication skills
Duration: November 2026 to March 2027, anticipated start November 2, 2026
About the Opportunity
Are you a skilled Data Engineer who enjoys solving complex data challenges and improving performance? An organization in the healthcare information sector is seeking an experienced Data Engineer to optimize high-volume ETL pipelines that process critical healthcare data from across Canada.
In this role, you'll collaborate with business and IT teams to improve data processing efficiency, convert Python code to PySpark, and strengthen the reliability of nightly data workflows. Your work will help ensure accurate, timely data is available to support meaningful healthcare analytics.
What's In It for You
• Work on a high-impact project supporting healthcare data and analytics across Canada.
• Enjoy the flexibility of a fully remote contract opportunity.
• Collaborate with knowledgeable business and IT professionals on meaningful technical challenges.
• Apply your expertise to improve large-scale data processing and pipeline performance.
Your Responsibilities
• You'll convert existing Python code into optimized PySpark, ensuring accuracy, performance, and seamless integration into ETL pipelines.
• You'll test, validate, and implement code changes to maintain data integrity and processing reliability.
• You'll review existing data enrichment packages and identify opportunities to improve nightly pipeline performance.
• You'll develop and integrate code optimizations to improve processing speed, scalability, and efficiency.
• You'll document technical processes and recommend improvements to existing data workflows.
• You'll collaborate with IT teams, as time permits, to enhance pipeline automation, functionality, and overall efficiency.
Skills and Qualifications
• 7+ years of experience with Apache Spark (PySpark), including large-scale data processing and performance optimization.
• 3+ years of hands-on Python development experience, ideally involving ETL pipelines and data transformation.
• 3+ years of experience using GitLab or GitHub for version control and collaborative development.
• Strong understanding of ETL processes, code optimization, testing, validation, and data pipeline integration.
• Experience with AWS EMR Clusters and Apache Airflow is considered an asset.
• Familiarity with AWS data services, including S3, Glue, Redshift, and Lake Formation, as well as infrastructure-as-code tools such as Terraform or CloudFormation, is an asset.
• Strong analytical, problem-solving, documentation, and communication skills, with the ability to collaborate across technical and business teams.
Why Partner with Altis
If you’ve never worked with a staffing agency before, we make it easy. We work with top employers across Canada who have great jobs to fill, each vetted and verified by our team. When you apply for a job with Altis, we get to know you as a candidate and learn what your strengths are. Then, if you’re a solid match, we handle all the logistics, advocating for you as a candidate for the role, providing access to coaching and connecting you directly with the hiring manager. And rest assured, all our services are free of cost for candidates.