Data Engineer Job at Galent, Toronto, ON

NGRPQ2NFTTFSYmhQQlNkeVNOVEJOMk9uUHc9PQ==
  • Galent
  • Toronto, ON

Job Description

Key Responsibilities

  • Design, develop, and optimize data pipelines using Databricks and PySpark .
  • Build scalable ETL/ELT data solutions integrating data from various structured and unstructured sources.
  • Work extensively with Azure Data Lake Storage (ADLS) for data ingestion, transformation, and storage.
  • Develop robust, reusable, and high-performance code in Python .
  • Create and maintain SQL scripts, queries, and stored procedures to support data transformations and analytics.
  • Implement data workflows using Azure Data Factory (ADF) .
  • Apply functional programming principles to build clean, modular, and testable data processing logic.
  • Collaborate with cross-functional teams in an Agile environment to deliver end-to-end data engineering solutions.
  • Ensure data quality, data governance, and best practices in pipeline development.
  • Perform performance tuning, debugging, and troubleshooting of pipelines and jobs.

Required Skills & Qualifications

  • 5+ years of experience as a Data Engineer or similar role.
  • Strong expertise with Databricks notebooks, workflows, and cluster management.
  • Hands-on experience with PySpark for distributed data processing.
  • Strong proficiency in Python and SQL.
  • Experience with Azure Data Lake , ADF , and other components of Azure data services.
  • Background in functional programming concepts and best practices.
  • Experience working in Agile methodologies (Scrum/Kanban).
  • Excellent problem-solving and communication skills.

Job Tags

Similar Jobs

Net2Source (N2S)

Verification/testing Engineer Job at Net2Source (N2S)

 ...with hardware, firmware, management firmware, and/or software (system & application stack) interfaces across all modules in a system FPGA and CPLD development knowledge Knowledge of schematic capture, circuit design, routing constraints definition, layout review and... 

Winnipeg Regional Health Authority (WRHA)

Program Consultant Job at Winnipeg Regional Health Authority (WRHA)

 ...City: Winnipeg Employer: Winnipeg Regional Health Authority Site: WRHA Community...  ...Grow your career in the Winnipeg Health Region! Our team provides a spectrum of health care...  ...Program Director or designate, the Program Consultant provides consultation, review, analysis,... 

GFL Environmental

Chauffeur(e) Classe 3 - Chargement latéral Job at GFL Environmental

Poste : Chauffeur(e) de camion Chargement latral Lieu de travail :111 rue Industrielle New Richmond Qubec Poste permanent Bienvenue chez Matrec, une division de GFL! Nous sommes une entreprise dynamique, axe sur la croissance et la scurit. GFL assure...

Freddie Mac

Enterprise Business Risk and Control Senior Job at Freddie Mac

 ...At Freddie Mac, our mission of Making Home Possible is what motivates us, and it's at the core of everything we do. Since our charter in 1970, we have made home possible for more than 90 million families across the country. Join an organization where your work contributes... 

E. Bourassa & Sons

NAPA Auto Parts Sales Associate Job at E. Bourassa & Sons

 ...Join NAPA Auto Parts and become the go-to expert our customers depend on! You'll be the initial point of contact for a wide range of automotive needs, assisting everyone from passionate DIYers to busy local mechanics. Get ready for a fast-paced role where your contributions...