Data Engineer Job at Qode, Pennsylvania

cFllbVphWURoWmFPMWZXQTA4NzFzNTJpb3c9PQ==
  • Qode
  • Pennsylvania

Job Description

Job Summary:

We are seeking a skilled and motivated Data Engineer with strong expertise in PySpark, SQL to join our Data Engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and processing systems that support our business intelligence, analytics, and machine learning initiatives.

Key Responsibilities:

  • Develop and maintain scalable, robust data pipelines using Scala and big data technologies.
  • Work with large datasets from multiple sources to ingest, transform, and make data available for analytics and reporting.
  • Collaborate with Data Scientists, Analysts, and other engineers to understand data requirements and deliver efficient solutions.
  • Optimize ETL jobs for performance and cost.
  • Ensure data quality, governance, and consistency across all environments.
  • Monitor production jobs, troubleshoot issues, and ensure system reliability.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.

Required Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 6+ years of experience as a Data Engineer or in a similar role.
  • Strong skills in PySpark and SQL (experience with functional programming is a plus).
  • Hands-on experience with big data tools like Apache Spark , Kafka , Hadoop , or Hive .
  • Proficiency in building ETL pipelines and working with structured and unstructured data.
  • Experience with cloud platforms (e.g., AWS , Azure , GCP ) and their data services.
  • Familiarity with version control systems (e.g., Git ), CI/CD, and DevOps practices.
  • Solid understanding of data warehousing and data modeling concepts.

Preferred Qualifications:

  • Knowledge of SQL and database systems such as Postgres, Redshift, or Snowflake.
  • Exposure to containerization technologies like Docker and orchestration tools like Airflow or Kubernetes.

Job Tags

Full time,

Similar Jobs

Worldwide Clinical Trials - USA

Associate, Pharmacovigilance - US - Remote Job at Worldwide Clinical Trials - USA

 ...be a workplace where people thrive by being themselves and are inspired to do their best work every day.Join us! What the Pharmacovigilance Department does at Worldwide Pharmacovigilance is the gateway to ensuring drug safety ! Our Pharmacovigilance team comprises... 

Steris Corporation

Maintenance Manager Job at Steris Corporation

 ...providing innovative healthcare and life science product and service solutions around the globe. Position Summary The Maintenance Manager is responsible for implementing and maintaining a successful maintenance program that includes maintenance, repair and improvement... 

Landis Financial Advisors, Inc.

Healthcare insurance advisor Job at Landis Financial Advisors, Inc.

 ...Description: We are seeking a representative that is either familiar with or will be able to learn the Medicare and individual healthcare landscape. Your goal will be to become an expert in the field alongside your co-workers, build strong, lasting relationships with... 

Tiffany & Co.

Jeweler Job at Tiffany & Co.

Tiffany & Co. seeks an experienced Jeweler in Whippany, NJ to perform repairs and alterations on luxury jewelry. The role requires proficiency in soldering, laser welding, and diamond setting, with a strong attention to detail and customer service orientation. The position... 

Apptad Inc

Apptad- Backup Admin Job at Apptad Inc

 ...Job Title: Backup admin Location: Remote Mode : Contract (6+ Months) Job description: Implement, maintain, and support data protection devices and systems with optimal performance and availability Provide recuring backup and recovery testing...