Job Title: Data Engineer
Location: New York
Job Type: Fulltime
Salary Range: $130,000 - $150,000
Job Description:
We recently partnered with a leading pharmaceutical organization and are looking for a skilled Data Engineer to design, build, and maintain robust data pipelines and systems. You will collaborate with cross-functional teams to ensure data is clean, accessible, and reliable, enabling the organization to make data-driven decisions.
Key Responsibilities:
- Develop, test, and maintain scalable real-time and batch processing data pipelines.
- Implement ETL (Extract, Transform, Load) processes to integrate data from various sources into centralized systems.
- Optimize and manage database architecture to ensure performance and reliability.
- Collaborate with data scientists and analysts to understand data requirements.
- Work with cloud platforms (e.g., AWS, Azure, GCP) to deploy and manage data infrastructure.
- Monitor and troubleshoot data flow and performance issues.
- Ensure data security and compliance with relevant regulations.
Required Skills and Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or related field.
- Strong experience with programming languages such as Python, Java, or Scala.
- Proficiency in SQL and database systems (e.g., PostgreSQL, MySQL, MongoDB).
- Hands-on experience with big data tools (e.g., Hadoop, Spark, Kafka).
- Familiarity with data modeling and schema design.
- Experience with cloud platforms and tools (e.g., AWS Glue, Azure Data Factory).
- Excellent problem-solving and communication skills.