Job Description
Job DescriptionJob Title: AWS Databricks Lead Engineer
Duration: 12 Months
Location: Boston, MA (Hybrid)
Job Summary:
We're seeking an experienced AWS Databricks Lead Engineer to join our team in Boston, MA, in a hybrid or onsite capacity. As a Lead Engineer, you'll play a key role in designing and implementing data engineering solutions using Databricks and AWS services. You'll lead the development of scalable data pipelines, architect data lakehouse solutions, and ensure seamless integration with existing systems.
Key Responsibilities:
- Develop scalable data pipelines using Databricks (PySpark, Delta Lake, MLflow) and AWS services (S3, Glue, Redshift, Lambda).
- Design and implement CI/CD pipelines to ensure seamless integration and deployment of data engineering solutions.
- Design and implement data lakehouse solutions using Databricks and AWS services.
- Work closely with data science, analytics, and engineering teams to ensure seamless integration and alignment.
- Implement data quality and governance policies to ensure data accuracy, completeness, and security.
Requirements:
- 8+ years of experience in data engineering, with a focus on Databricks and AWS services.
- Strong experience with Databricks (PySpark, Delta Lake, MLflow) and AWS services (S3, Glue, Redshift, Lambda).
- Experience leading teams and mentoring junior engineers.
- Excellent communication and collaboration skills.
- Experience with CI/CD pipeline development and implementation.
Nice to Have:
- Experience designing and implementing data lakehouse solutions.
- Experience with machine learning models and deployment using MLflow.
- AWS certifications, such as AWS Certified Data Analytics or AWS Certified Solutions Architect.
If you are interested, please send your Updated Resume, DL copy with the following info at the earliest;
- Full Legal Name:
- Current City, State, Zip:
- Interview Availability:
- Start availability:
- Work Authorization:
- Phone No:
- Hourly Rate: