Job Description
Job Description
Job Tittle: Data Engineer
Location - Boston, MA (Need Local)
Visa: USC, GC, H4-EAD, GC-EAD
Must have: Spark, Scala, AWS, ETL, Python, lambda/glue/s3
Key responsibilities:
AWS data engineers are responsible for designing and building data pipelines and developing ETL/ELT processes using tools such as AWS Glue, EMR, and Redshift to prepare data for analytics. They integrate data from various sources and create and maintain data models efficient for storage and analysis. Ensuring data quality, security, and compliance through implementing checks, validation processes, and security best practices is also crucial. The role involves monitoring and optimizing data processing jobs and databases for performance, collaborating with stakeholders to understand data requirements, and maintaining and operationalizing existing data solutions.
Minimum Skills Required:
At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution.
- Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must.
- Strong Application development experience in Scala/Python.
- Strong Database SQL experience, preferably Redshift.
- Experience in Snowflake is an added advantage.
- Experience with ETL/ELT process and frameworks is a must.
- Strong background in AWS cloud services like lambda, glue, s3, emr, sns, sqs, cloudwatch, redshift
- Expertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQL
- Proficient in Python programming for data engineering tasks, automations
- Experience with shell scripting in Linux/Unix environments.
- Experience with Big Data – Hadoop, Spark
- Financial Services experience required
Nice to have - knowledge in Machine Learning models, regression, validation
If you are interested, please send your Updated Resume with the following info at the earliest.
- Full Legal Name:
- Current City, State, Zip:
- Interview Availability:
- Start availability:
- Work Authorization:
- Phone No:
- Hourly Rate: