AWS Data Engineer

Select how often (in days) to receive an alert:

• Designing, building, and maintaining efficient, reusable, and reliable architecture and code.
• Build reliable and robust Data ingestion pipelines (within AWS on-prem to AWS etc.).
• Ensure the best possible performance and quality of high-scale data engineering projects.
• Participate in the architecture and system design discussions.
• Independently perform hands-on development and unit testing of the applications.
• Collaborate with the development team and build individual components into complex enterprise web systems.
• Work in a team environment with product production operation QE/QA and cross-functional teams to deliver a project throughout the whole software development cycle.
• Responsible for identifying and resolving any performance issues. Keep up to date with new technology development and implementation.
• Participate in code reviews to ensure standards and best practices are met.

Required Skills

• Bachelor's degree in computer science, Software Engineering, MIS, or equivalent combination of education and experience.
• 5-10 years of experience implementing and supporting data lakes, data warehouses, and data applications on AWS for large enterprises.
• Programming experience with Python, Shell scripting, and SQL. Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, etc.
• Solid experience implementing solutions on AWS-based data lakes.
• Good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, Elasticsearch, Serverless application development using AWS Lambda.
• Experience in AWS data lake/data warehouse/business analytics.
• Experience in system analysis, design, development, and implementation of data ingestion pipelines in AWS.
• Knowledge of ETL/ELT, end-to-end data solutions (ingest, storage, integration, processing, access) on AWS. Architect and implement CI/CD strategy for EDP. Implement high-velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred).
• Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift. Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift. Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case. AWS Solutions Architect or AWS Developer Certification preferred.
• Good understanding of Lakehouse/data cloud architecture.

Life At Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

• Healthcare including dental, vision, mental health, and well-being programs.
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan.
• Paid time off and paid holidays.
• Paid parental leave.
• Family building benefits like adoption assistance, surrogacy, and cryopreservation.
• Social well-being benefits like subsidized back-up child/elder care and tutoring.
• Mentoring, coaching, and learning programs.
• Employee Resource Groups.
• Disaster Relief.

Disclaimer

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status, or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities, and Qualifications required for this position. Physical, mental, sensory, or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Click the following link for more information on your rights as an Applicant: http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law

Ref. code: 74414

Posted on: Mar 17, 2025

Experience Level: Experienced Professionals

Contract Type: Permanent

Location: Brooklyn, NY, US

Brand: Capgemini

Professional Community: Software Engineering