Senior Data Engineer

Currently, we are looking for talented resources for one of our listed clients. If interested please reply to me with your updated resume or feel free to reach out to me for more details at (949) 774-2432.

Title: Senior Data Engineer (Hybrid Role)
Location: Atlanta, GA
Duration: Long Term
 

Job Description:

• We are seeking a Senior Data Engineer to join our dynamic and innovative team. As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure, enabling us to extract valuable insights and drive data-informed decisions.

Responsibilities:

• Collaborate with cross-functional teams to understand data requirements and design efficient and scalable data pipelines.
• Develop Python applications and leverage Python frameworks to build robust and performant data processing solutions.
• Implement and manage AWS CloudFormation templates for provisioning and managing cloud resources.
• Monitor and troubleshoot data pipelines using AWS CloudWatch to ensure optimal performance and reliability.
• Design, build, and optimize data storage solutions using AWS DynamoDB, AWS S3, and other relevant technologies.
• Utilize AWS EventBridge and AWS Kinesis to enable real-time data streaming and event-driven architectures.
• Create and manage serverless functions using AWS Lambda to process data and trigger actions.
• Construct and maintain a Data Lake using AWS Lake Formation, AWS Glue, and Athena for efficient data storage, cataloging, and querying.
• Develop and maintain Pydantic models to ensure data consistency, validation, and efficient serialization.
• Mentor and guide junior team members, providing technical expertise and sharing best practices.
• Stay up-to-date with industry trends and emerging technologies, and apply them to enhance our data engineering capabilities.
• Collaborate with data scientists, analysts, and other stakeholders to ensure the availability and accessibility of high-quality data for analytics and reporting.

Required Skills & Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 9+ years of experience in data engineering roles, with a strong focus on Python application development and data processing.
• Proficiency in Python programming and experience with relevant frameworks (e.g., Pandas, NumPy, etc.).
• Extensive hands-on experience with AWS services including CloudFormation, CloudWatch, DynamoDB, EventBridge, Kinesis, Lambda, and S3.
• Proven expertise in building and maintaining Data Lakes using AWS Lake Formation, AWS Glue, and Athena.
• Strong understanding of serverless architecture and the ability to design and implement serverless data processing solutions.
• Familiarity with Pydantic models for data validation and serialization.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Excellent problem-solving skills with the ability to troubleshoot complex data pipeline issues.
• Effective communication skills to collaborate with technical and non-technical stakeholders.
• Experience with Agile/Scrum methodologies and version control systems (e.g., Git).
• AWS certifications (e.g., AWS Certified Data Analytics - Specialty) are a plus.

About us:
At our organization, we take our mission and values to heart! We are on a mission to offer more and better jobs all over the world! Our goal is to care for you while you care for our clients and get you paid the highest pay possible. All our associates working with us are expected to embrace our RACE values: R - Results Matter, A- Approachable, C - Care, and E - Emergency i.e. work with a sense of urgency.

For more relevant job opportunities please visit our website: Denken Solutions Careers