AWS Data Engineer

Job Description We are seeking a skilled AWS Data Engineer to join our team. The ideal candidate will design, build and maintain scalable data pipelines and infrastructure on AWS to support data driven decision making. You will collaborate with architects, analysts and software engineers to ensure efficient data flow and accessibility across the organization. Key Responsibilities: - Design, develop and maintain data pipelines using AWS services such as AWS Glue, Lamda, S3, Redshift and Athena. - Build and optimize data models for performance and scalability - Implement ETL/ELT processes to extract, transform and load data from various sources into AWS data stores - Ensure data quality, integrity and security by implementing best practices and governance policies - Monitor and optimize data pipeline performance, ensuring low latency and high availability - Collaborate with cross-functional teams to understand data requirements and deliver solutions - Automate data workflows using tools like AWS Step Functions or Airflow - Implement CI/CD pipelines for data infrastructure deployment - Stay updates on AWS data services and industry trends to recommend improvements We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: Skills and Requirements - 5+ years of experience as a Data Engineer or similar role - Strong proficiency with AWS services (e.g. S3, Glue, Macie) - Experience with SQL and NoSQL databases - Proficiency in programming languages like Python, Terraform, Scala or Java for data processing - Experience with ETL tools and frameworks (e.g. AWS Glue, Apache Spark) - Familiarity with data modeling, schema design and data warehousing concepts - Knowledge of CI/CD practices and version control systems - Strong problem solving skills and attention to detail - AWS Certification (e.g. AWS Certified Data Analytics, AWS Certified Solutions Architect) - Experience with big data technologies like Hadoop, Spark or Kafka - Knowledge of data governance and compliance frameworks - Experience with IaC tools like Terraform