Iris's client, a large insurance company, is currently searching for a strong for AWS Data Engineer. Our client has offices all over the world and has the global reach, advisory services, and distribution power to meet the needs of issuers and investors worldwide. Job title: AWS Data EngineerLocation: Hybrid 2 days onsite (Newark, NJ)Duration: 24 months Only w2, no C2C Must Skills: NodeJS, AWS Redshift, AWS Lambda. Job Description: <ul><li>motivated AWS Data Solutions Engg. willing to work on NodeJS based microservices/backend.</li><li>building Serverless applications on AWS using AWS SAM, API Gateway, Lambda, SQS, SNS, RedShift, EC2 Kinesis, Cognito, DynamoDB, IAM Roles/Permissions.</li><li>experience with Python.</li><li>in using relational databases like Oracle/SQL</li><li>in deploying applications in Unix environments and writing shell scripts.</li><li>in debugging AWS applications.</li></ul>

IRIS direct end client which is one of the leading American provider of human resources management software and services is urgently looking to hire AWS Data Engineer Parsippany, NJ 07054 (Hybrid - 3 days per week). This is a Contract to hire Role opportunity.AWS Data EngineerParsippany, NJ 07054 (Hybrid - 3 days per week)Nature of Contract Contract to hire OpportunityFocus is : Databricks Products, AWS (Glue/Athena/kinesis/aurora etc.), Python or PySpark Development experience, building Data pipelines. We are seeking a highly skilled AWS Data Engineer with expertise in building Data pipelines and processing solutions on the AWS platform, focusing on Databricks, Delta Lake, and Python development. The ideal candidate will have a strong background in relational and non-relational data architecture, data classification, and working collaboratively with Data Scientists and Architects.Key Responsibilities:<ul><li>Design, develop, and optimize Data pipelines and processing solutions on the AWS platform, emphasizing Databricks, Delta Lake, and Python.</li><li>Collaborate with Data Scientists, Architects, and business stakeholders to gather and clarify requirements for Data Lake components.</li><li>Utilize AWS services such as CloudFormation, Lambda, API Gateway, S3, DynamoDB, RDS, Glue, Athena, and QuickSight for data management and analysis.</li><li>Develop metadata-driven Data Lake solutions for ingesting historic and real-time structured/semi-structured/unstructured data.</li><li>Implement ETL/ELT pipelines and ensure data integrity, quality, and security throughout the process.</li><li>Manage changes in enterprise-grade operational Data Lake environments and ensure scalability and efficiency.</li><li>Utilize tools like Gliffy for creating diagrams representing Business Processes, ERD, and AWS Architecture.</li><li>Develop solutions for data Ingestion, Transformation, Cataloging, In-Place Querying, Storage, and Security following AWS best practices.</li><li>Experience in Relational/NOSQL database integration into an Enterprise Data Lake environment.</li><li>Set up AWS CloudWatch, CloudTrail for monitoring, and optimizing Data Lake environments.</li><li>Write SQL queries using AWS Athena and map various relational DB queries to Athena.</li><li>Proficient in Python, PySpark, and AWS Glue ETL jobs for data processing and transformations.</li><li>Follow and enforce strict standards for code quality, automated testing, infrastructure-as-code, and code maintainability.</li><li>Lead the development of user stories and translate requirements into Problem Statements in an agile collaborative environment.</li></ul>Qualifications:<ul><li>10+ years of experience in data management with a focus on AWS Data solutions.</li><li>Strong expertise in relational and non-relational data architecture and classification.</li><li>Hands-on experience with Databricks, Delta Lake, AWS services, Python, or PySpark development.</li><li>Experience in designing and implementing ETL/ELT pipelines for Data processing.</li><li>Knowledge of AWS EMR and its application in data processing and analytics.</li><li>Proficiency in SQL queries using AWS Athena and mapping relational DB queries.</li><li>Experience in de-normalizing/flattening data structures in Parquet/ORC formats.</li><li>Good understanding of AWS IAM policies for implementing Data Lake security best practices.</li><li>Robust debugging skills and knowledge of automated testing platforms and unit tests.</li></ul>Looking forward to hear from you...!!!Thanks and Regards,Bharat SharmaSr. Technical RecruiterIRIS Software, Inc.by Jobble

Our esteemed client is looking to hire Sr AWS Cloud Data Engg for a (Long Term Contract) opportunity.Senior AWS Cloud Data EngineerLong Term Contract Number of Roles 3 Location Roseland Parsippany, NJ Hybrid Need 3 days onsite. Strong experience in working with Data Scientists, Architects, and business experts to clarify requirements for components and features of the Data Lake.Ability to garner requirements for varying consumers of Data Lake is strongly desired.Strong expertise in designing, and developing metadata-driven Data Lake solutions for ingesting historic and near real-time structured/semi-structured/unstructured data.10 years or more experience in data management. Experience with Databricks Products. Minimum 2 years of experience managing changes in enterprise-grade operational Data LakeHands-on experience developing systems that leverage multiple AWS services including CloudFormation, Lambda, API Gateway, S3, DynamoDB/ any NoSQL, Relational Database Service (RDS), Glue Catalog, Crawler, Glue ETL job, Athena and QuickSight for data management and analysisStrong experience in design & implement ETL and ELT pipelines is a must.Experience in developing solutions for data Ingestion, Transformation, Cataloging, In-Place Querying, Storage, and Security using AWS tools and best practicesExperience in working with Machine learning and AI concepts related to RAG architecture, LLMSs, embedding and data insertion into a Vector data store.Experience in Relational/NOSQL database into an Enterprise Data Lake is a PlusProficient in Python, PySpark, AWS Glue ETL jobsSQL queries using AWS Athena and mapping of various relational DB queries to AthenaGood understanding of AWS IAM policies to implement security best practices in Data LakeAbility to work in an agile collaborative environment, take lead on developingAWS Certification plusby Jobble

Our esteemed client is looking to hire Sr AWS Cloud Data Engg for a (Long Term Contract) opportunity.Senior AWS Cloud Data EngineerLong Term Contract Number of Roles – 3 Location – Roseland – Parsippany, NJ Hybrid – Need 3 days onsite. Strong experience in working with Data Scientists, Architects, and business experts to clarify requirements for components and features of the Data Lake.Ability to garner requirements for varying consumers of Data Lake is strongly desired.Strong expertise in designing, and developing metadata-driven Data Lake solutions for ingesting historic and near real-time structured/semi-structured/unstructured data.10 years or more experience in data management. Experience with Databricks Products. Minimum 2 years of experience managing changes in enterprise-grade operational Data LakeHands-on experience developing systems that leverage multiple AWS services including CloudFormation, Lambda, API Gateway, S3, DynamoDB/ any NoSQL, Relational Database Service (RDS), Glue Catalog, Crawler, Glue ETL job, Athena and QuickSight for data management and analysis.Strong experience in design & implement ETL and ELT pipelines is a must.Experience in developing solutions for data Ingestion, Transformation, Cataloging, In-Place Querying, Storage, and Security using AWS tools and best practicesExperience in working with Machine learning and AI concepts related to RAG architecture, LLMSs, embedding and data insertion into a Vector data store.Experience in Relational/NOSQL database into an Enterprise Data Lake is a PlusProficient in Python, PySpark, AWS Glue ETL jobsSQL queries using AWS Athena and mapping of various relational DB queries to AthenaGood understanding of AWS IAM policies to implement security best practices in Data LakeAbility to work in an agile collaborative environment, take lead on developingAWS Certification plus

IRIS direct end client which is one of the leading American provider of human resources management software and services is urgently looking to hire AWS Data Engineer – Parsippany, NJ 07054 (Hybrid - 3 days per week). This is a Contract to hire Role opportunity.AWS Data EngineerParsippany, NJ 07054 (Hybrid - 3 days per week)Nature of Contract – Contract to hire OpportunityFocus is : Databricks Products, AWS (Glue/Athena/kinesis/aurora etc.), Python or PySpark Development experience, building Data pipelines. We are seeking a highly skilled AWS Data Engineer with expertise in building Data pipelines and processing solutions on the AWS platform, focusing on Databricks, Delta Lake, and Python development. The ideal candidate will have a strong background in relational and non-relational data architecture, data classification, and working collaboratively with Data Scientists and Architects.Key Responsibilities:<ul><li>Design, develop, and optimize Data pipelines and processing solutions on the AWS platform, emphasizing Databricks, Delta Lake, and Python.</li><li>Collaborate with Data Scientists, Architects, and business stakeholders to gather and clarify requirements for Data Lake components.</li><li>Utilize AWS services such as CloudFormation, Lambda, API Gateway, S3, DynamoDB, RDS, Glue, Athena, and QuickSight for data management and analysis.</li><li>Develop metadata-driven Data Lake solutions for ingesting historic and real-time structured/semi-structured/unstructured data.</li><li>Implement ETL/ELT pipelines and ensure data integrity, quality, and security throughout the process.</li><li>Manage changes in enterprise-grade operational Data Lake environments and ensure scalability and efficiency.</li><li>Utilize tools like Gliffy for creating diagrams representing Business Processes, ERD, and AWS Architecture.</li><li>Develop solutions for data Ingestion, Transformation, Cataloging, In-Place Querying, Storage, and Security following AWS best practices.</li><li>Experience in Relational/NOSQL database integration into an Enterprise Data Lake environment.</li><li>Set up AWS CloudWatch, CloudTrail for monitoring, and optimizing Data Lake environments.</li><li>Write SQL queries using AWS Athena and map various relational DB queries to Athena.</li><li>Proficient in Python, PySpark, and AWS Glue ETL jobs for data processing and transformations.</li><li>Follow and enforce strict standards for code quality, automated testing, infrastructure-as-code, and code maintainability.</li><li>Lead the development of user stories and translate requirements into Problem Statements in an agile collaborative environment.</li></ul>Qualifications:<ul><li>10+ years of experience in data management with a focus on AWS Data solutions.</li><li>Strong expertise in relational and non-relational data architecture and classification.</li><li>Hands-on experience with Databricks, Delta Lake, AWS services, Python, or PySpark development.</li><li>Experience in designing and implementing ETL/ELT pipelines for Data processing.</li><li>Knowledge of AWS EMR and its application in data processing and analytics.</li><li>Proficiency in SQL queries using AWS Athena and mapping relational DB queries.</li><li>Experience in de-normalizing/flattening data structures in Parquet/ORC formats.</li><li>Good understanding of AWS IAM policies for implementing Data Lake security best practices.</li><li>Robust debugging skills and knowledge of automated testing platforms and unit tests.</li></ul>Looking forward to hear from you...!!!Thanks and Regards,Bharat SharmaSr. Technical RecruiterIRIS Software, Inc.

Data Engineer Iris Software Inc. Jobs

Aws Data Engineer
May 1, 2024

Aws Data Engineer
April 28, 2024

Aws Data Engineer
April 11, 2024

Senior Aws Cloud Data Engineer
April 11, 2024

Senior Aws Cloud Data Engineer
April 10, 2024

Aws Data Engineer
April 7, 2024

Senior Aws Cloud Data Engineer
April 3, 2024

Quick filters

Top companies

Data Engineer Iris Software Inc. Jobs

Aws Data EngineerMay 1, 2024

Aws Data EngineerApril 28, 2024

Aws Data EngineerApril 11, 2024

Senior Aws Cloud Data EngineerApril 11, 2024

Senior Aws Cloud Data EngineerApril 10, 2024

Aws Data EngineerApril 7, 2024

Senior Aws Cloud Data EngineerApril 3, 2024