The Lead Data Engineer holds the primary responsibility for skillfully designing, developing, implementing, and supporting enterprise Microsoft Azure Data Warehouse. This role assumes accountability for ensuring the dependable, efficient, and secure operation and advancement of On-Premise and Cloud Data Warehouses to effectively meet crucial business needs. Onsite / 175-185+Bonus / Azure Data Studio Essential Duties and Responsibilities:<ul><li>Provide support in designing and overseeing enterprise-grade data pipelines and data stores, essential for the development of advanced analytics programs, machine learning models, and statistical methods.</li><li>Implement automation and streamline processes to optimize the entire data and analytics platform, ensuring efficient throughput and high-performance outcomes.</li><li>Recognize, devise, and execute internal process enhancements, including automation of manual tasks, optimizing data delivery, and redesigning architecture or infrastructure to enhance scalability.</li><li>Collate large, intricate datasets that align with functional and non-functional business demands.</li><li>Develop processes that facilitate data transformation, manage data structures, metadata, dependencies, and workload management.</li><li>Collaborate with business users to understand functional and data requirements, contributing to the enhancement of data models and pipelines.</li><li>Apply expert-level analytical and problem-solving skills to diagnose and resolve intricate technical issues.</li><li>Create, maintain, and continuously enhance scalable data pipelines, while also developing new data source integrations to accommodate the growing volume and complexity of data.</li><li>Designing, implementing, and managing data extraction, transformation, and loading (ETL) processes.</li><li>Creating comprehensive technical specification documents and application interface designs.</li><li>Creating data processing and integration solutions for both batch and real-time scenarios, proficiently handling structured and unstructured data.</li></ul> Qualifications/Competencies:Key Technical Knowledge, Skills, and Abilities:<ul><li>Exhibit a thorough understanding of Data Lake architectures, including raw, enriched, and curated layer concepts, and ETL/ELT operations.</li><li>Exhibit a solid understanding of database design, data warehousing concepts, big data platforms, and ETL operations.</li><li>Experience working with data integration techniques & self-service data preparation.</li><li>Experience in requirements analysis, design, and prototyping.</li><li>Experience deploying modern data solutions leveraging components like Azure functions, Azure Data Factory, Data Flows, Azure Data Lake, Azure SQL, Azure Synapse, Streaming Analytics or equivalent on another cloud provider such as AWS or Google Cloud.</li><li>Experience with DevOps tools like Azure DevOps, Jenkins, Maven etc.</li><li>Experience in building/operating/maintaining fault tolerant and scalable data processing integrations.</li><li>Demonstrated experience of turning business use cases and requirements into technical solutions.</li><li>Strong level of understanding on Azure Data Factory, SQL/Synapse, ADLS, and Azure DevOps.</li><li>Ability to conduct data profiling, cataloging, and mappings for technical design and construction of data flows.]</li></ul> Education and Experience:<ul><li>Bachelor’s degree with a minimum of 10 years of related experience.</li><li>10+ years of hands-on Data Warehouse architecture and development experience</li><li>Demonstrated expertise in Microsoft SQL Server and/or Azure development.</li></ul>

Ready to take your expertise in Azure data engineering to the next level? Join our team as a Senior Azure Data Engineer ! Direct hire- FT$150-160KONSITE- one of 2 locations-Candidate choice- CT or ILSkills: SQL, Azure, Data Bricks, Data Lake, ETL, Data Security/Compliance/Governance, Azure DevOps, Data Factory, Big Data Platforms, Microsoft Azure Data Warehouse We are seeking a highly skilled Senior Data Engineer with expertise in Microsoft Azure and Databricks to join our dynamic team. As a key member of our data engineering department, you will be responsible for designing, implementing, and maintaining scalable data pipelines and analytical solutions on the Azure cloud platform. Your innovative solutions will empower our organization to extract actionable insights from large and complex datasets, driving informed decision-making and business growth. Responsibilities:<ul><li>Design, develop, and deploy robust data pipelines and ETL processes using Azure Data Factory, Databricks, and other related technologies.</li><li>Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.</li><li>Implement data security and compliance measures to ensure the integrity and confidentiality of sensitive data.</li><li>Perform data modeling and schema design to support analytical and reporting needs.</li><li>Troubleshoot and resolve performance issues, bottlenecks, and other data-related issues.</li><li>Stay current with emerging technologies and best practices in data engineering, and recommend innovative solutions to enhance efficiency and effectiveness.</li></ul>Requirements:<ul><li>Bachelor's degree in Computer Science, Engineering, or a related field; advanced degree preferred.</li><li>Proven experience as a Data Engineer, with a focus on designing and building data pipelines and solutions on the Azure cloud platform.</li><li>Strong proficiency in Azure services, including Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Data Lake Storage.</li><li>Proficiency in programming languages such as Python, SQL, and Scala for data manipulation and analysis.</li><li>Experience with data modeling, schema design, and performance tuning in a large-scale data environment.</li><li>Familiarity with DevOps practices and tools for CI/CD, version control, and automated testing.</li><li>Excellent problem-solving skills and the ability to work effectively in a fast-paced, collaborative environment.</li><li>Strong communication skills with the ability to effectively articulate technical concepts to non-technical stakeholders.</li></ul>

Are you a seasoned data engineering professional with a passion for leading teams and driving innovation in data solutions? If you have a proven track record in designing and implementing robust data architectures on the Azure platform, we want to hear from you! Direct hire- FT$170-190KONSITE- one of 2 locations-Candidate choice- CT or ILSkills: SQL, Azure, Data Bricks, Data Lake, ETL, Data Security/Compliance/Governance, Azure DevOps, Data Factory, Big Data Platforms, Microsoft Azure Data Warehouse As a Principal Data Engineer, you will play a crucial role in designing, implementing, and optimizing our data infrastructure. You will be responsible for leading a team of data engineers, collaborating with cross-functional teams, and driving the development of scalable and efficient data solutions. The ideal candidate should have extensive experience in Azure and SQL technologies, possess strong leadership skills, and demonstrate a deep understanding of data engineering best practices.Qualifications:<ol><li>Proven experience (10+ years) in data engineering, with a focus on designing and implementing solutions in Azure.</li><li>Strong expertise in SQL and database design principles.</li><li>Provide support in designing and overseeing enterprise-grade data pipelines and data stores</li><li>Exhibit a solid understanding of database design, data warehousing concepts, big data platforms, and ETL operations.</li><li>Extensive experience with Azure data services, such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse Analytics.</li><li>Solid programming skills in languages like Python, Java, or Scala.</li><li>Demonstrated leadership experience, including managing and mentoring a team of data engineers.</li><li>Excellent communication skills with the ability to effectively convey technical concepts to both technical and non-technical stakeholders.</li><li>Proven ability to troubleshoot and optimize data pipelines for performance and reliability.</li></ol>Education and Experience:<ul><li>Bachelor’s degree with a minimum of 10 years of related experience.</li><li>10+ years of hands-on Data Warehouse architecture and development experience</li><li>Demonstrated expertise in Microsoft SQL Server and/or Azure development.</li></ul>

Are you a seasoned data engineering professional with a passion for leading teams and driving innovation in data solutions? If you have a proven track record in designing and implementing robust data architectures on the Azure platform, we want to hear from you!Direct hire- FT$170-190KONSITE- one of 2 locations-Candidate choice- CT or ILSkills: SQL, Azure, Data Bricks, Data Lake, ETL, Data Security/Compliance/Governance, Azure DevOps, Data Factory, Big Data Platforms, Microsoft Azure Data WarehouseAs a Principal Data Engineer, you will play a crucial role in designing, implementing, and optimizing our data infrastructure. You will be responsible for leading a team of data engineers, collaborating with cross-functional teams, and driving the development of scalable and efficient data solutions. The ideal candidate should have extensive experience in Azure and SQL technologies, possess strong leadership skills, and demonstrate a deep understanding of data engineering best practices.Qualifications:<ol><li>Proven experience (10+ years) in data engineering, with a focus on designing and implementing solutions in Azure.</li><li>Strong expertise in SQL and database design principles.</li><li>Provide support in designing and overseeing enterprise-grade data pipelines and data stores</li><li>Exhibit a solid understanding of database design, data warehousing concepts, big data platforms, and ETL operations.</li><li>Extensive experience with Azure data services, such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse Analytics.</li><li>Solid programming skills in languages like Python, Java, or Scala.</li><li>Demonstrated leadership experience, including managing and mentoring a team of data engineers.</li><li>Excellent communication skills with the ability to effectively convey technical concepts to both technical and non-technical stakeholders.</li><li>Proven ability to troubleshoot and optimize data pipelines for performance and reliability.</li></ol>Education and Experience:<ul><li>Bachelors degree with a minimum of 10 years of related experience.</li><li>10+ years of hands-on Data Warehouse architecture and development experience</li><li>Demonstrated expertise in Microsoft SQL Server and/or Azure development.</li></ul>by Jobble

Data Engineer Top Prospect Group Jobs

Lead Data Engineer
April 27, 2024

Lead Data Engineer
April 19, 2024

Senior Data Engineer
April 19, 2024

Lead Data Engineer
April 17, 2024

Lead Data Engineer
April 15, 2024

Senior Data Engineer
April 15, 2024

Senior Data Engineer
April 14, 2024

Lead Data Engineer
April 14, 2024

Lead Data Engineer
April 13, 2024

Senior Data Engineer
April 13, 2024

Quick filters

Top companies

Data Engineer Top Prospect Group Jobs

Lead Data EngineerApril 27, 2024

Lead Data EngineerApril 19, 2024

Senior Data EngineerApril 19, 2024

Lead Data EngineerApril 17, 2024

Lead Data EngineerApril 15, 2024

Senior Data EngineerApril 15, 2024

Senior Data EngineerApril 14, 2024

Lead Data EngineerApril 14, 2024

Lead Data EngineerApril 13, 2024

Senior Data EngineerApril 13, 2024