Our client is searching for a Senior Software Engineer specializing in SQL development that has experience with Databricks for a temp-to-perm position that can be worked remotely. All candidates must work directly for TEKsystems on a W2 basis before converting to full-time employment of our client. This role provides technical expertise to software development projects and the development and implementation of database management system solutions. Most of this work will involve database development and experience with Azure Synapse or Databricks is required. Duties: ? Defines IT software and database solutions by working with enterprise architecture teams and IT leadership. ? Effectively plans and manages assignments spanning multiple projects ? Collaborates with data scientists and analysts to provide data-driven solutions and insights. ? Drives technical and procedural change relative to best practices in software and database development ? Defines test strategies and procedures to drive total quality across IT systems ? Clearly communicates project issues and status with the project team and IT leadership. ? Integrates new data engineering tools with other data storage and processing systems. ? Ensures data security and compliance with data governance policies. ? Builds and maintains data pipelines and workflows. ? Develops and optimizes Spark-based data processing applications. ? Implements data transformations and aggregations for large datasets. ? Troubleshoots and debugs data-related issues. ? Develops in languages like PySpark and Python ? Preprocess of structured and unstructured data ? Analyzes, transforms, and creates SQL queries Key Qualifications: ? Experience in all phases of the software/database development cycle is required. ? Experience with Python and Spark in Databricks required. ? Experience with Terraform is highly desirable. ? Working experience in CI/CD deployments required. ? Must have experience using Microsoft Visual Studio and understanding of the C# programming language ? Must have experience building data services in use of SQL stored procedures, functions, or other platform constructs. ? Experience using cloud-based data technologies and/or MPP database systems is highly desirable. ? Must be able to read, analyze, and interpret business requirements and translate those into functioning computer software that executes in a relational database system. ? Must be able to write reports, business correspondence, and procedure manuals. ? Must be able to effectively present information and respond to questions from groups of managers, clients, and other associates. ? Must be able to effectively communicate verbally and in writing business issues and needs. ? Must be proactive, have teamwork abilities, be self-motivated, possess competent judgment and be deadline oriented ? Excellent analytical, problem-solving and troubleshooting skills. All employees must be willing to submit to a drug and background check ?o Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following: Medical, dental & vision Critical Illness, Accident, and Hospital 401(k) Retirement Plan Pre-tax and Roth post-tax contributions available Life Insurance (Voluntary Life & AD&D for the employee and dependents) Short and long-term disability Health Spending Account (HSA) Transportation benefits Employee Assistance Program Time Off/Leave (PTO, Vacation or Sick Leave) About TEKsystems: We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company. The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

Description: Implement CI/CD pipelines specifically for Kubernetes workloads to automate deployment processes. Automation of ADF, AzureBlob Storage into an ADF, all of the triggers involved in that, data coming across email that they manually upload every day. Infrastructure as code back ground and can actually script out templates, not just click ops. Not solving company engineer challenges with the data. More just infrastructure coding. Ansible. Shell. Cloud Management: oManage and optimize resources on Microsoft Azure and Google Cloud Platform (GCP). oEnsure high availability, performance, and security of cloud-based services. Data Warehousing: oDesign and manage data models in Snowflake and BigQuery to support business intelligence and analytics. oImplement best practices for data governance, security, and compliance within Snowflake. Automation and DevOps: oLead the development and maintenance of Ansible scripts for configuration management and automation. oImplement and maintain CI/CD pipelines to ensure smooth and reliable software deployments. BI Tools Infrastructure: oOversee the infrastructure supporting Tableau and Qlik, ensuring optimal performance for data visualization and analysis. oIntegrate these BI tools with data sources for seamless data flow and real-time analytics. User and License Management: oManage user access and licenses for BI tools, ensuring compliance with organizational policies and cost efficiency. oProvide training and support for users, enhancing tool adoption and proficiency. Infrastructure as Code (IaC): oChampion the use of Infrastructure as Code principles to manage and provision infrastructure resources. oEnsure consistency and repeatability in infrastructure deployments. Server Administration: oTroubleshoot and resolve complex server issues promptly. Monitoring and Optimization: oImplement and manage monitoring solutions to ensure system health and performance. oContinuously optimize infrastructure for cost-efficiency and performance. Kubernetes Workload CI/CD: oImplement CI/CD pipelines specifically for Kubernetes workloads to automate deployment processes. oEnsure seamless integration and deployment of containerized applications within Kubernetes environments. Skills: ci/cd, gcp, azure, IaC, Blob Storage, ADF, server administrator, sox compliance Top Skills Details: ci/cd,gcp,azure,IaC,Blob Storage,ADF Experience Level: Expert Level Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following: Medical, dental & vision Critical Illness, Accident, and Hospital 401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available Life Insurance (Voluntary Life & AD&D for the employee and dependents) Short and long-term disability Health Spending Account (HSA) Transportation benefits Employee Assistance Program Time Off/Leave (PTO, Vacation or Sick Leave) About TEKsystems: We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company. The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

**Full time role, must be hybrid 3 days/week in Jersey City, NJ, and must be able to work on a W2 basis, no sponsorship available *A global bank is seeking a VP level Azure Data Engineer with expertise in Databricks architecture to join their risk technology team*. The role will be responsible for developing, deploying solutions for risk, regulatory, compliance projects on Azure platform and be at the forefront of on-prem to cloud migration initiative. Financial services experienced is preferred but not required. Must have skills:* 10+ years of professional experience in data related projects and at least 5+ years of Azure Cloud Development* Ability to recreate existing legacy application logic and functionality into Azure Databricks/Data Lake, SQL Database and SQL Data warehouse environment.* Excellent programming skills in Python and SQLResponsibilities:* As an Azure Databricks Architect, responsible for the administration, configuration, and optimization of the Azure Databricks platform.* Provide technical expertise to deploy applications on the platform, and work with data engineers, data scientists, and other stakeholders to ensure the platform meets their requirements.* Databricks Cluster configuration, Unity catalog repository configuration.* Seamless integration with On-prem databases and Power BI reports* Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform.* Partner with architects, engineers, information analysts, business, and technology stakeholders for developing and deploying enterprise grade platforms that enable data-driven solutions.* Provide technical guidance on technology implementation and architectural changes.* Coordinating with platform, APIM, Azure DevOps, and Support.* Analyze and design technical solutions on Azure to address business needs.* Develop, test, and modify software to improve efficiency of data platforms and applications.* Proficient in Python coding and frameworks knowledge.* Ability to migrate the Data Science models written on native python language to the multi node Databricks compute.Additional information: D&I CommitmentResponsible for fostering a culture of diversity and inclusion, holding leaders accountable for creating an inclusive environment through awareness and practice of equity in recruiting, developing, and promoting diverse talent. Employees participate in a hybrid workforce model that provides employees with an opportunity to work from home, as well as, from an office. Requires that employees live within a reasonable commuting distance of their office location. Prospective candidates will learn more about their specific hybrid work schedule during their interview process.We are an equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, disability status, protected veteran status or any other characteristic protected by law. Provides reasonable accommodations for employees and applicants with disabilities consistent with applicable law. If you need a reasonable accommodation during the application process, please let us know.This position is eligible for full benefits, please reach out for further details., About TEKsystems: We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company. The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

Data Engineer Teksystems Jobs

Remote Data Engineer W2 Only Databricks Experience Preferred
October 17, 2024

Remote Data Engineer W2 Only Databricks Experience Preferred
October 13, 2024

Data Engineer
October 12, 2024

Big Data Engineer
October 7, 2024

Data Engineer With Azure Gcp
October 6, 2024

Data Engineer With Azure Gcp
October 5, 2024

Azure Data Engineer Architect W2 Only
October 5, 2024

Azure Data Engineer Architect W2 Only
October 4, 2024

Quick filters

Top companies

Data Engineer Teksystems Jobs

Remote Data Engineer W2 Only Databricks Experience PreferredOctober 17, 2024

Remote Data Engineer W2 Only Databricks Experience PreferredOctober 13, 2024

Data EngineerOctober 12, 2024

Big Data EngineerOctober 7, 2024

Data Engineer With Azure GcpOctober 6, 2024

Data Engineer With Azure GcpOctober 5, 2024

Azure Data Engineer Architect W2 OnlyOctober 5, 2024

Azure Data Engineer Architect W2 OnlyOctober 4, 2024