Client Industry: Retail Gasoline/Food ServicesPosition Title: Sr. Data EngineerLocation: REMOTE (EST OR CST ONLY)Duration: 6 month extending contract Requirements:<ul><li>Bachelor's degree or experience in Data Science and Management field.</li><li>At least 8 years’ experience as a Data Engineer or similar role.</li><li>At least 3 years’ experience with Databricks on any cloud platform</li><li>Strong proficiency in SQL and experience with relational databases.</li><li>Proficiency in at least one programming language (e.g., Python, Java, Scala) for data processing and scripting.</li><li>Knowledge of data modeling and database design principles.</li><li>Good experience with cloud platforms, such as AWS, Azure, or Google Cloud.</li><li>Excellent problem-solving and communication skills.</li></ul> Preferred Qualifications:<ul><li>Bachelor’s degree in Computer Science, Engineering, Mathematics or a related field.</li><li>Experience with stream processing technologies. i.e., Kafka</li><li>Knowledge of data governance and security best practices.</li><li>Experience and Certifications in AWS and Databricks technologies.</li></ul> Responsibilities: <ul><li>Design, develop, and maintain scalable and efficient data pipelines for extracting, transforming, and loading (ETL) data from various sources into our data warehouse leveraging AWS, Databricks, Python and SQL technologies.</li><li>Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.</li><li>Optimize and troubleshoot existing data pipelines for performance and reliability.</li><li>Implement data quality and validation processes to ensure accuracy and consistency of data.</li><li>Stay updated on industry trends and best practices in data engineering to continuously improve our data infrastructure.</li><li>Work closely with data scientists, analysts, and other stakeholders to understand data use cases and provide the necessary infrastructure and support.</li><li>Assemble large, complex sets of data that meet non-functional and functional business requirements.</li><li>Identify, design and implement internal process improvements including re-design infrastructure for greater scalability, optimize data delivery, and automating manual processes.</li><li>Thought Leadership with ability to bring to the team options, ideas, efficiencies and new ways to manage data within scope/parameters of the organization</li></ul> Compensation: $65.00-80.00/HR

Responsibilities:• Design and build data processing pipelines using tools and frameworks in the Databricks/Azure ecosystem.• Analyzes requirements and architecture specifications to create a detailed design document. - Responsible for data engineering functions including, but not limited to data extract, transformation, loading, integration in support of modern cloud computing platforms like Azure and Databricks• Develop, Construct, Test and maintain data architectures.• Ensure data architecture will support the requirements of the business.• Assist in the discovery of new opportunities for data acquisition.• Work with huge data sets and work with other Data Engineers and/or Scientists on analyzing this data using algorithms and machine learning.• Implement and configure big data technologies as well as tune processes for performance at scale.• Design and build ETL pipelines to automate the ingestion of structured and unstructured data.• Work with DevOps engineers on CI/CD, and IaC (Continuous Integration, Continuous Delivery, and Infrastructure as Code) processes; read specifications and translate them into code and design documents; and perform code reviews and develop processes for improving code quality.• Strong in scalability, performance, and availability of our systems.• Responsible for deploying the developed solution in Azure environment and examining the results for accuracy.• Responsible for defining and assisting in the implementation/maintaining Data Governance Policies, Quality Standards, Data Security Data Classifications, and the creation of a data catalog. Basic Qualifications:• Bachelor’s degree in computer science or similar field with 10 years' experience as a data engineer, Database Administrator, or software developer.• 5 years’ experience developing SQL and Python.• 5 years' experience working in an Azure Environment• 5 years' experience creating, implementation and maintaining a Data Government Policy Preferred Qualifications:• Master’s degree in computer science or related field• Familiarity with other query languages Path, SPARQL, etc. -- e.g., XPath, MongoDB query language, Elasticsearch query language, JSON Experience with the following technologies is also highly desirable: Python, Airflow.• Advanced Data Analytics / Machine Learning Techniques / Large Language models Professional Skills:• Strong technical communication skills; both written and verbal.• Strong problem solving and structuring skills.• Ability to identify and learn applicable new techniques independently as needed.

Sr. Data Engineer/Architect - Remote Innova Solutions has an immediate need for a Sr. Data Engineer/Architect for a fully remote job based out of CST time zone: <ul><li>The jobs will work on the Data Team, small team of 4 people - all high level engineers. </li><li>Job is on an ongoing indefinite contact, potential contract to hire </li><li>Job will operate out of the CST time zone </li><li>This will be working to create one client database and work closely with UI team. </li><li>Will work with Salesforce CRM team as customer data transitions to new platform (TBD) </li></ul> Technology Stack:<ul><li>Data Engineering - Databricks - PySpark</li><li>Cloud development / architecture, preferably AWS</li><li>Cloud deployments - writing CI/CI pipelines, terraform a big plus (or platform-specific cloud IAC w/willingness to learn Terraform)</li><li>Data warehouse / Lakehouse - dimensional modeling (e.g., Kimball, Inmon)</li><li>Power BI - experience in DAX, plus for experience with Tabular Editor 2/3, DAX Studio</li><li>Experience with Kafka topics, e.g., reading from / publishing to topics, familiarity with pub/sub integration pattern</li><li>Data Engineering - Databricks - ETL / ELT - PySpark, spark SQL. Experience with RDBMS platforms (One/Many of MSSQL, Oracle, Postgres, etc.), SQL, sprocs, functions, etc.</li><li>Experience working with public APIs (e.g., REST using GET/PUT/POST etc.) to access and work with 3rd party vendor data</li></ul> PAY RANGE AND BENEFITS:Pay Range- $200-300K/year range Benefits: Innova Solutions offers benefits( based on eligibility) that include the following: Medical & pharmacy coverage, Dental/vision insurance, 401(k), Health saving account (HSA) and Flexible spending account (FSA), Life Insurance, Pet Insurance, Short term and Long term Disability, Accident & Critical illness coverage, Pre-paid legal & ID theft protection, Sick time, and other types of paid leaves (as required by law), Employee Assistance Program (EAP).Website: https://www.innovasolutions.com/ is an Equal Opportunity Employer and prohibits any kind of unlawful discrimination and harassment. Innova Solutions is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment on the basis of race, color, religion or belief, national origin, citizenship, social or ethnic origin, sex, age, physical or mental disability, veteran status, marital status, domestic partner status, sexual orientation, or any other status protected by the statutes, rules, and regulations in the locations where it operates. If you are an individual with a disability and need a reasonable accommodation to assist with your job search or application for employment, please contact us at or (770) 493-5588. Please indicate the specifics of the assistance needed. Innova Solutions encourages all interested and qualified candidates to apply for employment opportunities. Innova Solutions (HireGenics/Volt) does not discriminate against applicants based on citizenship status, immigration status, or national origin, in accordance with 8 U.S.C. § 1324b.The company will consider for employment qualified applicants with arrest and conviction records in a manner that complies with the San Francisco Fair Chance Ordinance, the Los Angeles Fair Chance Initiative for Hiring Ordinance, and other applicable laws.ABOUT INNOVA SOLUTIONS: Founded in 1998 and headquartered in Atlanta, Georgia, Innova Solutions employs approximately 50,000 professionals worldwide and reports an annual revenue approaching $3 Billion. Through our global delivery centers across North America, Asia, and Europe, we deliver strategic technology and business transformation solutions to our clients, enabling them to operate as leaders within their fields. American Cybersystems, Inc is acting as an Employment Agency in relation to this vacancy.

Data Engineer Jobs in St. Louis

Remote Sr Data Engineer Databricks Python Aws
July 21, 2024

Data Engineer 100 Remote
July 20, 2024

Sr Data Engineerarchitect Remote
June 28, 2024

Quick filters

Top companies

Data Engineer Jobs in St. Louis

Remote Sr Data Engineer Databricks Python AwsJuly 21, 2024

Data Engineer 100 RemoteJuly 20, 2024

Sr Data Engineerarchitect RemoteJune 28, 2024

Quick filters

Top companies

Remote Sr Data Engineer Databricks Python Aws
July 21, 2024

Data Engineer 100 Remote
July 20, 2024

Sr Data Engineerarchitect Remote
June 28, 2024