Big data Jobs in US

Senior Data Engineer #2595 Position Summary: Our partner is a global manufacturer modernizing its ERP-driven data environment into a cloud-native platform for trusted analytics and forecasting. Experience and Education: BS in Computer Science, Information Systems, Software Engineer or equivalent technical field Experience building enterprise data platforms using Databricks and Azure Background in designing and owning data models sourced from ERP systems Experience working with SAP or other large-scale ERP environments History of owning data pipelines end-to-end in production environments Exposure to forecasting, analytics, or ML-enabled data use cases Experience working with globally distributed or offshore teams Skills and Strengths: Databricks Azure Data engineering Data modeling ERP data environments SAP SQL Python Lakehouse architecture ETL design Data orchestration Data quality frameworks Performance optimization Enterprise data governance Analytics enablement Forecasting data pipelines Machine learning support Systems tradeoff analysis Cross-team collaboration Technical documentation Primary Job Responsibilities: Own the Databricks-based data engineering layer used across the enterprise Design and maintain high-quality data models sourced from ERP systems Ensure data pipelines are reliable, scalable, and performant Standardize ETL patterns, orchestration, and data quality checks Improve lakehouse performance and long-term maintainability Partner closely with BI leadership to enable trusted analytics and forecasting Support ML and advanced analytics use cases through strong data foundations Establish and reinforce enterprise data governance practices Collaborate with offshore and onshore teams to ensure consistency Decide when work requires immediate fixes versus backlog prioritization Clearly explain engineering tradeoffs across cost, performance, and mai...

We are seeking a highly skilled Data Engineer focused on building, optimizing, and maintaining enterprise-grade ETL/ELT pipelines using AWS Glue, Amazon S3, and Databricks. The ideal candidate must be located in Columbus, Ohio and have strong experience with cloud data platforms, understands large-scale data processing patterns, and can design resilient, secure, and high-performance data pipelines in a production environment What You’ll Do Build, optimize, and operate scalable ETL/ELT pipelines using AWS Glue, Databricks, Spark, and Amazon S3 Transform raw, structured, and semi-structured data into analytics-ready datasets that power BI, reporting, and advanced analytics Design and maintain modern lakehouse architectures, including bronze, silver, and gold data layers Develop Spark workloads using Python (PySpark) and SQL, leveraging Delta Lake features such as ACID transactions, schema evolution, and time travel Automate and orchestrate reliable data workflows using Glue Workflows, Step Functions, Databricks Jobs, or equivalent tools Optimize performance, reliability, and cost across clusters, jobs, and pipelines Implement monitoring, logging, alerting, and recovery processes to ensure pipeline health and data quality Apply strong data governance and security practices, including IAM, encryption, access controls, validation, lineage tracking, and compliance support (SOX, PCI, SOC2) Collaborate closely with Analytics, BI, Data Science, and Application teams to translate business needs into scalable data solutions Participate in code reviews and architecture discussions, contributing to platform standards and best practices What You Bring 3+ years of experience in data engineering, ETL development, or cloud data platforms Hands-on experience with AWS Glue, Databricks, and Apache Spark Strong proficiency in Python (PySpark) and SQL Experience building and managing data lakes on Amazon S3 Understanding of data modeling concepts, including star schema and dimensional modeling Experience with Delta Lake, lakehouse architecture, and/or Unity Catalog Familiarity with orchestration tools such as AWS Step Functions, Airflow, or equivalents Knowledge of streaming pipelines (Kafka, Kinesis, Auto Loader) is a plus Experience working with version control (Git), CI/CD pipelines, and infrastructure...

Job Summary We are currently seeking a Data Analyst Intern for Summer 2026 (May 18 – early Aug). The Health Analytics Division specializes in developing advanced Information Technology and Data Management solutions for our government and commercial clients.

Senior Data Engineer Location: Washington, DC (Hybrid) Clearance: Active Secret Employment Type: Full-time Company Description We are seeking an experienced Senior Data Engineer to support a federal client in advancing enterprise-scale analytics and data-driven decision-making. Responsibilities • Build, test, and orchestrate data pipelines in Python • Design and optimize data structures, schemas, and ETL processes • Translate business use cases into SQL queries, reports, and dashboards • Manage database objects in development environments without impacting production • Automate workflows using Databricks Workflows or the Jobs API • Integrate code into GitHub/GitLab and support CI/CD practices • Diagnose data gaps and quality issues and design test cases for validation • Collaborate with developers and analysts to synchronize code and ensure reliability Qualifications • Active Secret clearance (required) • Bachelor’s in computer science, Data Engineering, or related field • 7+ years of professional experience in data engineering • Expert-level proficiency in Databricks, Apache Spark, and SQL • Proficiency in Python and SQL (2–3 years each) • Experience with ETL tools such as Kafka, Airflow, or AWS Glue • Skilled in CI/CD pipelines and GitHub/GitLab version control • Familiarity with cloud platforms (AWS, Azure, or GCP) • Strong problem-solving, debugging, and collaboration skills Show less [{"type":"people_also_viewed","href":"https://www..com/jobs/view/data-engineer-senior-at-spear-ai-4332774078","jobId":"4332774078","label":"Data Engineer - Senior"},{"type":"people_also_viewed","href":"https://www..com/jobs/view/data-engineer-at-creative-information-technology-inc-4369147042","jobId":"4369147042","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://www..com/jobs/view/data-engineer-at-aisquared-4304382237","jobId":"4304382237","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://www..com/jobs/view/data-engineer-at-visionist-inc-4311560531","jobId":"4311560531","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://www..com/jobs/view/data-engineer-at-zendr-4361285872","jobId":"4361285872","label...

The Team Our AI & Data practice offers comprehensive solutions for designing, developing, and operating advanced Data and AI platforms, products, insights, and services. LangGraph) to include: Azure: AI Foundry (design, deployment, orchestration of AI/agentic applications); OpenAI Ser...

Senior Data Engineer – Energy & Financial Markets We’re looking for a Senior Data Engineer to design, build, and scale data pipelines supporting trading, analytics, and market-facing teams. Senior Data Engineer responsibilities; Build and maintain scalable ETL pipelines using Python and AWS Design and optimize data models and workflows in Snowflake Partner with quant, trading, and analytics teams on data architecture Own data reliability, performance, and quality across market datasets Contribute to data platform architecture and cloud best practices Senior Data Engineer requirements; 5+ years’ experience in Data Engineering Strong Python, AWS (S3, Lambda, Glue, etc.), and ETL experience Hands-on Snowflake development and performance tuning Experience designing data architectures in cloud environments Knowledge of financial or energy markets (trading, pricing, risk, market data) Houston-based or open to relocation Nice to Have Experience supporting trading desks or quants Exposure to real-time or high-frequency market data Show less [{"type":"people_also_viewed","href":"https://www..com/jobs/view/data-engineer-at-ezee-fiber-4368480262","jobId":"4368480262","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://www..com/jobs/view/job-title-%C2%A0senior-data-engineer-at-guruschools-llc-4367312069","jobId":"4367312069","label":"Job Title:- Senior Data Engineer"},{"type":"people_also_viewed","href":"https://www..com/jobs/view/data-analyst-at-sysco-4370109750","jobId":"4370109750","label":"Data Analyst"},{"type":"people_also_viewed","href":"https://www..com/jobs/view/software-data-engineer-at-navitas-resourcing-group-4364017256","jobId":"4364017256","label":"Software Data Engineer"},{"type":"people_also_viewed","href":"https://www..com/jobs/view/data-analyst-ii-at-airswift-4369200716","jobId":"4369200716","label":"Data Analyst: II"},{"type":"people_also_viewed","href":"https://www..com/jobs/view/apm-predictive-analytics-engineer-intern-summer-2026-at-cams-4303865146","jobId":"4303865146","label":"APM Predictive Analytics Engineer Intern - Summer 2026"},{"type":"people_also_viewed","href":"https://www..com/jobs/view/senior-data-engineer-at-david-weekley-homes-4315030462","jobId":"4315030462","label":"Senior Data Engineer"},{"type":"people_also_viewed","href":"https://www..com/jobs/view/data-engineer-intern-2026-data-services-at-ibm-4364004643","jobId":"4364004643","label":"Data Eng...