Data Engineer – ETL & Cloud Data Platforms - IQVentures

We are seeking a highly skilled Data Engineer focused on building, optimizing, and maintaining enterprise-grade ETL/ELT pipelines using AWS Glue, Amazon S3, and Databricks. The ideal candidate must be located in Columbus, Ohio and have strong experience with cloud data platforms, understands large-scale data processing patterns, and can design resilient, secure, and high-performance data pipelines in a production environment What You’ll Do Build, optimize, and operate scalable ETL/ELT pipelines using AWS Glue, Databricks, Spark, and Amazon S3 Transform raw, structured, and semi-structured data into analytics-ready datasets that power BI, reporting, and advanced analytics Design and maintain modern lakehouse architectures, including bronze, silver, and gold data layers Develop Spark workloads using Python (PySpark) and SQL, leveraging Delta Lake features such as ACID transactions, schema evolution, and time travel Automate and orchestrate reliable data workflows using Glue Workflows, Step Functions, Databricks Jobs, or equivalent tools Optimize performance, reliability, and cost across clusters, jobs, and pipelines Implement monitoring, logging, alerting, and recovery processes to ensure pipeline health and data quality Apply strong data governance and security practices, including IAM, encryption, access controls, validation, lineage tracking, and compliance support (SOX, PCI, SOC2) Collaborate closely with Analytics, BI, Data Science, and Application teams to translate business needs into scalable data solutions Participate in code reviews and architecture discussions, contributing to platform standards and best practices What You Bring 3+ years of experience in data engineering, ETL development, or cloud data platforms Hands-on experience with AWS Glue, Databricks, and Apache Spark Strong proficiency in Python (PySpark) and SQL Experience building and managing data lakes on Amazon S3 Understanding of data modeling concepts, including star schema and dimensional modeling Experience with Delta Lake, lakehouse architecture, and/or Unity Catalog Familiarity with orchestration tools such as AWS Step Functions, Airflow, or equivalents Knowledge of streaming pipelines (Kafka, Kinesis, Auto Loader) is a plus Experience working with version control (Git), CI/CD pipelines, and infrastructure...