Big data Jobs

[Applicants: Over 200 applicants | Industry: IT Services and IT Consulting | Type: Full-time | Level: Mid-Senior level] Classification:ContractContract Length:6 MonthsPosition SummaryWe are looking for aBig Data Engineer/Senior Levelto join our team inNashville, TN.The Big Data Engineer/Senior-Level serves as a primary development resource for design, writing code, test, implementation, document functionality, and maintain of NextGen solutions for the GCP Cloud enterprise data initiatives. This candidate will have a record of accomplishment of participation in successful projects in a fast-paced, mixed team environment.ResponsibilitiesWork with data engineers, data architects, SIEM Team stakeholders to understand product requirements and then design, build, and monitor streaming platforms and capabilities that meet today's requirements but can gracefully scale.Implement automated workflows that lower manual/operational costs, define and uphold SLAs for timely delivery of data, and move the company closer to democratizing streaming data.Enable a self-service SIEM data architecture supporting query exploration, dashboards, data catalog, and rich data discovery.Promote a collaborative team environment that prioritizes effective communication, team member growth, and success of the team over success of the individual.Design and create real-time data services using Confluent Kafka and/or Streamsets that accelerate the time from idea to insight.Adheres to ...

[Applicants: İlk 25 başvurandan biri olun] Talan – Positive InnovationTalan is an international consulting group specializing in innovation and business transformation through technology. This includes transferring data from/to the data lake, technical validations, busi...

CSQ227R46As a Big Data Solutions Architect (Resident Solutions Architect) in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help customers to get most value out of their data.

[Applicants: Legyen az első 25 pályázó között | Level: Not Applicable] wherewework.hu on behalf of:Employers from HungaryAdd your CV to wherewework platform and we’ll match your skills with the right opportunities as soon as they become available!Applicants should build data lakes or big data platforms, manage distributed processing and optimize large-scale data workflows.Continue browsing wherewework to discover what it’s like to work at various companies, review your recent interview experiences and even your past or current work experiences! Our community grows through your feedback, thanks for being part of it!

[Industry: Defense and Space Manufacturing | Type: Full-time | Level: Mid-Senior level] SummaryThe Sr Systems Administrator performs and oversees a variety of functions to ensure IT infrastructure is available, reliable, secure, and stable. They will apply advanced judgment and analysis in the evaluation, selection, installation, and maintenance of systems software and hardware.

[Applicants: Over 200 applicants | Industry: IT Services and IT Consulting | Type: Full-time | Level: Mid-Senior level] About PersistentWe are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Throughout our market-leading growth, we’ve maintained a strong employee satisfaction score of 8.2/10.At Persistent, we embrace diversity to unlock everyone's potential.

[Industry: Financial Services | Type: Full-time | Level: Not Applicable] Job DescriptionThis is your chance to change the path of your career and work at one of the world's leading financial institutions.As a Software Engineer for Big Data and Analytics at JPMorgan Chase within Consumer and Community Banking Data Technology, you will be an integral part of an agile team that enhances, builds, and delivers trusted, market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you will be responsible for delivering critical technology solutions across multiple technical areas and business functions, supporting the firm’s objectives using Java, J2EE, Microservices, Python, Spark, Scala, and AWS for Business Banking Data Products.Job ResponsibilitiesOversee all aspects of data strategy, governance, data risk management, reporting, and analytics.Manage risks associated with data use, retention/destruction, and privacy.Design, develop, code, test, debug, and deploy scalable and extensible applications.Produce high-quality code utilizing Test Driven Development techniques.Participate in retrospectives to drive continuous improvement within the feature team.Participate in code reviews, ensuring all solutions align with pre-defined architectural specifications.Implement automation through Continuous Integration and Continuous Delivery.Manage cloud development and deployment, supporting applications in both private and public clouds.Required Qualifications, Capabilities, And SkillsFormal training or certification in software engineering concepts and 5+ years of applied experience.Advanced knowledge of architecture, design, and business processes.Full Software Development Life Cycle experience within an Agile framework.Expert-level skills in Java, AWS, database technologies, Python, Scala, Spark/PySpark, or any ETL technology.Experience developing and decomposing complex SQL on RDMS platforms.Experience with Data Warehousing con...

[Applicants: Be among the first 25 applicants | Industry: Financial Services | Type: Full-time | Level: Not Applicable] Job DescriptionJob responsibilitiesDesign & build new applications utilizing leading edge technologies and modernize existing applicationsImplement batch & real-time software components consistent with architectural best-practices of reliability, security, operational efficiency, cost-effectiveness and performanceEnsure quality of deployed code via automated unit, integration & acceptance testingCollaborate with multi-national agile development, support and business teams to meet sprint objectivesParticipate in all agile meetings & rituals, including daily standups, sprint planning, backlog reviews, demos, and retrospectivesProvide level 2 support for production systemsLearn and applies system processes, methodologies, and skills for the development of secure, stable code and systemsHands on applicaitn development leveraging distributed compute such as Apache flink or Spark on very large datasetsDesign and development of applications that leverage the AWS infrastructure deploying software components on AWS using common compute and storage services such as EC2, EKS, Lambda, S3Lead and deliver projects from concept to production across PNI (Personalization and Insights) platformRequired Qualifications, Capabilities, And SkillsFormal training or certification on software engineering concepts and 5+ years applied experienceHands-on practical experience in Frameworks, system design, application development, testing, and operational stabilityExperience with Apache Spark, Apache Flink or similar large-scale data processing enginesExperience with Distributed Datastores (e.g. Cassandra, Red Shift)Experience designing, developing and deploying software components on AWS using common compute and storage services such as EC2, EKS, Lambda, S3Experience with Big Data / Distributed / cloud technology (AWS Big data services like lambda, glue, glue emr, Performance tuning, Streaming, KAFKA, Entitlements etc., )Experience with Apache Spark, Ray or similar large-scale data processing enginesProficiency in automation and continuous delivery methodsProficient in all aspects of the Software Development Life CycleAdvanced understanding of agile methodologies such as CI/CD, Application Resiliency, and SecurityDemonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, BigData, artificial intelligence, m...

Full Stack Developer – Cloudera (Big Data)Freelance | Long-termAbout the ProjectShakers is supporting Reply in sourcing seniorFull Stack Developersfor alarge-scale Big Data & energy platform, operating in a high-volume, mission-critical environment.RoleYou will contribute across thefull software lifecycle, from technical analysis to development, testing, bug fixing and production support, working with modern Big Data stacks.Key ResponsibilitiesDevelop and maintain applications on Cloudera-based platformsImplement new features and resolve complex technical issuesParticipate in architecture and technical design discussionsEnsure code quality and compliance with delivery standardsMaintain clear technical documentationRequirements (Must-have)5+ years in software development (or 9+ with non-university degree)Strong experience withJava, Python and ScalaHands-on work withCloudera, Spark, Kafka, HBase/PhoenixSolid understanding of Big Data architecturesFluentEnglish or SpanishNice to haveHadoop ecosystem (YARN, HDFS, S3A)Apache Iceberg, NiFi, DatabricksAtlassian tools (Jira, Bitbucket, Bamboo)

Cloud Data Engineer (AWS-Big Data)Location:Nagpur/Pune/Chennai/BangalorePurpose of the Position:As a Cloud Data Engineer, this position requires candidate who are enthusiastic about specialized skills in AWS Services and Big Data. Support the cloud COE initiatives.Nurture and Grow Talent-Provide support for recruitment, coaching and mentoring, and building practice capacity in the firm in Cloud.AWS Integration-Integrate various AWS services to create seamless workflows and data processing solutions.Data Pipeline Development-Design, build, and maintain scalable data pipelines using AWS services to support data processing and analytics.Essential Skills:Knowledge of following AWS Services required: S3, EC2, EMR, Severless, Athena, AWS Glue, Lambda, Step FunctionsCloud Databases– AWS Aurora, Singlestore, RedShift, SnowflakeBig Data- Hadoop, Hive, Spark, YARNProgramming Language– Scala, Python, Shell Scripts, PySparkOperating System- Any flavor of Linux, WindowsStrong SQL SkillsOrchestration Tools: Apache AirflowHands-on in developing ETL workflows comprising complex transformations like SCD, deduplications, aggregations, etc.Desirable Skills:Experience and Technical Knowledge in DatabricksStrong Experience with event stream processing technologies such as Kafka, KDSKnowledge of Operating System- Any flavor of Linux, ETL Tools Informatica, TalendExperience with at least one major Hadoop platform (Cloudera, Hortonworks, MapR) will be a plusQualifications:Overall 7-9 years of IT experience & 3+ years of AWS related projectBachelors degree in computer science, engineering, or related field (Masters degree is a plus)Demonstrated continued learning through one or more technical certifications or related methodsQualities:Hold strong technical knowledge and experienceShould have the capability to deep dive and research in various technical related fieldsSelf-motivated and focused on delivering outcomes for a fast growing team and firmAble to communicate persuasively through speaking...

Zone Operations Manager - Automotive Refinish - Midwest Midwest USA Field position / company car provided Must live near a major metropolitan area/airport in the Midwest We are looking for an Operations Manager to join our Automotive Refinish team in the Midwest. As a Zone Operations Manager - Automotive Refinish - Midwest, you create chemistry by...