Big Data Java Developer - Global Relay

Joining the Reporting product line, you would work as a member of a small, highly focused team, responsible for delivering backend services for a highly scalable reporting and analytics platform, using leading edge technologies. Tech Stack: Micro-services Container Platforms (OpenShift, Kubernetes, CRC, Docker) File formats (Avro, Parquet, Orc) Large scale data processing (Kafka) Large scale data platforms (Hadoop, Trino, Spark) Dependency injection frameworks (Spring, Guice) Splunk CI/CD Build tools (Maven, Git, Jenkins) Frameworks: Vert.x Text search engines (Lucene, ElasticSearch) Your Job: Develop ETL and ELT jobs and processes Support data analysis and design efforts within the wider team Migrate existing services to microservices, with the goal of reducing complexity at the design and architecture level Write unit and integration tests for your Java code Collaborate with testers in development of functional test cases Develop deployment systems for Java based systems Collaborate with product owners on user story generation and refinement Monitor and support the operation of production systems Participate in knowledge sharing activities with colleagues Pair programming and peer reviews About You: Required Experience: Minimum 8 years of Java development experience in an Agile environment, building scalable applications and services with a focus on big data solutions and analytics 7+ year experience in developing ETL / ELT processes using relevant technologies and tools Experienced in working with data lakes and data warehouse platforms for both batch and streaming data sources ANSI SQL experience or other flavours of SQL Experience of unstructured, semi-structured and structured data processing A good understanding of ETL/ELT principles, best practices and patterns used Experienced in some big data technologies such as Hadoop, Spark and other Apache platform products Experience with RESTful services Passion for Test Driven Development CI/CD Exposure to data visualisation and Business Intelligence solutions Show less [{"type":"people_also_viewed","href":"https://uk.linkedin.com/jobs/view/software-engineer-at-quantcast-4319565173","jobId":"4319565173","label":"Software Engineer"},{"type":"people_also_viewed","href":"https://uk.linkedin.com/jobs/view/founding-engineer-%C2%A3240k%2B-at-jack-jill-4356721592","jobId":"4356721592","label":"Founding Engineer (£240k+ )"},{"type":"people_also_viewed","href":"https://uk.linkedin.com/jobs/view/junior-software-engineer-backend-at-fanduel-4356566149","jobId":"4356566149","label":"Junior Software Engineer - Backend"},{"type":"people_also_viewed","href":"https://uk.linkedin.com/jobs/view/software-engineer-at-deliveroo-4330477975","jobId":"4330477975","label":"Software Engineer"},{"type":"people_also_viewed","href":"https://uk.linkedin.com/jobs/view/software-engineer-systematic-trading-%C2%A3300k%2B-at-paragon-alpha-hedge-fund-talent-business-4368627543","jobId":"4368627543","label":"Software Engineer - Systematic Trading - £300k+"},{"type":"people_also_viewed","href":"https://uk.linkedin.com/jobs/view/python-software-engineer-at-prima-4149696449","jobId":"4149696449","label":"Python Software Engineer"},{"type":"people_also_viewed","href":"https://uk.linkedin.com/jobs/view/software-engineer-at-flock-4358117793","jobId":"4358117793","label":"Software Engineer"},{"type":"people_also_viewed","href":"https://uk.linkedin.com/jobs/view/backend-software-engineer-at-encord-4262454164","jobId":"4262454164","label":"Backend Software Engineer"},{"type":"people_also_viewed","href":"https://uk.linkedin.com/jobs/view/software-engineer-at-deutsche-bank-4366629975","jobId":"4366629975","label":"Software Engineer"},{"type":"people_also_viewed","href":"https://uk.linkedin.com/jobs/view/software-engineer-internship-at-targetjobs-uk-4320179154","jobId":"4320179154","label":"Software Engineer, Internship"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/digital-marketing-specialist-jobs","label":"Empleos de Especialista en marketing digital"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/marketing-manager-jobs","label":"Empleos de Jefe de marketing"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/j2ee-developer-jobs","label":"Empleos de Desarrollador de J2EE"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/software-engineer-intern-jobs","label":"Empleos de Becario de ingeniería de software"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/computer-software-engineer-jobs","label":"Empleos de Ingeniero de software informático"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/web-development-specialist-jobs","label":"Empleos de Desarrollo web"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/software-intern-jobs","label":"Empleos de Becario de software"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/back-end-developer-jobs","label":"Empleos de Desarrollador de back-end"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/junior-software-engineer-jobs","label":"Empleos de Ingeniero de software júnior"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/graduate-software-engineer-jobs","label":"Empleos de Ingeniero de Software Graduado"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/game-programmer-jobs","label":"Empleos de Programador de videojuegos"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/student-software-engineer-jobs","label":"Empleos de Estudiante de Ingeniería de Software"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/developer-internship-jobs","label":"Empleos de Prácticas de desarrollo"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/developer-jobs","label":"Empleos de Desarrollador"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/junior-developer-jobs","label":"Empleos de Desarrollador auxiliar"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/associate-software-engineer-jobs","label":"Empleos de Ingeniero adjunto de software"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/frontend-developer-jobs","label":"Empleos de Desarrollador de front-end"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/clinical-programmer-jobs","label":"Empleos de Programador clínico"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/java-software-engineer-jobs","label":"Empleos de Desarrollador Java"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/statistical-programmer-jobs","label":"Empleos de Programador estadístico"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/network-programmer-jobs","label":"Empleos de Programador de redes"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/engineer-jobs","label":"Empleos de Ingeniero"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/engine-programmer-jobs","label":"Empleos de Programador de Motor de Juego"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/client-services-engineer-jobs","label":"Empleos de Ingeniero de servicios para clientes"},{"type":"similar_search","href":"https://www.linkedin.com/jobs/web-developer-jobs","label":"Empleos de Desarrollador web"}]