Data Engineer. We are looking for an experienced data engineer with a minimum of 3 years’ experience in industry. Be proficient in software engineering with proven experience in Agile and Design Techniques.Building the next generation of commerce infrastructure, services, and analytics as part of the research and development organization of the largest global payment processor. Role Overview We are looking for an experienced data engineer with a minimum of 3 years’ experience in industry. Be proficient in software engineering with proven experience in Agile and Design Techniques. To have the ability to work on end to end solutions, across multi-disciplined SCRUM teams. A good understanding of test mythology is a must, to ensure seamless integration with current policies in line with our DevOps department. To have a good understanding of machine learning, particularly in Spark, Hive and Hadoop HDFS. To be comfortable in working with large data sets and have enterprise experience in developing end to end ETL pipelines. To be able to think outside of the box and be confident in working to deadlines. Primary Objectives and Skills Must have 3+ years’ experience working as a data engineer at an enterprise level. Must have a knowledge of machine learning , such as pattern recognition, classification and predictive modelling. Enterprise experience in using Spark, Python, Hive and Hadoop HDFS . Have both relational and NOSQL DB experience, predominately in Oracle, PostgreSQL and MongoDB . Should have enterprise experience working with cloud technology, specifically AWS . To be proficient in both Python and Java . Be confident in developing end to end ETL processes. Additional Skillsets. To have had some base understanding of relevant statistical methods. To have had industry experience of working within a Data Science team before. To be comfortable in presenting to large audiences. To be knowledgeable in SCRUM Agile methodologies. To be able to think outside the box, without mitigating risk to quality or performance. Education. First Class Honours Degree in either a Computer Science, Data Engineering or Mathematical discipline. We Want To Talk With People Who Want To Be a part of a next generation data science team who will be working specifically in R&D, with the goal to introduce new ways of detecting and preventing card fraud. Ask questions of the biggest datasets. Be passionate about pushing the boundaries of existing methods. Have impact on day one. Help build and join a team on an exciting mission and new journey. This job originally appeared on RecruitIreland.com.
10 days ago