Job Details
Senior Data Engineer
-
Company Details Confidential
-
Ref: #JOB-2424291
-
Co. Dublin,
-
No of positions: 1
-
Paid Position
-
40 hours per week
-
Negotiable
-
Published On: 10 Dec 2025
-
Closing On: 07 Jan 2026
In order to work in Ireland a non-EEA National, unless they are exempted, must hold a valid employment permit. Please review the Eligibility and requirements for an employment permit if you are unsure of your eligibility to apply for this vacancy.
Overview Are you passionate about building scalable data solutions and ensuring data integrity in high-impact financial technology? Do you thrive in solving complex data challenges while maintaining rigorous quality standards? Join the team behind Crypto Secure, a cutting-edge risk assessment platform helping banks gain visibility into crypto spend, transaction volumes, and AML risk exposure. Working with modern technologies like Snowflake, Hadoop, Spark, NiFi, and cloud-native architectures, you’ll play a dual role: designing robust data pipelines and implementing comprehensive testing strategies to guarantee reliability and trust. ________________________________________ Role Responsibilities Data Engineering & Platform Development • Design, build, and maintain scalable data pipelines using Snowflake, Hadoop, Spark, NiFi, and related big data technologies. • Implement data architectures and optimize workflows for massive financial datasets. • Write high-quality, maintainable code in Python and SQL following best practices. • Integrate data governance principles, metadata management, and lineage tracking into solutions. Data Quality Assurance & Testing • Develop automated testing frameworks and validation scripts for ETL processes and data transformations. • Implement data quality checks, reconciliation processes, and regression testing suites to ensure accuracy, completeness, and timeliness. • Perform unit, integration, and end-to-end testing for data pipelines and schema changes. • Use tools like dbt tests, custom Python utilities for automated validation. Collaboration & Agile Delivery • Work closely with Data Engineers, Product, and Data Science teams to embed testing into the development lifecycle. • Participate in agile ceremonies (sprint planning, backlog refinement, retrospectives) with a focus on quality and delivery. • Support production incident response with rapid data validation and root cause analysis. Continuous Improvement • Stay current with emerging data engineering and testing technologies. • Contribute to team knowledge sharing, mentoring junior engineers, and improving technical standards. • Shape best practices for data reliability, testing automation, and CI/CD integration. ________________________________________ Skills & Qualifications Core Technical Expertise • Advanced SQL and experience with relational and NoSQL databases. • Strong experience with Snowflake, Hadoop, Spark, Databricks, Kafka, and cloud data platforms. • Proficiency in Python for both data engineering and test automation. • Familiarity with orchestration tools and workflow management systems. Testing & Quality • Proven experience in data testing methodologies, ETL validation, and automated testing frameworks. • Knowledge of data profiling, anomaly detection, and statistical validation techniques. • Experience integrating testing into CI/CD pipelines. Professional Attributes • Strong problem-solving and analytical skills with attention to detail.
- This vacancy is suitable for Remote/Blended working
- Sector:
Career Level
- Experienced [Non-Managerial]
Candidate Requirements
Essential- Minimum Experienced Required (Years): 8
- Minimum Qualification:No Qualification
- Ability Skills:Skilled Trade(s), Technical IT
- Competency Skills:Teamwork, Working on own Initiative
Show Center Title: No
