Overview & Purpose
SOFTSWISS is hiring a Senior Data Engineer to join our Data Operations team.
We need a true, experienced, accomplished professional who shares our culture and values.
Purpose of the Role
You’ll design and build scalable data products and infrastructure that power real-time analytics, enhance business reporting, and support innovation across SOFTSWISS platforms.
Key Responsibilities
- Build business-critical, robust and self-service data products using Apache Spark, Kafka, Delta Lake and other big data technologies.
- Design an extensible, highly scalable and optimised real-time data platform.
- Develop and maintain the data products crucial for product innovation and business reporting.
- Continually acquire new data sources to develop increasingly rich datasets that characterise users’ behaviour and finances.
- Drive innovation by exploring new technologies and developing creative solutions to complex data challenges.
Required Experience
- 5+ years of software engineering experience with expertise in development, deployment, and integration.
- Proficiency in at least one high-level programming language (Scala, Java, Python or equivalent).
- Experience in data environments, such as Data Lakes, Data Warehouses, Data Marts, Data transformation concepts and working with large data volumes.
- Experience in building ETL pipelines to perform feature engineering on large-scale datasets using Apache Spark and Delta Lake.
- Experience with sourcing and modelling data from application APIs.
- Experience with building stream-processing applications using Spark-Streaming, Kafka Streams or others.
- Strong analytical and problem-solving skills.
- Strong communication skills in English and Russian.
Nice to Have
- Experience with workflow orchestration tools such as Apache Airflow.
- Familiarity with cloud platforms (AWS, GCP, Azure, OCI).
- Familiarity with CDC and Debezium.
- Familiarity with Clickhouse.
- Familiarity with Data Lineage.
- Familiarity with low-latency NoSQL datastores (such as HBase, Cassandra, MongoDB), Relational databases (such as MySQL, Postgres) and Search systems (such as ElasticSearch, Solr).
- DevOps tools (e.g. Ansible, Docker, Kubernetes).
- Masters, PhD, or equivalent experience in Software Engineering, Mathematics or Computer Science.
Learn more about our hiring process here – what to expect, how to prepare, and what makes SOFTSWISS different.