Overview:
SOFTSWISS continues to expand the team and is looking for a Middle Data Engineer.
We need a true, experienced and accomplished professional who shares our culture and values
Key responsibilities:
- Design, construct, install, test and maintain datasets for the team, ensuring data availability and accessibility
- Assist in the design and maintenance of scalable data pipelines for data collection, integration and transformation using Python and Airflow
- Monitor data pipeline performance, troubleshoot issues and implement improvements to enhance efficiency and reliability
- Work collaboratively with different teams to address data-related issues and help enhance the efficiency and effectiveness of data use
- Support the management and optimisation of our ClickHouse databases, ensuring data accuracy and availability
- Contribute to the development of data models and database design to support our data applications and analytics platforms
- Stay up-to-date with industry trends and advancements in data engineering technologies and methodologies
Requirements
- 2+ years of commercial experience
- Good knowledge of and experience with database technologies, specific experience with ClickHouse is a big plus
- Good knowledge SQL and experience working with relational databases
- Proficiency in Python, with experience using data manipulation and ETL pipelines
- Basic understanding of data pipeline orchestration tools, with Airflow familiarity highly desirable
- Outstanding problem-solving skills and attention to detail
- Eagerness to learn and adapt in a fast-paced environment
- Good communication skills, both written and verbal
- English and Russian knowledge (B2+)
Nice to have:
- Knowledge of data modelling techniques and data warehousing concepts
- Previous experience / familiarity with Tableau, especially building and managing data sources
- Familiarity with Airflow