Junior Data Engineer (Databricks)

4 дн. назад

ПольшаJunior

pythonpyspark

Design, build and maintain data pipelines and collaborate with product teams to develop scalable data solutions for a SaaS product.

Design, build, and maintain data pipelines using Python/PySpark.
Collaborate with an international team to develop scalable data solutions.
Conduct in-depth analysis and debugging of system bugs (Tier 2).
Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists and workflows.
Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding.
Write unit/integration tests to ensure the quality and reliability of data services.
Work with Gitlab to manage code, CI/CD and collaborate with team members.
Utilize Databricks for data processing and management.
Work in Azure cloud.

Programming: Minimum of 1-2 years as data/software engineer, or in a relevant field .
Python working knowledge: Coding experience in Python, particularly in delivering/maintaining data pipelines and troubleshooting code-based bugs. Experience working with large codebases, working with an IDE and Git.
Data Skills: Structured approach to data insights and diagnostic skills for data related issues.o data insights.
Cloud: Familiarity with cloud platforms (preferably Azure ).
Data Platforms: Knowledge of Databricks , Snowflake, or similar data platforms.
Database Skills: Knowledge of relational databases, and working experience with SQL.
Documentation: Experience in creating and maintaining structured documentation.
Testing: Proficiency in utilizing testing frameworks (pytest) to ensure code reliability and maintainability.
Version Control: Experience with Git and Gitlab or equivalent.
English and Polish Proficiency: B2 plus.
Interpersonal Skills: Strong collaboration abilities, willing to learn new skills and tools, adaptive and exploring mindset. We're looking for candidates that do not fear to reach out to others.

Big Data: Experience using Apache Spark/PySpark.
Knowledge of Docker and Kubernetes .
Ability to travel abroad once/twice a year for an on-site team building (Oslo, Norway) .

Flexible working format - remote, office-based or flexible
A competitive salary and good compensation package
Personalized career growth
Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
Active tech communities with regular knowledge sharing
Education reimbursement
Memorable anniversary presents
Corporate events and team buildings
Other location-specific benefits
*not applicable for freelancers

Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality solutions that inspire customer confidence. Additionally, identify opportunities to develop self-service tools that streamline data onboarding and make it more accessible for our users.
Our Client was established with the mission to fundamentally transform the execution of capital projects and operations. Designed by industry experts for industry experts, our Client’s platform empowers users to digitally search, visualize, navigate, and collaborate on assets. Drawing on 30 years of software expertise and 180 years of industrial legacy as part of the renowned Scandinavian business group , Client plays an active role in advancing the global energy transition. The company operates from Norway, the UK, and the U.S.