Data Engineer Jobs
3.82K subscribers
102 photos
1 video
2 files
457 links
DE вакансии #remote, #onsite
Admin: @storm_de
Курсы для новичков:
@data_human
Career Hub: @data_career_hub
Обсуждаем поиск работы:
https://t.me/+eZSdeuzw-TAyYzMy
Download Telegram
Обзор собеседования

Должность: Data Engineer
Компания: ООО Тера Интегро
Тип собеса: #тех_собес
Грейд: #Junior #middle
Вилка: 210к
Вакансия: https://spb.hh.ru/vacancy/128761959
Итог собеса: Отказ, тк кандидат еще учится в универе ❌

Краткий обзор собеседования:
Вопросы про БД:
• Как вы начинаете изучать почему запрос стал работать медленнее какие шаги предпринимаете и на что смотрите?
• Какие физические виды Join бывают, их алгоритм выполнения?
• (Greenplum) Есть таблица транзакций 1 млрд записей она соединяется с таблицей sheets и таблицей clients по foreign key, все 3 таблицы распределены равномерно. В таблице транзакций в колонке для соединения с таблицей sheets 300 млн Null значений. Будут ли проблемы при Join этих трех таблиц?
• Как избавиться от Broadcast при соединении двух таблиц?

Вопросы по Python:
• List что за тип данных?
• Что такое lambda функция и отличия от обычной?

Вопросы по dbt (dbt Core):
• Как запустить одну модель dbt, все предыдущие модели, которые необходимо для рассчета текущей?
• Для чего используют макросы в dbt?



Как вам собес?🤔

it пингвин | data engineer 🐧

#собеседование #подписчик
Please open Telegram to view this post
VIEW IN TELEGRAM
🔥11🤔6❤2😁2👍1
Social Discovery Group looking for a Data Engineer Team Lead
Georgia (Грузия)


Social Discovery Group (SDG) is the 3rd largest social discovery company in the world, uniting 60+ brands with 500 million users. We solve the problems of loneliness, isolation, and disconnection by transforming virtual intimacy into the new normal. Our portfolio includes online communication platforms focusing on AI, game mechanics, and video streaming - Dating.com, DateMyAge, Cupid Media, Dil Mil, Kiseki, and others.

SDG invests in IT startups worldwide. Our investments include OpenAI, Patreon, Flo, Clubhouse, Woebot, Flure, Astry, Coursera, Academia.edu, and many others.

We bring together a team of like-minded people and IT professionals specialising in the creation and development of globally impactful social discovery products. Our international team of 1200 professionals and digital nomads works all over the world.

Our teams of digital nomads work remotely from Cyprus, Malta, the USA, Armenia, Georgia, Kazakhstan, Montenegro, Poland, Latvia, Serbia, Spain, Portugal, UAE, Israel, Turkey, Thailand, Indonesia, Japan, Hong Kong, Australia and many other locations.

In August 2024, we achieved Great Place to Work US Certification™! This achievement reflects our core belief that a truly exceptional workplace is built on trust, pride, and camaraderie—not just great perks.


We are looking for a Data Engineer Team Lead.

Your main tasks will be:

Development of various services in Python: integration with marketing partners, obtaining data from various sources;
Creation and support of processes on Airflow;
Development/refinement of reports on SSRS / SuperSet dashboards;
Creation/support of SQL DWH, creation/support of stored procedures;

We expect from you:
- Knowledge of SQL at the confident level (window functions, subqueries, various joins);
- Knowledge of Python (experience from 1 year);
- Basic query optimisation skills;
- Experience with MSSQL, SSRS, Superset (or other BI solutions);
- Experience with Airflow.

The advantage will be experience with:
1. Google Cloud Platform
2. Google Api (Ads, Analytics, Drive)
3. Facebook Marketing API, AppsFlyer API, Bing Ads API, etc.

What do we offer:
- REMOTE OPPORTUNITY to work full-time;
- Vacation 28 calendar days per year;
- 7 wellness days per year (time off) that can be used to deal with household issues, to lie down and recover without taking sick leave;
- Bonuses up to $5000 for recommending successful applicants for positions in the company;
- 50% payment for professional training, international conferences and meetings;
- Corporate discount for English lessons;
​- Health benefits. According to the paychecks, if you are not eligible for corporate medical insurance, the company will pay up to $1,000 gross per employee per year. This can be spent on self-purchase of health insurance or on doctors’ fees for yourself and close relatives (spouse, children);
​- Workplace organisation. The company provides all employees with an equipped workspace and all necessary equipment (table, armchair, Wi-Fi, etc.) in our offices or co-working locations. In the other locations, the company provides reimbursement of workplace costs up to $ 1000 gross once every 3 years, according to the paychecks. This money can be spent on the rent of the co-working room, on equipping the working place at home (desk, chair, Internet, etc.) during those 3 years.
- Internal gamified gratitude system: receive bonuses from colleagues and exchange them for our merchandise, team building activities, massage certificates, etc.

Sounds good? Join us now!
Senior Data Engineer (DWH и ETL)

Финтех
Ставка: до 2000 руб в час
Локация: РФ
Гражданство: РФ
Контракт: Бессрочно

Проект: разработка центрального хранилища данных в банке (DWH)

Требования:

Опыт в банках от 1 года;

Опыт работы разработчиком ETL от 2х лет СТРОГО

Продвинутый уровень SQL, опыт оптимизации sql-запросов

Опыт разработки в GreenPlum и Oracle, знание PL/SQL

Опыт с ETL инструментами: AirFlow, Informatica IPC - критичное требование

Опыт работы с большим объемом данных (таблицы с десятками миллиардов записей)

Опыт работы с Python, PySpark


Контакты: @mary_shimoff
😁11👎2🤬1
Forwarded from Neurotech Jobs
Data Engineer at inbrain-neuroelectronics.com
Barcelona, Catalonia, Spain

About the Role
As a Data Engineer at INBRAIN, you will be in charge of implementing the internal data collection, ingestion and automatic analysis tools. You will be at the forefront of bringing advanced healthcare solutions to market, making a tangible difference in people´s lives worldwide.

Requirements
- Degree in Software Engineering, Electrical/Electronics engineering, Physics or equivalent practical experience
- Relevant 3+ years of experience in Data Engineering
- Hands-on expertise with SQL and noSQL databases (such as PostgreSQL, MongoDB), analysis pipelines (using tools like Apache Spark or Pandas), containerization (Docker), cloud platforms (AWS, Azure, or Google Cloud), and job orchestration and management tools (such as Kubernetes, Harbor, Jenkins and Apache Airflow)
- Fluent in English (company language)
- Approachable, methodical, and good communication

About Inbrain-neuroelectronics
Inbrain Neuroelectronics is a Barcelona-based neurotech company developing advanced brain-machine interfaces using graphene-based neuroelectronics for therapeutic applications like Deep Brain Stimulation. Led by a world-class team of neurotech experts, scientific founders, and a prestigious clinical advisory board including Nobel Laureate Kostya Novoselov, the company boasts a 60-person international team from 20 countries. As an ISO 13485 compliant organization backed by European Commission funding, they focus on investigational devices poised for market approval.

https://app.reccy.dev/j/jh75zwsm7jacpmskqxkdm87mss7zkcn8
❤3👍1
Обожаю
😁25🔥2
Компания: Tribe (thetribe.com.cy)
Локация и формат работы: только с территории Кипра в Лимассоле (помогаем с визами, релокацией и тд.)
Позиция: Middle Data Engineer
Компенсация: обсуждаем индивидуально
Описание продукта и задач: Огромный и увлекательный продукт в сфере онлайн-развлечений от крупнейшего мирового холдинга в сфере iGaming.
🔻Вы:
- от 3 лет опыта в роли Data Engineer
- Имеете опыт написания тестов
- Имеете опыт работы с Airflow / Dagster
- Обладаете продвинутыми навыками в написании и оптимизации SQL запросов
- Имеете опыт работы с MySQL / PostgreSQL
- Имеете опыт работы с Clickhouse / Greenplum
- Имеете опыт работы с Apache Kafka / RabbitMQ
- Имеете опыт работы с DBT
- soft-skills на отличном уровне
- позитив, юмор и рок:)
🔻Чем будете заниматься?
- Интегрировать новые ETL/ELT процессы
- Проектировать и развивать архитектуру хранилищ
- Разрабатывать и развивать внутренние инструменты
- Принимать участие в ревью кода коллег
🔻Мы:
- годовой бонус по результатам работы
- компенсация квартиры до 750 Euro
- помощь с релокацией, оформлением визы для Вас и членов семьи
- возможность беспроцентной рассрочки
- оплачиваемый отпуск по законам Кипра
- оплачиваемый спорт
- частичная оплата английского
- корпоративное питание в офисе (завтраки, обеды)
- офисный спортзал
- оплата выставок, конференций
- технически сложные задачи и возможность развиваться как вертикально, так и горизонтально

📌контакт: @DzmitryS6
👍7❤1
Ищем тех, кто построит Центр компетенций данных в Hamkor Bank (Ташкент)
Hamkor Bank (Узбекистан) — это 30 лет стабильности, которые мы сейчас дополняем мощным технологическим рывком. Мы строим Data Center of Excellence и пересобираем платформу данных практически с нуля.
Мы в активной фазе создания ядра DWH. У тебя есть шанс заложить фундамент архитектуры и внедрить Best Practices в крупнейшем банке региона.
Наш стек: Greenplum (ADB), Kafka, Debezium, dbt, Airflow, OpenMetaData, Python.
Open Roles:
GP Team Lead
• Focus: Лидинг команды инженеров, дизайн ядра DWH на Greenplum, тюнинг производительности.
• Requirements: Управление командой 2+ года, Deep Dive в Greenplum от 4 лет.
DQ Team Lead
• Focus: Выстраивание Data Governance и DQ-фреймворка.
• Requirements: SQL, Python, dbt. Опыт с OpenMetaData — мастхэв.
Greenplum Engineer
• Focus: Развитие платформы, сборка ADB, настройка интеграций (Kafka/Debezium).
• Requirements: DE-опыт 4+ года, практический Greenplum от 2 лет.
DQ Analyst-Engineer
• Focus: Настройка DQ-чеков внутри пайплайнов, работа с dbt.
• Requirements: SQL, BI-инструменты, понимание того, как не допустить Bad Data в прод.
Data Analyst-Engineer
• Focus: Витрины данных, dbt-пайплайны, BI (Superset/Metabase).
• Requirements: SQL 2+ года, умение строить чистые и эффективные витрины.

Location: Ташкент (помогаем с релокацией, делимся лайфхаками по городу).
Пиши @mariyaaitbay Обсудим задачи, профиты и проект
❤2👍2
We at Symfa https://symfa.com/ are looking for a Senior Data Engineer to join the project for a large US insurance client.

Location: EU, Georgia, Belarus.
Tech stack: Azure (Synapse Analytics, Blob Storage), Apache Spark (PySpark, Spark SQL), Delta Lake, Azure Data Factory, T-SQL, Azure Log Analytics.

We'd love to hear from you if you have:
✅ 5+ years of experience in Data Engineering or similar roles;
✅Strong hands-on experience with Azure data stack: Azure Data Factory, Azure Synapse, PySpark, Spark SQL, Delta Lake;
✅Solid understanding of Data Warehouse concepts: Star schema, Snowflake schema, data normalization, data modeling, Slowly Changing Dimensions;
✅Good command of SQL (T-SQL) and experience in building production-grade data pipelines;
✅English level B2 or higher.


🔥Ready to take the next step in your career? Feel free to contact: @kgrowll
Platform Administrator (Databricks)

We offer 100%  remote, full-time work.

Nitka Technologies develops software for customers in the US and Europe and brings together about 300 professionals from Eastern Europe, North and South America, Armenia, Georgia and Kazakhstan.
We are looking for an experienced Platform Administrator (Databricks) for a long-term project. The customer is a company in California, an industry leader in the sale of tickets to events in Europe and the USA.

Requirements:
• Experience in implementation, integration or technical support;
• Experience with Linux, Bash;
• Confident SQL skills;
• Strong experience of working with AWS Infrastructure (ec2, s3, iam, vpc, secret management, sqs);
• Experience with Python sufficient for writing small scripts or applications;
• Experience of maintaining Databricks jobs & environments;
• Experience with REST API/SDK;
• Understanding of file-based databases (DeltaLake, Parquet, Hive);
• Understanding of of cluster types & node families;
• Spoken English at Intermediate level or higher;

Would be a plus:
• Databricks REST API / Databricks SDK;
• Working with schema evolution, time travel, vacuum, compaction, z-order;
• Debugging corrupted delta tables (conflicting commits, tombstones, missing checkpoints);
• Understanding of acid implementation on top of object storage;
• Spark knowledge (jobs, partitions, queries), experience in Kafka or similar technology, familiarity with Terraform / Gitlab CI;
• Cost monitoring for platform services and objects;
• Experience in enterprise Data platforms;

Working conditions:
• Remote work;
• Full-time (8 hours/day);
• Attractive USD compensation;
• Paid vacation, holidays.

Contacts:
Telegram: @irishka_kartun
Mail: irina.kartun@nitka.com
DATA ENGINEER

We offer 100% remote, full-time work with a flexible schedule.

Nitka Technologies develops software for customers in the US and Europe and brings together about 300 professionals from Eastern Europe, North and South America, Armenia, Georgia and Kazakhstan.
We are looking for an experienced Data Engineer to join our team for a long-term project.
The customer is an American company that develops and implements innovative technological solutions in the field of veterinary medicine and pet care. The company designes unique DNA tests for dogs that provide owners with complete information about the breed of their pets, potential health risks and unique features of the animal.

Skills required:
• 5+ years of experience as Data Engineer 
• Advanced skills in Python for ETL processes, including data cleaning, transformation, and loading
• Strong SQL skills  
• Understanding the principles of DWH building
• Proven experience in using DBT 
• Strong expertise in working with Amazon Redshift, including performance tuning and optimization
• Hands-on experience with FiveTran for data integration and pipeline automation
• Proficiency in using various AWS services (AWS S3)
• Experience with GitHub Actions and IAC (CloudFormation or CDK)
• Nice to have experience of using the Tableau
• Bonus points if you are familiar with AWS Athena, Typescript
• Strong spoken and written English skills (Intermediate level and more)

Working conditions:
• Remote work
• Full-time (8 hours/day)
• Interaction with a team from the USA
• Flexible schedule without time trackers
• Attractive USD compensation
• Paid vacation, holidays

Contacts:
Telegram: @irishka_kartun
Mail: irina.kartun@nitka.com
🔥 К нам в Mayflower ищем Analytics Engineer уровня Senior🔥
https://lnkd.in/dwmytzGC

Рассматриваем кандидатов с релокацией на Кипр 🇨🇾🌊☀️ (релокация семьи, детей, животных оплачивается за счет компании + выплачивается бонус). У сотрудников есть удаленка 2 месяца в год из любой точки мира.

Что делать:
Превращать бизнес-требования от аналитиков в устойчивые data-модели и витрины (Spark, Iceberg, ClickHouse, dbt), то есть готовить silver/gold слои (итоговые репорты аналитики делают сами). Писать и оптимизировать SQL, обеспечивать качество данных через автотесты, документировать логику и улучшать производительность пайплайнов, работая в тесной связке с аналитиками и дата инженерами.

Требования:
- SQL (advanced level)
- Python
- Airflow
- dbt
- Clickhouse
- умение покрывать данные тестами, алертами, мониторингом
- понимание, как моделировать данные

Плюсом, но не обязательно:
- Spark, including PySpark
- S3 + Iceberg

У нас высоконагруженный видео-стриминг сервис, около 20Тб данных в день, сотни миллионов пользователей, интересный продукт, современный стек, менеджеры, которые по-настоящему «дата дривен», очень крутой офис с завтраками и обедами за счет компании, новая техника apple, валютная зп, куча спортивных плюшек, топ медстраховка, соблюдаем work-life-balance.

Ссылка на пост в Линкедин
Data Engineer

- Work in an international IT product company with offices in Poland, Georgia, Malta;
- Remote full-time work or work from a comfortable office.

N1 Partners is a fast-growing company operating in the iGaming (Gambling/Betting) sector. As part of our growth, we're looking for a Data Analyst (Data Engineer) to strengthen our analytics team and help improve the performance of our web products.

Responsibilities:
Handle incoming requests from internal departments (automation, integrations, scripts/services).
Maintain, fix, and refactor existing bots and automation mechanisms (cron/Airflow).
Develop and support web scrapers and integrations with external APIs.
Prepare and export data for reporting purposes (PostgreSQL → Google Sheets/Tableau).
Ensure system stability: logging, alerts, testing, documentation.

Requirements:
1.5+ years of commercial experience with Python.
Strong SQL skills (PostgreSQL) and experience using pandas for data transformations.
Advanced web scraping skills: HTTP, anti-bot practices, proxy/agent rotation; tools such as Playwright, Selenium, BeautifulSoup, or Parsel (not necessarily all).
Experience in task automation: cron/Airflow, CLI tools, or microservices.
Practical experience with Linux, Docker, Git, and basic testing (pytest).
English level — B1/B2 (reading and written communication).

Nice to Have:
Understanding of iGaming KPIs (LTV, ARPU, Retention, Churn, ROI, RTP) and internal business processes.
Applied knowledge of slot mechanics (RNG, RTP, volatility).
Experience with ClickHouse and basic AWS knowledge.
Data quality control (DQ), ETL/ELT pipelines, practical use of Airflow.
Integrations with Google APIs (Sheets/Drive) and experience working with Tableau.
Stack: Python, PostgreSQL, pandas, cron/Airflow, Docker, Linux, Google Sheets, Tableau.

Working Conditions:
Work in an international IT product company with offices in Poland, Georgia, Malta;
Remote full-time work or work from a comfortable office.
Flexible schedule. It is enough to coordinate time zones and have intersections of working hours with the team;
Paid 4 Sick Days and 1 Day Off per calendar year;
Free online English lessons with a native speaker;
Trainings, internal meetings, participation in international professional conferences and corporate events.

📩 Recruiter contact: tg @dobrovolskajjja
🚀 Data Engineer (Mid) - Sparrow Card
🌍 Remote | Full-time
📍 Любая точка мира, кроме Беларуси и России

В Satellite ищем Data Engineer в финтех-проект Sparrow Card.

Задачи:
-Data pipelines и ETL на Python
-SQL для трансформации и валидации данных
-Databricks (Spark, Delta Lake) - основная среда
-Оркестрация через Airflow
-Data quality и стабильность пайплайнов
-Работа в AWS
-Git и базовый CI/CD

Мы ищем:
-2-4 года опыта в Data / Software Engineering
-Сильный Python + SQL
-Опыт с Databricks и Airflow
-Понимание ETL и cloud-архитектуры
-Английский B2 и выше

Если хочешь расти в финтехе и работать с современным data-стеком - пиши в личные сообщения @UladzislavaR
🔥4
Я знаю, вы подписались, чтобы получать вакансии, но сейчас мне нужна ваша помощь.
Распишите, пожалуйста, в комментариях, что надо знать DE вкатуну по Airflow?
Ну вот прям базовый минимум знаний, что позволило бы хоть за какую-то вакансию зацепиться.
Data Delivery Lead
Location: #Remote
Experience Required: 14+ Years
Employment Type: Contract / Full-Time
Industry: Private Equity

About the Client:
The client is one of the biggest Private Equity firms.

Role Overview
We are looking for a Data Delivery Lead with strong experience in Private Equity and Private Credit, along with a solid background in investment banking. The role requires hands-on expertise in Azure Databricks and Data Lake environments.

Mandatory Experience
14+ years of overall experience
Investment Banking experience
Private Credit experience (Mandatory)
Private Equity experience (Mandatory)

Technical Skills
Azure Databricks
Data Lake
Data Ingestion

If interested, whatsapp me
+919477572400

Click the link directly for WhatsApp
https://wa.me/+919477572400
😱14😁3❤2
Data Automation Specialist (Internal Communications team)

Компания: Social Discovery Group
Опыт работы: 3–6 лет
Подработка
График: свободный
Рабочие часы: по договорённости
Формат работы: #remote

We are looking for a Data Automation Specialist (Internal Communications team) for short-term part-time contract with the potential to transition into a full-time position, who will help us transform scattered data on internal communications into a clear, visualized reporting system

Your main tasks will be:

Automating data collection and processing for:
- Slack (where API access is restricted);
- Confluence page views;
- Internal event surveys;
- Google Analytics — enabling named tracking of key materials (e.g., quarterly digests);
Connecting, cleaning, and visualizing data in Google Sheets dashboards;
Setting up a highly automated data pipeline with minimal manual effort;
Researching and proposing the best automation and tracking methods given current limitations.

We expect from you:
- Experience scripting data automation and integration (e.g., Python, Google Apps Script);
- Experience extracting data from non-standard sources (e.g., Slack without API access) is a big plus;
- Strong skills in Google Sheets: formulas, pivot tables, charts;
- Familiarity with analytics platforms, primarily Google Analytics;
- Ability to test and suggest unconventional solutions;
- Experience with Confluence is a plus;
- Basic understanding of internal communications and how to measure them is a nice-to-have.

Ссылка на HH
Телеграм рекрутера:
@Kseniya_Leshik
❤1
А вы знали, что если зарегистрироваться на моем сайте как ментор, то в поисковиках вы будете отображаться в топах?
Если вы менторите или планируете этим заниматься, давайте сделаем для вас страничку, при готовом контенте это займет 5 минут.
Пишите в лс: @storm_de
Актуальный список менторов:
https://www.dataengineers.pro/mentors
👍3😁3❤2🔥2
🚀 Hiring: Data Engineer | FinTech
#Remote | European Time Zone

We are searching for an experienced Data Engineer to manage large-scale data flows and support data infrastructure. The role combines maintaining existing systems with developing new solutions, with a strong focus on data stability and real-time quality.

WHAT YOU'LL DO:
- Build and enhance data pipelines (historical & real-time) – aggregation, processing, verification
- Develop and optimize Python scripts for data integration from external sources
- Ensure data quality through verification processes, issue detection, and resolution
- Develop Data Lake architecture, refactor pipelines, optimize raw data storage
- Monitor critical services, respond to alerts, troubleshoot issues

WHAT WE EXPECT:
- 3+ years in Data Engineering or Python development (fintech/trading/finance background preferred)
- Expert Python skills: OOP, multithreading, multiprocessing, asyncio
- Proficiency with Pandas, NumPy, Matplotlib, Plotly, Apache Airflow
ClickHouse, SQL, Git, Linux/Unix, technical English
- Data Lake experience is a plus; Grafana, Dash, Dask/Ray is a bonus

WHAT WE OFFER:
- Remote with flexible hours
- Flexible employment: B2B, full-time
- 28 days vacation + 13 flexible days off
- Relocation support available to select countries

💬 Interested or know someone who might be a great fit? Reach out to anastasia@new.hr

Source: Linkedon post