Forwarded from Старый Хрыч
#вакансия #puppet #hadoop #prometheus #jvm #linux #troubleshooting
вакансия ops enginer
Локация: питер, воронеж, москва, омск
формат работы: удалёнка, но офисы для оформления только в городах выше.
з\п 210-240 тыс рублей
Требования:
Опыт работы с jvm приложениями и их troubleshooting от 3 лет
Хорошие знания Puppet/Ansible, но осваивать придётся Puppet
Опыт работы с Apache Hadoop (Spark, Yarn, HDFS, Hive, Flume, Flink, Mapreduce,)
Опыт работы с efk, понимание чем отличается обычный Elasticsearch от Opendistro, умение настраивать и дополнять обработку логов перед записью.
Опыт работы Apache Spark(умение понимать логи, и объяснить разрабу где он был не прав).
Опыт работы с Hive( понимание особенности sql запросов, умение дебажить ошибки из логов по записи и таймаутам).
Опыт работы с Vertice, Clickhouse, presto, Hue, PostgreSQL
опыт работы с AirFlow желателен
Что предстоит - обслуживание и развитие платформы на 25 пбайт, большое число аналитики и много много Scala job в Spark, выгрузки и загрузки по 300-400 тб в день
контакт @erzentd
вакансия ops enginer
Локация: питер, воронеж, москва, омск
формат работы: удалёнка, но офисы для оформления только в городах выше.
з\п 210-240 тыс рублей
Требования:
Опыт работы с jvm приложениями и их troubleshooting от 3 лет
Хорошие знания Puppet/Ansible, но осваивать придётся Puppet
Опыт работы с Apache Hadoop (Spark, Yarn, HDFS, Hive, Flume, Flink, Mapreduce,)
Опыт работы с efk, понимание чем отличается обычный Elasticsearch от Opendistro, умение настраивать и дополнять обработку логов перед записью.
Опыт работы Apache Spark(умение понимать логи, и объяснить разрабу где он был не прав).
Опыт работы с Hive( понимание особенности sql запросов, умение дебажить ошибки из логов по записи и таймаутам).
Опыт работы с Vertice, Clickhouse, presto, Hue, PostgreSQL
опыт работы с AirFlow желателен
Что предстоит - обслуживание и развитие платформы на 25 пбайт, большое число аналитики и много много Scala job в Spark, выгрузки и загрузки по 300-400 тб в день
контакт @erzentd
Forwarded from Victoria Alimova
#Belgrad #DataEngineer #AWS #Prometheus #Postgres #ElasticSearch #ClickHouse #Python #Greenplum
📌Data Engineer
Practicum
Belgrade, Serbia
$4500-6500
Practicum is a service for anyone looking to master the unit profession. Our team develops, operates, and expands the infrastructure, empowering Practicum to make informed decisions. Practicum is pushing hard into the US and other countries. That's why we're looking for engineers to help our fantastic team quickly grow and reach new data heights.
Our technologies:
•AWS, EFbK Stack, Prometheus, GitLab, Lambda, Kafka.
•Postgres, ElasticSearch, ClickHouse, Metabase.
•Python, Golang.
Responsibilities:
•Handle our data processing infrastructure for analytics and user services.
•Design and build displays for data pulled from raw product sources and external APIs.
•Configure streamlined data updates.
•Develop a logical DWH architecture to make life easy for analysts.
•Improve DWH stability and reliability.
•Formulate requirements for new data sources and integrate them into existing aggregate data models.
Qualifications:
•3+ years of experience in data engineering.
•At least 2 years experience in AWS
•Experience working with AWS, Postgres, Greenplum, and ClickHouse.
•Proficiency in or a desire to learn Python / Golang.
•Ability to write clean, optimal code that is easy to maintain and test.
•Habit of covering your code with tests.
•Proven background in developing ETL processes.
•Experience working with relational databases and APIs.
•Experience designing dashboard displays.
•Desire for self-development and studying new technologies and tools.
•Readiness to make decisions and take responsibility.
•Desire and understanding of how to build loaded systems.
•Familiarity with fault tolerance and service scaling.
•Ability to find common ground with colleagues and the team.
Benefits:
•Relocation to Serbia
•Engaging work with the opportunity to influence the process and result
•A strong team to grow with
•Remote work or relocation assistance
•Power compensation
•Discounts from the company's partners
Contact: @vrtrlmv
📌Data Engineer
Practicum
Belgrade, Serbia
$4500-6500
Practicum is a service for anyone looking to master the unit profession. Our team develops, operates, and expands the infrastructure, empowering Practicum to make informed decisions. Practicum is pushing hard into the US and other countries. That's why we're looking for engineers to help our fantastic team quickly grow and reach new data heights.
Our technologies:
•AWS, EFbK Stack, Prometheus, GitLab, Lambda, Kafka.
•Postgres, ElasticSearch, ClickHouse, Metabase.
•Python, Golang.
Responsibilities:
•Handle our data processing infrastructure for analytics and user services.
•Design and build displays for data pulled from raw product sources and external APIs.
•Configure streamlined data updates.
•Develop a logical DWH architecture to make life easy for analysts.
•Improve DWH stability and reliability.
•Formulate requirements for new data sources and integrate them into existing aggregate data models.
Qualifications:
•3+ years of experience in data engineering.
•At least 2 years experience in AWS
•Experience working with AWS, Postgres, Greenplum, and ClickHouse.
•Proficiency in or a desire to learn Python / Golang.
•Ability to write clean, optimal code that is easy to maintain and test.
•Habit of covering your code with tests.
•Proven background in developing ETL processes.
•Experience working with relational databases and APIs.
•Experience designing dashboard displays.
•Desire for self-development and studying new technologies and tools.
•Readiness to make decisions and take responsibility.
•Desire and understanding of how to build loaded systems.
•Familiarity with fault tolerance and service scaling.
•Ability to find common ground with colleagues and the team.
Benefits:
•Relocation to Serbia
•Engaging work with the opportunity to influence the process and result
•A strong team to grow with
•Remote work or relocation assistance
•Power compensation
•Discounts from the company's partners
Contact: @vrtrlmv
Forwarded from Viktoria Alimova
Добрый день)
Немного изменили позицию. Можем ли еще раз опубликовать?
#Belgrad #DataEngineer #Prometheus #Postgres #ElasticSearch #ClickHouse #Python #Greenplum
📌Data Engineer
Practicum
Belgrade, Serbia
$4500-6500
Practicum is a service for anyone looking to master the unit profession. Our team develops, operates, and expands the infrastructure, empowering Practicum to make informed decisions. We are hiring for experts who have design experience of high load analytics DWH and also will build that DWH on top of S3, Spark, Clickhouse.
Our technologies:
•AWS, EFbK Stack, Prometheus, GitLab, Lambda, Kafka.
•Postgres, ElasticSearch, ClickHouse, Metabase.
•Python, Golang.
Responsibilities:
•Design and build infrastructure on top of CDC from PostgreSQL to S3, Spark, Parquet, ClickHouse.
•Maintain data infrastructure for analytics.
•Design SLI / SLO for analytics infrastructure.
•Help analytics to grow and improve their infrastructure understanding skills.
•Formulate requirements for new data sources and integrate them into existing aggregate data models.
Qualifications:
•3+ years of experience in data engineering.
•At least 2 years experience in AWS.
•Experience working with AWS, PostgreSQL, S3, Spark, Parquet, and ClickHouse.
•Experience working with relational databases and APIs.
•Experience designing data marts.
•Proven background in developing ETL processes.
•Proficiency in or a desire to learn Python / Golang.
•Ability to write clean, optimal code that is easy to maintain and test.
•Desire for self-development and studying new technologies and tools.
Readiness to make decisions and take responsibility.
•Desire and understanding of how to build loaded systems.
•Familiarity with fault tolerance and service scaling.
•Ability to find common ground with colleagues and the team.
Benefits:
•Relocation to Serbia
•Engaging work with the opportunity to influence the process and result
•A strong team to grow with
•Remote work or relocation assistance
•Power compensation
•Discounts from the company's partners
Contact: @vrtrlmv
Немного изменили позицию. Можем ли еще раз опубликовать?
#Belgrad #DataEngineer #Prometheus #Postgres #ElasticSearch #ClickHouse #Python #Greenplum
📌Data Engineer
Practicum
Belgrade, Serbia
$4500-6500
Practicum is a service for anyone looking to master the unit profession. Our team develops, operates, and expands the infrastructure, empowering Practicum to make informed decisions. We are hiring for experts who have design experience of high load analytics DWH and also will build that DWH on top of S3, Spark, Clickhouse.
Our technologies:
•AWS, EFbK Stack, Prometheus, GitLab, Lambda, Kafka.
•Postgres, ElasticSearch, ClickHouse, Metabase.
•Python, Golang.
Responsibilities:
•Design and build infrastructure on top of CDC from PostgreSQL to S3, Spark, Parquet, ClickHouse.
•Maintain data infrastructure for analytics.
•Design SLI / SLO for analytics infrastructure.
•Help analytics to grow and improve their infrastructure understanding skills.
•Formulate requirements for new data sources and integrate them into existing aggregate data models.
Qualifications:
•3+ years of experience in data engineering.
•At least 2 years experience in AWS.
•Experience working with AWS, PostgreSQL, S3, Spark, Parquet, and ClickHouse.
•Experience working with relational databases and APIs.
•Experience designing data marts.
•Proven background in developing ETL processes.
•Proficiency in or a desire to learn Python / Golang.
•Ability to write clean, optimal code that is easy to maintain and test.
•Desire for self-development and studying new technologies and tools.
Readiness to make decisions and take responsibility.
•Desire and understanding of how to build loaded systems.
•Familiarity with fault tolerance and service scaling.
•Ability to find common ground with colleagues and the team.
Benefits:
•Relocation to Serbia
•Engaging work with the opportunity to influence the process and result
•A strong team to grow with
•Remote work or relocation assistance
•Power compensation
•Discounts from the company's partners
Contact: @vrtrlmv
Forwarded from Денис
2) Kafka Platform Engineer / Streaming Engineer
Компания: GetMeGit
З/П: $15-$25 в час
Тип занятоcти: Удаленка
Локация: ЕС (строго)
Позиция: Senior
Международный проект: построение крупномасштабной Kafka-based event streaming платформы для real-time обработки данных и системных интеграций.
Что предстоит делать:
* Строить и поддерживать Kafka-based streaming-решения.
* Разрабатывать stream-processing сервисы и интеграции.
* Управлять конфигурацией платформы, производительностью и production-поддержкой.
Требования:
- Сильный практический опыт с Apache Kafka
- Опыт с Kafka Streams, Kafka Connect или Schema Registry
- Уверенное владение Java, Scala или Python
- Опыт работы с Kubernetes
- Глубокое понимание event-driven архитектуры и распределённых систем
- Опыт с инструментами мониторинга (Prometheus, Grafana)
- Опыт с CI/CD и Git
- Английский C1
- Локация - строго ЕС
Будет плюсом:
- Strimzi Operator
- Debezium / CDC
- GitOps / ArgoCD
- Avro и schema evolution
- Опыт с PostgreSQL, Oracle, Redis или Data Lakes
- Знание platform security, authentication и сертификатов
Контакты для связи: @boweiguo
#Kafka #KafkaStreams #Java #Scala #Python #Kubernetes #Prometheus #Grafana #CICD #Git #Debezium #ArgoCD
Компания: GetMeGit
З/П: $15-$25 в час
Тип занятоcти: Удаленка
Локация: ЕС (строго)
Позиция: Senior
Международный проект: построение крупномасштабной Kafka-based event streaming платформы для real-time обработки данных и системных интеграций.
Что предстоит делать:
* Строить и поддерживать Kafka-based streaming-решения.
* Разрабатывать stream-processing сервисы и интеграции.
* Управлять конфигурацией платформы, производительностью и production-поддержкой.
Требования:
- Сильный практический опыт с Apache Kafka
- Опыт с Kafka Streams, Kafka Connect или Schema Registry
- Уверенное владение Java, Scala или Python
- Опыт работы с Kubernetes
- Глубокое понимание event-driven архитектуры и распределённых систем
- Опыт с инструментами мониторинга (Prometheus, Grafana)
- Опыт с CI/CD и Git
- Английский C1
- Локация - строго ЕС
Будет плюсом:
- Strimzi Operator
- Debezium / CDC
- GitOps / ArgoCD
- Avro и schema evolution
- Опыт с PostgreSQL, Oracle, Redis или Data Lakes
- Знание platform security, authentication и сертификатов
Контакты для связи: @boweiguo
#Kafka #KafkaStreams #Java #Scala #Python #Kubernetes #Prometheus #Grafana #CICD #Git #Debezium #ArgoCD
🤡86🔥1