Data Engineer
Description
What you can expect from the work:
- You’ll be part of our data team, which also comprises of machine learning and business intelligence teams, and you will work closely with our security, infrastructure & performance (SIP) team;
- You’ll support our Data team with designing, building and managing scalable data pipelines. You will also be responsible for the architecture facilitating our batch and realtime ML models;
- You’ll be the driving force in the design and development of data solutions on our AWS hosted platform;
- You design and manage a systematic way of working with data and make sure that the data is accessible and easily understandable by the end users. You are also willing to modernise our data warehouse and make it semi-real-time and ready for the next 5 years;
- You love to automate things and make things more efficient. Technologies we are using: Docker, Kubernetes, Helm, CircleCI, Prometheus, Terraform, Kafka, AWS, Redshift, Presto, Amazon SageMaker, ElasticSearch and many more 💪;
- Data Integration: Contribute to the design and implementation of scalable ETL and data processing systems to go into our big data ecosystem, including data collection from multiple sources, cleaning, processing, ETL and the creation of a common data lake.
Requirements
About you
- BS/MS/PhD in Computer Science or related quantitative fields;
- At least 3 years of experience in data engineering, ML Ops and AWS Cloud Architecture.
- 2+ years of experience designing data warehouse/data lake and ETL architectures with big data technologies such as Spark, Spark Streaming, Hive, Presto, Kafka and/or HDFS;
- Extensive experience with Docker and Kubernetes;
- Familiar with building data architecture for scalable and real-time recommendation engines;
- Experience with optimising the data infrastructure for real-time and batch machine learning and analytics;
- Experience with SQL/NoSQL systems such as MongoDB, Cassandra, Solr, Elasticsearch, Redshift, DynamoDB, etc;
- Fluent in Python and/or Go;
- Highly organised, structured work approach and dependable;
- 2+ years experience in start-up scale software architecture is preferred.
Benefits & Perks
TicketSwap Perks & Benefits
- Remote friendly
- Macbook pro and 27'' monitor
- Friday drinks at the office
- 25 paid vacation days a year
- An electrical sit-stand desk
- Diverse team with 15+ nationalities
- Pension plan, fully paid by TicketSwap
This job has expired but you can still explore other open positions from the same company or find new ones from our amazing selection.
Ticketswap
Discover more jobs
TicketSwap is a safe, convenient and fair place to buy and sell e-tickets for concerts, festivals, sports events, theatre and day trips. We protect buyers from overpricing by keeping to a maximum 20% mark-up from the original sales price. As a buyer, you know you’ll always be paying a fair price for your tickets. Fraud is prevented by user-checks and through partnerships and collaborations with event organizers. TicketSwap is the world’s favorite place for fans to buy and sell tickets. TicketSwap is on a journey to become the world’s favourite platform for fans to buy and sell tickets. The pandemic hit the live entertainment sector hard and we can’t wait for events to start happening again. In the meantime, we haven’t sat still. We have continued working on our strategy and making big improvements behind the scenes so that we come out of this chapter stronger than ever.