View Our Website View All Jobs

Data Engineer

People are at the core of Fareportal. We are one of the fastest growing travel technology companies in the world; our portfolio of travel brands, including flagship product CheapOair, receives over 100 million visitors annually. We are looking for a Data Engineer to join our team.

As a data engineer at Fareportal, you will be responsible for building out the data tools and processes to support the creation of insights that will drive our business. You will participate in the design and implementation of the entire data pipeline, from capturing and storing data to processing that data and making that data available to other team members. We are passionate about making data-driven decisions and mining data for actionable insights and need talented people to help us make that happen.

Responsibilities:

  • Create and maintain optimal data pipeline architecture for providing a real time and batch processing platform for all algorithms to run on
  • Coordinate the movement of data from original data sources into noSQL data lakes and cloud environments
  • Assemble large, complex data sets that meet functional / non-functional business requirements
  • Build and maintain the ETL infrastructure for a wide variety of data sources
  • Assist in troubleshooting data-related technical issues and identify proper solutions

Requirement:

  • 3-6 years experience developing, maintaining, and testing infrastructures for data generation
  • 4 year technical degree (Computer Science or Engineering)
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases, such as Redis, ElasticSearch, Postgres or Cassandra Experience working with distributed systems and an understanding of fault tolerance, partitioning, consistency, etc. in them
  • Experience with object-oriented/object function scripting languages: Python, Java, Kotlin, Scala, etc
  • Has built complex ETLs and have a solid understanding of data serialization formats such as ProtoBuf, Avro or JSON
  • Worked with software development environments and using modern version control systems

Nice to have:

  • Experience with CI/CD infrastructure such as TeamCity, GitLab or Jenkins
  • Experience with containers and container orchestration such as Docker, Kubernetes or Marathon Experience with Infrastructure as Code, such as Ansible, Terraform or CloudFormation
  • Experience moving bulk data with tools such as Scoop
  • Experience with Mesos, DC/OS or similar
Read More

Apply for this position

Required*
Apply with Indeed
Attach resume as .pdf, .doc, .docx, .odt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

150
Human Check*