Senior Big Data Engineer

Contact: careers@square-sense.com
Technology domains: Data layer design, Scala, Python, Kafka stack, Spark, HDFS, Docker, Kubernetes, GCP, Azure
Location: Paris, France
Duration: CDI

Square Sense

Square Sense is a fast-growing platform that provides advanced data solutions to global real estate developers, investors and managers. The company builds AI-powered “brains” that improve the operational and financial performance of real estate assets by providing real-time pattern detection and autonomous optimization. They also greatly enhance the overall experience for the tenants.

Square Sense was founded in 2017 in Paris by a multi-cultural team of talented engineers and data scientists.

Software Engineering at Square Sense

In Square Sense's Software Engineering Team we are building a multitude of products in the domains of data collection, analysis, visualization and IoT manipulation. Our systems collect data from IoT devices and third-party data sources, process ingested data in streaming and batch modes, organize processed data, provide the APIs to access it (thus creating a data analytics platform), or use third-party APIs to manipulate the physical world (thus making an automated decision making solution).

Our main programming languages are Scala and Python. Our solution is built with modern technologies such as (list is not exhaustive): Docker and Kubernetes, Kafka stack (Kafka, Kafka Connect, KSQL), Spark, Airflow. Our production platforms run in the public clouds (Azure, GCP, AWS) and employ related services such as GKE, Dataproc (GCP) and AKS, HDInsight (Azure) to name a few, and we deploy the software in a Continuous Delivery process. We focus on high quality of our software and all team members take seriously such practices as automated testing and PR reviews for instance.

All team members are responsible for the overall design and architecture, development, quality, production delivery, and monitoring.

Objectives

As a Senior Big Data Engineer / Data Architect you will be a member of the Software Engineering Team. This position implies close collaboration with all members of the Software Engineering Team, as well as members of our Data Science Team, who design and implement various data processing algorithms.

Primary objectives of a Senior Big Data Engineer are:

  • Design the data pipelines for collection, storage, processing and BI of data generated by IoT devices and third-party services. Propose relevant technologies and solutions.
  • Design efficient data models using various storage technologies (e.g. HDFS) and efficient analytics DB schemas for use in BI.
  • Develop various components for data collection (connectors for various IoT devices and third-party services, web hooks) and ingestion of collected data (using Kafka, for example).
  • Develop data processing applications (for example, streaming and batch data pipelines with Apache Kafka Streams and Apache Spark).
  • Automate data processing tasks and their monitoring in production (for example, orchestration of batch processing jobs using Airflow).

Profile

We are looking for a data engineer with 4+ years of industry experience in data engineering. Candidates for this position are expected to have:

  • Rich industry experience in data engineering: experience with multiple products (from a business standpoint), experience with implementation of components in various layers of the data architecture (data collection, data preparation, data processing, storage, BI).
  • Industry experience and strong programming skills with Scala, Python. We expect a candidate to be fully autonomous in the coding process.
  • Strong knowledge of SQL, as well as some understanding of non-relational databases.
  • A taste for high quality software (clean code, high test coverage, willingness to do thorough PR reviews).

Knowledge in any of the following areas is a plus:

  • Kafka, Kafka Connect, Kafka Streams, KSQL
  • Spark
  • Docker
  • Kubernetes
  • NoSQL databases
  • Amazon Web Services / Google Cloud Platform / Microsoft Azure
  • Agile methodology and Scrum in particular

Being passionate about IT ourselves, we are looking for a likewise passionate person with a good team spirit.

What we offer

  • An experienced data engineering team with a very strong high-quality development mentality yet focused on fast and agile execution to achieve business impact
  • A data-centric product, where data engineers make an important contribution to making it all happen
  • A team leader with more than 10 years of professional experience in software engineering
  • A competitive salary and eligibility for participation in the stock option plan.
  • Performance-based bonuses
  • Fast-growing early-stage startup: team size is expected to double in the next 12 months
  • A multi-cultural team that is passionate about technology, regular team outings
  • Open communication, flat hierarchy, and fast execution
  • Flexible working hours, allowance for partial telecommuting
  • A budget for personal education, participation to conferences, and training
  • A comfortable office in the center of Paris (Strasbourg – Saint-Denis metro station)

To apply for this position, please send us your CV and cover letter to careers@square-sense.com with the subject line "Senior Big Data Engineer".