Data Engineer
wati.io, Indonesia
Job Description
Wati is a growing CPaaS platform that provides end-to-end WhatsApp API solutions for SMBs and large enterprises. We aim to simplify business communication, helping businesses meet their customers where they are - WhatsApp.Backed by global investors such as Sequoia, DST Global, and Tiger Global, we're Shopify's first investment in a startup in Southeast Asia.
Headquartered in Hong Kong and trusted by 8000+ customers across 100+ countries. We're a rapidly expanding team filled with talented people from around the globe.
We are growing fast, and we are now looking for a Data Engineer to help the data team design, implement and maintain our data infrastructure, ensuring the efficient and reliable processing and analysis of large volumes of data.
In this role, you will work closely with cross-functional teams, including customer, marketing, product, tech engineers and operations, to enable data-driven decision-making and support the company's strategic objectives. This role requires a strong technical background, excellent problem-solving skills, and a passion for building scalable data solutions.
What you’ll do:
- Designing and developing data pipelines: Create and maintain robust and scalable data pipelines to extract, transform, and load large volumes of data from various sources into the data warehouse.
- Data modeling and architecture: Collaborate with analysts and data scientists to design and implement data models that support reporting, analytics, and machine learning needs. Ensure data integrity and consistency.
- Managing data infrastructure: Optimize and manage the data warehouse infrastructure, ensuring efficient data processing, storage, and retrieval. Monitor performance and troubleshoot issues to ensure data availability.
- Ensuring data quality: Implement and maintain data quality checks and validation processes to ensure accurate and reliable data. Address data quality issues and work with stakeholders to resolve concerns.
- Collaboration and documentation: Collaborate with cross-functional teams to understand data requirements and deliver solutions. Document data engineering processes, data flows, and system architectures to facilitate knowledge sharing.
What will make you stand out:
- Strong technical expertise in areas of data engineering, data modeling and database management.
- Ability to analyze data requirements and troubleshoot issues effectively.
- Excellent teamwork and communication skills with both technical and non-technical stakeholders.
Requirements
- Must haves:
- Bachelor's + degree in Computer Science, Engineering, or a related field.
- Minimum of 3 years of professional experience as a Data Engineer, preferably in a SaaS or technology-focused company.
- Proficiency in programming languages such as Python, with experience in data manipulation, transformation, and scripting.
- Proficiency in SQL and experience with relational databases and NoSQL databases (e.g., MongoDB)
- Familiar with version control (Github, Gitlab or Bitbucket) and Cloud Environment (GCP or AWS)
- Capable of building CI/CD process and using Docker
- Experience with data pipeline and workflow management tools like Airflow or Cloud Composer
- Experience with the tools below is a plus
- DBT
- Google BigQuery, Google Cloud Bucket, Google Pubsub, Google Data Studio
- Pyspark amp; Debezium
- Transferable amp; soft skills:
- Proactive and willing to explore, learn and share new ideas
- Open to feedback from stakeholders and data users
- Keen to understand the business holistically
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
- Strong analytical and problem-solving skills, with a keen attention to detail