San Francisco, CA · noida · full time · senior level
We're seeking a Senior Data Engineer to architect our next-generation data platform supporting real-time analytics and machine learning workflows. Key Responsibilities: - Design scalable data pipelines processing TB+ of data daily - Build real-time streaming infrastructure using Kafka and Flink - Optimize data warehouse performance and cost - Implement data quality and governance frameworks - Partner with ML teams on feature engineering pipelines Requirements: - 5+ years of data engineering experience - Expert knowledge of Spark, Kafka, and Flink - Experience with cloud data warehouses (Snowflake, BigQuery, Redshift) - Strong SQL and Python skills - Experience with data modeling and schema design
Skills: Apache Spark, Kafka, Python, SQL, Snowflake, Airflow, dbt