lvl100Sign in

Weekday AI

Data Engineer

  • India ยท Remote
  • Full-time
  • Posted

Skills

  • Agile
  • Large Language Models
  • Machine Learning
  • PostgreSQL
  • Python
  • SQL
  • Snowflake
  • Writing

Job description

๐—ง๐—ต๐—ถ๐˜€ ๐—ฟ๐—ผ๐—น๐—ฒ ๐—ถ๐˜€ ๐—ณ๐—ผ๐—ฟ ๐—ผ๐—ป๐—ฒ ๐—ผ๐—ณ ๐˜๐—ต๐—ฒ ๐—ช๐—ฒ๐—ฒ๐—ธ๐—ฑ๐—ฎ๐˜†'๐˜€ ๐—ฐ๐—น๐—ถ๐—ฒ๐—ป๐˜๐˜€

๐—ฆ๐—ฎ๐—น๐—ฎ๐—ฟ๐˜† ๐—ฟ๐—ฎ๐—ป๐—ด๐—ฒ: ๐—ฅ๐˜€ ๐Ÿฎ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ - ๐—ฅ๐˜€ ๐Ÿฏ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ (๐—ถ๐—ฒ ๐—œ๐—ก๐—ฅ ๐Ÿฎ๐Ÿฌ-๐Ÿฏ๐Ÿฌ ๐—Ÿ๐—ฃ๐—”)

Experience: 3+ yrs

Location: Remote

As a Data Engineer, you will design, build, and maintain scalable data pipelines and analytics platforms that drive business insights and product innovations. Leveraging your expertise in Python and SQL, you will transform raw data into clean, structured datasets, enabling data scientists and product teams to accelerate experimentation. You will integrate Posthog for behavioral analytics, employ deepeval for model validation workflows, and use Streamlit and LangChain to create interactive data tools and prompt-based applications. Your role will ensure data quality, performance, and compliance across the organization while collaborating closely with cross-functional stakeholders to translate data needs into technical solutions.

Requirements

๐—ž๐—ฒ๐˜† ๐—ฅ๐—ฒ๐˜€๐—ฝ๐—ผ๐—ป๐˜€๐—ถ๐—ฏ๐—ถ๐—น๐—ถ๐˜๐—ถ๐—ฒ๐˜€

โ€ขDesign and implement robust ETL pipelines that ingest, transform, and store data from diverse sources into a unified data warehouse.
โ€ขBuild and maintain dashboards and data visualizations using Streamlit to provide realโ€‘time insights for product, marketing, and engineering teams.
โ€ขIntegrate Posthog event data into the analytics pipeline and create segmented user funnels for product optimization.
โ€ขDevelop and maintain LangChain workflows to power conversational AI features that interact with structured data.
โ€ขEmploy deepeval to automate evaluation of machine learning models, ensuring model performance aligns with business KPIs.
โ€ขOptimize SQL queries and database schemas for speed, reliability, and scalability across large datasets.
โ€ขCollaborate with data scientists to provision and manage queryable data lakes and data marts.
โ€ขImplement data governance, security, and privacy controls to comply with industry regulations.
โ€ขMonitor pipeline health, troubleshoot failures, and iterate on performance enhancements.
โ€ขDocument data architecture, pipeline logic, and best practices for internal and external stakeholders.

๐—ช๐—ต๐—ฎ๐˜ ๐— ๐—ฎ๐—ธ๐—ฒ๐˜€ ๐—ฌ๐—ผ๐˜‚ ๐—ฎ ๐—š๐—ฟ๐—ฒ๐—ฎ๐˜ ๐—™๐—ถ๐˜

โ€ข3+ years of professional experience building data pipelines and analytics platforms in a production environment.
โ€ขStrong programming skills in Python, with extensive experience in writing reusable, testable code.
โ€ขDeep knowledge of SQL and experience with modern database systems such as PostgreSQL, BigQuery, or Snowflake.
โ€ขProven track record of integrating Posthog for behavioral data ingestion and analysis.
โ€ขHandsโ€‘on experience with deepeval or similar model evaluation frameworks.
โ€ขFamiliarity with LangChain for building LLMโ€‘driven data workflows and prompt engineering.
โ€ขSolid understanding of Streamlit or comparable openโ€‘source toolkits for building interactive dashboards.
โ€ขAbility to collaborate effectively with crossโ€‘functional teams in a remote, agile environment.
โ€ขStrong problemโ€‘solving mindset, with the capacity to troubleshoot complex data issues under tight deadlines.
โ€ขCommitment to code quality, documentation, and continuous learning in the fastโ€‘moving data engineering landscape.

Browse all jobs by role, city or company