lvl100Sign in

craft.co

Senior / Staff Data Platform Engineer (US)

  • US · Remote
  • Full-time
  • Posted

Skills

  • AWS
  • Apache Spark
  • CI/CD
  • Communication
  • PostgreSQL
  • Python
  • SQL
  • Terraform
  • Docker
  • Large Language Models

Job description

ABOUT CRAFT:

Craft is the leader in supplier risk intelligence, enabling enterprises to discover, evaluate, and continuously monitor their suppliers at scale. Our AI research and monitoring agents deliver real, actionable intelligence, by operating on top of our unique, proprietary data platform - this helps our customers make better, more informed decisions for their business, faster and strategically secure critical supply chains from risk. Our customers include Fortune 500 companies, government agencies, and global service platforms. We’ve developed distribution partnerships with some of the largest integrators and software platforms globally.

We are a post-Series B high-growth technology company backed by top-tier investors in Silicon Valley and Europe, headquartered in San Francisco with hubs in Seattle and Warsaw. We support remote and hybrid work, with team members across North America and Europe.

We are looking for innovative and driven people passionate about building the future of Enterprise Intelligence to join our growing team!

ABOUT THE ROLE:

You will join the team that owns the data foundation every Craft product runs on: the lakehouse, ingestion and change data capture pipelines, the serving layer behind our GraphQL APIs, and the infrastructure that brings our data into secure federal environments. You will have real ownership of architecture decisions and how they are delivered.

Craft is an AI-native engineering organization. Claude Code is our standard tool, and we build with agents: engineers define intent and acceptance criteria, agents implement and validate, and engineers review critically. We are looking for someone who already works this way and will contribute to how we build with agents: skills, workflows, and guardrails.

HOW YOU'LL WORK:

•You own outcomes, not tickets. You work with product to shape the problem, define what "done" means, ship it, and check that it worked in production.
•Finishing is not the end. When you complete something, you share what shipped, what you learned, and what you think should happen next.
•You work in the open. You share work in progress early, post short async updates, and demo regularly to a team spread across the US and Warsaw.
•You pull others in. You review code, unblock teammates, and raise risks before they become surprises.
•You think beyond the task at hand. You spot patterns across teams, anticipate what the platform will need next, and invest in shared libraries, tooling, and documentation that make everyone faster. You turn those ideas into shipped improvements, not just proposals.

WHAT YOU’LL DO:

•Design, build, and operate batch and streaming pipelines on our lakehouse, from ingestion through curated, production-grade data products.
•Own the serving layer that powers our GraphQL APIs, including data modeling, Postgres performance, and reliable large table reloads.
•Build change data capture and data movement patterns that work across commercial AWS and AWS GovCloud.
•Help design data architecture for our federal authorization boundaries, including what data may cross a boundary and how.
•Raise the reliability bar: observability, data quality checks, alerting, cost visibility, and incident response.
•Contribute to the data-platform monorepo, shared libraries, and our internal AI engineering toolkit (agent skills, workflows, guardrails).
•Partner with product squads and engineers building LLM-based research and monitoring agents on top of the platform.

WHO YOU ARE:

•5+ years of data engineering, including ownership of a production data platform, not only individual pipelines.
•Strong Python and SQL, with solid software engineering habits: testing, code review, CI/CD, maintainable design.
•Hands-on experience with lakehouse technologies: Spark/PySpark, Delta Lake or Iceberg, and catalog and governance tooling (Unity Catalog, Glue, Lake Formation).
•Production AWS experience and infrastructure as code with Terraform.
•Experience modeling and tuning Postgres for API-serving workloads.
•You use AI coding agents for real work beyond autocomplete and can walk us through how you scope, validate, and review agent output.
•Clear written communication and comfort collaborating across U.S. and European time zones.
•U.S. citizenship is required due to federal customer requirements. Eligibility for a U.S. security clearance is a plus.

NICE TO HAVE

•AWS GovCloud, FedRAMP, or DoD Impact Level (IL2/IL4/IL5) experience.
•CDC tooling (AWS DMS, Kinesis, Debezium) and Kafka.
•Airflow / MWAA orchestration.
•Elasticsearch or graph databases.
•Building pipelines that feed LLM workflows (structured outputs, grounding, evaluation data).

Our Stack

•Data: Python, PySpark, Pandas, Polars, SQL (PostgreSQL), Airflow, Kafka, Docker
•Platform: Databricks (Delta Lake, Unity Catalog), AWS (S3, Batch, ECS, RDS/Aurora, Glue, DynamoDB, GovCloud), Elasticsearch, Terraform
•AI: Claude Code, plus OpenAI, Anthropic, and Google Vertex AI models in production

WHAT WE OFFER:

•Competitive salary starting at $170,000 USD/ year. This starting number can be increased based on levels of expertise, location, cost of living, taxes, market experience, etc.
•Equity at a well-funded, fast-growing startup
•Unlimited vacation time so you can take what you need, when you need it
•99% covered health + dental + vision insurance for employees and dependents
•401K through Empower with options to invest how you want it

A NOTE TO CANDIDATES:

We are an equal opportunity employer who values and encourages diversity, equity and belonging at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, caste, or disability status.

Don’t meet every requirement? Studies have shown that women, communities of color and historically underrepresented talent are less likely to apply to jobs unless they meet every single qualification. At Craft, we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we strongly encourage you to apply. You may be just the right candidate for this or other roles!

Browse all jobs by role, city or company