Posted by
Zoheab Rehaman
Talent Acquisition at DRAUP BUSINESS SOLUTIONS PRIVATE LIMITED
Last Active: 17 November 2026
Posted in
GenAI
Job Code
1746164

Senior Product Manager
Company: Draup
Location: Bengaluru, India
Team: Product
Experience: 6 - 9 years
About Draup
Draup is a subscription-based talent and market intelligence platform, founded in 2017, that gives enterprises labor-market, skills and market data. We are building the next layer of the product: workforce intelligence delivered inside AI assistants and copilots, plus task-level analysis of which work is done by AI, humans or both. Our customers are large enterprises, and they rely on our answers for hiring, workforce-planning and location decisions. A wrong answer costs them real money, so quality matters here more than speed of demo.
The role
You will own the AI-powered features of a B2B SaaS product: from the first problem statement to production and beyond. This is a measurement-heavy role. You will spend more time in query editors, eval sets and usage dashboards than in roadmap decks. You will decide what "good" means for an LLM answer, build the way we check it, and defend those numbers to engineering and to customers.
What you will do
- Own the roadmap and outcomes for LLM-powered features in the product (chat, agents, search or generation), end to end.
- Define quality for LLM output: write the criteria, build and maintain eval sets, compare prompt and model versions, and decide what ships.
- Track and reduce error rates, empty-answer rates, latency and cost per query in production, and set the targets for each.
- Query product data yourself in SQL and in analytics tools to learn how features are used, where they fail, and what to fix next. No waiting on an analyst.
- Work closely with engineering and data teams on trade-offs among answer quality, response time, cost and user trust.
- Review real user sessions and failed answers regularly, and turn patterns into specific fixes.
- Talk to enterprise customers to understand the decisions they make with our answers, and bring that back into what you build.
- Write clear specs and success metrics, and run launches with sales, customer success and support.
What you bring
Experience:
- 6 - 9 years of total experience, including 4+ years as a product manager owning a B2B SaaS product end to end.
- 1 - 2+ years shipping LLM features to real users (chat, agents, search or generation) in production. You have dealt with bad answers, slow responses, cost and user trust. A demo or side project does not count.
- A background in engineering, data analysis or consulting before product management is a strong plus.
Must-haves:
- You write your own SQL, and you are comfortable in an analytics tool such as Datadog or GA4. You do not wait on an analyst to understand how a feature is used.
- You have judged LLM output systematically: built or run an eval set, compared prompt versions, and tracked error and empty-answer rates.
Strong preference:
- A B2B or enterprise product background rather than consumer-facing startups. You are used to longer buying cycles, fewer but higher-stakes users, and customers who check your numbers.
Nice to have:
- Experience with retrieval-based or agent-style products, and with how LLM tools connect to external data.
- Familiarity with how model, prompt and infrastructure choices drive cost per query.
- Experience working with data or analytics products where trust in the answer is the product.
How you will be measured:
- Answer quality on a defined eval set, improving release over release.
- Error and empty-answer rates in production, trending down.
- Latency and cost per query within agreed targets.
- Adoption and repeat use of AI features among enterprise customers.
What we offer:
- Ownership of a core AI product area at a company where answer quality is the product.
- Direct access to engineering, data and enterprise customers.
- Competitive compensation.
Didn’t find the job appropriate? Report this Job
Posted by
Zoheab Rehaman
Talent Acquisition at DRAUP BUSINESS SOLUTIONS PRIVATE LIMITED
Last Active: 17 November 2026
Posted in
GenAI
Job Code
1746164