USE CASE
Operations review
These are the same questions found in the library, grouped here by the capability each one mainly examines.
132 questions
Questions 1–50 of 132 on this page.
A · Professional problem solving and implementation8
- An AI assistant can create tickets, issue refunds, or change accounts on a user's behalf. A refund request times out, and the system cannot tell whether it completed; retrying may issue a second refund. How would you check the outcome, control retries, and ensure actions stay within the user's authorization?
- A new field must be backfilled across hundreds of millions of rows. The first run increases lock waits and replication lag. How would you decide whether to pause, batch, throttle, or use an online migration?
- An API has been slow since yesterday, and there is no release on record. Given logs, monitoring, and database slow-query records, in what order would you investigate?
- A cache key is invalidated and logs show a database reread, yet some users still see old data. Switching to the primary helps but does not eliminate it. How would you investigate caches, replicas, and clients?
- A request calls four downstream services, each using a full two-second timeout. End-to-end tail latency is high, and clients continue work after the response is no longer useful. How would you propagate deadlines and budgets?
- After a release goes wrong, the team says “we can roll back.” How would you check that this is true and not just a line in the plan?
- How would you design an invitation-based viral marketing campaign? How do you design invitation relationships, reward payout, abuse prevention, and effect evaluation?
- Several services read feature flags and audience rules on request paths. How would you design the control plane and local evaluation so behavior remains predictable when the control service fails?
No questions in this section match your target. ·
B · Business understanding and domain modeling20
- Sales reports growth using signed contract value, but customers will not use the product for months. How would you distinguish contracting, fulfillment, revenue recognition, and customer value, and explain what the team should observe?
- A premium service tier earns more revenue but consumes more human support, and renewal has not improved. How would you determine whether it creates incremental value?
- A product is sold once but requires long-term support and upgrades. Revenue is growing while the service queue accumulates. How would you decide whether these sales still create value?
- A customer buys a bundle and then asks to refund one item. How should the original bundle discount be reallocated?
- An order may use a membership discount, channel offer, and coupon, with exceptions by product, contract, or region. How would you define eligibility and calculation order so customers see a consistent amount and finance can reconcile refunds?
- The revenue share between a platform and its creators changes in tiers with monthly volume. How would you express this settlement rule so product, engineering, and finance can each verify it independently?
- A business object moves across teams as owners change. Audit must reconstruct the owner on a past date, while daily reporting needs current ownership. How would you model both queries?
- A user asks to have personal data deleted, while finance must retain transaction records for audit. How would you define the boundary among deletion, anonymization, and traceability?
- A business rule is corrected retroactively. Reports need corrected results, while decision-makers also need the results available at the time. How would you manage both historical views?
- A producer adds an order status, and an old consumer rejects the whole message because enum validation is strict. Teams disagree over who must update, and consumers have different owners. How would you design compatibility and rollout order?
- A promotion increases sales volume, but new customers’ first orders remain unprofitable after discounts, channel fees, and fulfillment costs. How would you isolate the loss and decide whether to change the offer threshold, audience, channel, or stop the promotion?
- A user orders through a channel and later receives a refund, chargeback, or cancellation. How would you define order value, attribution window, and channel cost so marketing analysis and finance settlement can both explain the same outcome?
- The same person may encounter a product through ads, an agency, a partner, and a self-serve channel, and different parties may pay. How would you distinguish customer, buyer, user, and acquisition touchpoint in the business model?
- Partner settlement must connect external order IDs, internal orders, payments, and refunds, but systems use different keys and update times. How would you build the mappings and reconciliation process?
- A risk value is usually present in training data, but live serving often substitutes a default and model performance fluctuates. How would you find whether the cause is data collection, timing, missing-value handling, or implementation differences?
- An upstream dependency change will increase refresh latency for a costly feature set from seconds to ten minutes. How would you determine which decisions are affected, which features must remain real time, and when a fallback value is acceptable?
- The commercial rule for a service changes from a free trial to a refund after conditions are met, while historical orders were signed under the old terms. How would you evolve the model and workflow so both old and new transactions remain explainable?
- The team plans to enter an adjacent market where users, payers, and fulfillment parties differ. How would you map the value chain and determine whose problem the product should solve first?
- Teams define “done,” “awaiting acceptance,” and “paused” differently, distorting roll-up data. How would you design a shared state model and transition rules?
- A user can belong to several organizations and hold different roles in each. How would you model identity, membership, and permissions without conflating accounts with business roles?
No questions in this section match your target. ·
C · Value judgment and direction setting7
- Gross margin is steady, but standard-service revenue falls while custom-service revenue grows, along with implementation and support hours. How would you determine whether growth is healthy?
- An acquisition campaign drives many registrations, but some regions cannot yet be served, reducing the share of new users who can actually receive the service. How would you define and report the campaign result?
- Brand advertising, search, and affiliate channels reach overlapping prospects, while the attribution platform assigns most conversions to the last click. How would you estimate each channel’s incremental contribution and state the limits of the conclusion?
- A checkout experiment improves payment completion, but complaints and refunds also increase. How would you judge whether the experiment succeeded, and how long would you wait before deciding?
- A membership program increases repeat-purchase frequency, but average order value and margin both decline. How would you distinguish a healthy habit change from purchases pulled forward or low-quality, promotion-driven growth?
- A major customer will pay a high price for a custom feature, but reuse by other customers is uncertain. Ongoing maintenance, permissions, and data rules add cost, and sales has promised a delivery date. How would you compare a one-off build, productizing it, a service, or declining—and decide whether to invest?
- Interviews and support tickets repeatedly mention the same problem, but few users in a pilot are willing to change their current workflow. How would you determine whether the issue is how the need was expressed, switching cost, target-user selection, or problem priority?
No questions in this section match your target. ·
D · Delivery and ongoing operations14
- A data-write incident has stopped and service metrics look normal, but users still report missing records. How would you organize recovery validation and follow-up communication?
- Project requests backed by senior sponsors tend to move ahead, while compliance and infrastructure work without executive sponsorship repeatedly slips. How would you create a transparent portfolio intake and prioritization process?
- An onboarding experiment does not change overall signup-to-activation conversion, but activated users complete their first key task sooner. How would you decide whether to roll it out and revise the definition of success?
- During a major promotion, landing-page traffic meets expectations but add-to-cart and order rates are far below target. How would you quickly distinguish traffic quality, page information, pricing rules, inventory, and fulfillment issues?
- A limited-time promotion launches, but popular products run short. Some channels have already promised availability while others continue sending traffic. How would you adjust promotion, page promises, replenishment, and customer communication?
- A brand campaign has delivered its planned total impressions, but actual reach among the core target audience is below expectation, and one-third of the budget remains. How would you decide whether to continue, change the media mix, or revise the objective?
- A community event has strong registration and interaction numbers, but participants rarely continue using the product or contributing content afterward. How would you locate where the connection to product value breaks and design the next operating cycle?
- To meet a quarterly goal, a partner asks to expand promotion delivery at short notice. An initial check suggests the new audience may exceed agreed authorization and brand boundaries. How would you move the decision forward within the deadline?
- A campaign creative gets high engagement on social channels but almost no conversion in search or stores. Another version has ordinary engagement but stronger sales. How would you decide on creative iteration and channel allocation?
- A broad discount meets the overall sales target, but valuable existing customers view it as unfair, and some users delay purchases they would have made anyway. How would you adjust future audiences and offers?
- A discount briefly increases volume, competitors follow, and category prices and margins decline. How would you decide whether to keep matching, change the value proposition, or exit the promotion?
- A new product misses its first-week sales target, yet trial users show strong usage depth and referral intent. How would you determine whether the issue is reach, a longer purchase cycle, price threshold, or positioning, and decide what to invest in next?
- A new-customer offer generates many registrations, but most users do not complete the first key action and the discount cost has already been incurred. How would you plan follow-up and decide which users merit further investment?
- A channel has a low acquisition cost in a small test, but lead quality and conversion fall as spend increases. How would you validate the cost definition and true incrementality, distinguish channel saturation from audience or sales-capacity changes, and set a limit for additional spend?
No questions in this section match your target. ·
F · People and organization building1
No questions in this section match your target. ·