desktop
SA Shopify Admin

Model

Tasks

Create a discount code Update an order note Issue a partial refund Adjust inventory location Tag a high-value customer
1 2 3 4 5
RL env

Shopify Admin environment

5 tasks with a model prompt, seeded environment state, and grader contract.

Task 1

Create a discount code

Prompt
Create the discount code from the brief with the requested percentage and expiration date.
Environment
The discounts page is empty for the campaign code.
Grader
Checks code, percentage, expiration date, and active status.
Task 2

Update an order note

Prompt
Find order SH-6102 and add the fulfillment note from the task brief.
Environment
The orders page contains similar order IDs and mixed fulfillment states.
Grader
Checks note text on SH-6102 and no status change.
Task 3

Issue a partial refund

Prompt
Open the seeded paid order and refund only the damaged line item.
Environment
The order has multiple line items and one marked damaged in the evidence panel.
Grader
Checks refunded item, amount, and that shipping remains unreimbursed.
Task 4

Adjust inventory location

Prompt
Move 5 units of SKU SP-447 from the backup location to the primary location.
Environment
Inventory is split across primary and backup locations.
Grader
Checks inventory delta for both locations and total stock preservation.
Task 5

Tag a high-value customer

Prompt
Find the customer with the email in the brief and add the VIP-review tag.
Environment
The customer list contains duplicate names but unique emails.
Grader
Checks tag placement on the exact email record.
UseDesktop Evals

Computer-use agent evals.

RL envs Main site Docs Blog