nips/90.md

389 lines
14 KiB
Markdown
Raw Normal View History

2024-11-22 06:43:01 -05:00
NIP-90
2023-07-05 05:14:50 -04:00
======
Data Vending Machine
--------------------
2023-11-15 19:42:51 -05:00
`draft` `optional`
2023-07-05 05:14:50 -04:00
2023-07-23 17:38:47 -04:00
This NIP defines the interaction between customers and Service Providers for performing on-demand computation.
Money in, data out.
2023-07-03 08:21:13 -04:00
## Kinds
2024-11-22 06:31:09 -05:00
This NIP reserves the range `5000-7000` for data vending machine use.
| Kind | Description |
2024-11-22 06:31:09 -05:00
|-----------|-------------------|
| 5000-5999 | Job request kinds |
| 6000-6999 | Job result |
| 7000 | Job feedback |
2024-11-22 06:31:09 -05:00
Job results always use a kind number that is `1000` higher than the job request kind. (e.g. request: `kind:5001` gets a
result: `kind:6001`).
Job request types are defined [separately](https://github.com/nostr-protocol/data-vending-machines/tree/master/kinds).
2023-07-23 16:58:12 -04:00
2023-07-03 08:21:13 -04:00
## Rationale
2024-11-22 06:31:09 -05:00
Nostr can act as a marketplace for data processing, where users request jobs to be processed in certain ways (e.g., "
speech-to-text", "summarization", etc.), but they don't necessarily care about "who" processes the data.
This NIP is not to be confused with a 1:1 marketplace; instead, it describes a flow where a user announces a desired
output, willingness to pay, and service providers compete to fulfill the job requirement in the best way possible.
2023-07-03 08:21:13 -04:00
### Actors
2024-11-22 06:31:09 -05:00
2023-07-23 17:38:47 -04:00
There are two actors in the workflow described in this NIP:
2024-11-22 06:31:09 -05:00
2023-07-03 08:21:13 -04:00
* Customers (npubs who request a job)
* Service providers (npubs who fulfill jobs)
## Job request (`kind:5000-5999`)
2024-11-22 06:31:09 -05:00
A request to process data, published by a customer. This event signals that a customer is interested in receiving the
result of some kind of compute.
2023-07-03 08:21:13 -04:00
2024-09-03 13:11:31 -04:00
```jsonc
2023-07-03 08:21:13 -04:00
{
"kind": 5xxx, // kind in 5000-5999 range
2023-07-03 08:21:13 -04:00
"content": "",
"tags": [
[ "i", "<data>", "<input-type>", "<relay>", "<marker>" ],
2023-07-11 16:25:54 -04:00
[ "output", "<mime-type>" ],
2023-10-30 17:21:53 -04:00
[ "relays", "wss://..." ],
[ "bid", "<msat-amount>" ],
[ "t", "bitcoin" ]
2024-11-22 06:31:09 -05:00
],
2024-09-03 13:11:31 -04:00
// other fields...
2023-07-03 08:21:13 -04:00
}
```
2023-07-23 16:37:20 -04:00
All tags are optional.
* `i` tag: Input data for the job (zero or more inputs)
2023-07-11 09:22:30 -04:00
* `<data>`: The argument for the input
* `<input-type>`: The way this argument should be interpreted. MUST be one of:
* `url`: A URL to be fetched of the data that should be processed.
* `event`: A Nostr event ID.
2024-11-22 06:31:09 -05:00
* `job`: The output of a previous job with the specified event ID. The dermination of which output to build upon
is up to the service provider to decide (e.g. waiting for a signaling from the customer, waiting for a
payment, etc.)
2023-07-23 16:58:12 -04:00
* `text`: `<data>` is the value of the input, no resolution is needed
2024-11-22 06:31:09 -05:00
* `<relay>`: If `event` or `job` input-type, the relay where the event/job was published, otherwise optional or
empty string
* `<marker>`: An optional field indicating how this input should be used within the context of the job
* `output`: Expected output format. Different job request `kind` defines this more precisely.
2024-11-22 06:31:09 -05:00
* `param`: Optional parameters for the job as key (first argument)/value (second argument). Different job request `kind`
defines this more precisely. (e.g. `[ "param", "lang", "es" ]`)
2023-07-23 17:38:47 -04:00
* `bid`: Customer MAY specify a maximum amount (in millisats) they are willing to pay
* `relays`: List of relays where Service Providers SHOULD publish responses to
2023-07-23 17:38:47 -04:00
* `p`: Service Providers the customer is interested in. Other SPs MIGHT still choose to process the job
2023-07-03 08:21:13 -04:00
## Encrypted Params
2024-11-22 06:31:09 -05:00
If the user wants to keep the input parameters a secret, they can encrypt the `i` and `param` tags with the service
provider's 'p' tag and add it to the content field. Add a tag `encrypted` as tags. Encryption for private tags will
use [NIP-04 - Encrypted Direct Message encryption](https://github.com/nostr-protocol/nips/blob/master/04.md), using the
user's private and service provider's public key for the shared secret
```json
[
2024-11-22 06:31:09 -05:00
[
"i",
"what is the capital of France? ",
"text"
],
[
"param",
"model",
"LLaMA-2"
],
[
"param",
"max_tokens",
"512"
],
[
"param",
"temperature",
"0.5"
],
[
"param",
"top-k",
"50"
],
[
"param",
"top-p",
"0.7"
],
[
"param",
"frequency_penalty",
"1"
]
]
```
This param data will be encrypted and added to the `content` field and `p` tag should be present
2024-09-03 13:11:31 -04:00
```jsonc
{
"content": "BE2Y4xvS6HIY7TozIgbEl3sAHkdZoXyLRRkZv4fLPh3R7LtviLKAJM5qpkC7D6VtMbgIt4iNcMpLtpo...",
"tags": [
2024-11-22 06:31:09 -05:00
[
"p",
"04f74530a6ede6b24731b976b8e78fb449ea61f40ff10e3d869a3030c4edc91f"
],
[
"encrypted"
]
],
2024-09-03 13:11:31 -04:00
// other fields...
}
```
## Job result (`kind:6000-6999`)
2023-07-23 17:38:47 -04:00
2024-11-22 06:31:09 -05:00
Service providers publish job results, providing the output of the job result. They should tag the original job request
event id as well as the customer's pubkey.
2023-07-23 17:38:47 -04:00
2024-09-03 13:11:31 -04:00
```jsonc
2023-07-03 08:21:13 -04:00
{
"pubkey": "<service-provider pubkey>",
"content": "<payload>",
"kind": 6xxx,
"tags": [
2024-11-22 06:31:09 -05:00
[
"request",
"<job-request>"
],
[
"e",
"<job-request-id>",
"<relay-hint>"
],
[
"i",
"<input-data>"
],
[
"p",
"<customer's-pubkey>"
],
[
"amount",
"requested-payment-amount",
"<optional-bolt11>"
]
],
2024-09-03 13:11:31 -04:00
// other fields...
2023-07-03 08:21:13 -04:00
}
```
* `request`: The job request event stringified-JSON.
2024-11-22 06:31:09 -05:00
* `amount`: millisats that the Service Provider is requesting to be paid. An optional third value can be a bolt11
invoice.
* `i`: The original input(s) specified in the request.
## Encrypted Output
2024-11-22 06:31:09 -05:00
If the request has encrypted params, then output should be encrypted and placed in `content` field. If the output is
encrypted, then avoid including `i` tag with input-data as clear text.
Add a tag encrypted to mark the output content as `encrypted`
2024-09-03 13:11:31 -04:00
```jsonc
{
"pubkey": "<service-provider pubkey>",
"content": "<encrypted payload>",
"kind": 6xxx,
"tags": [
2024-11-22 06:31:09 -05:00
[
"request",
"<job-request>"
],
[
"e",
"<job-request-id>",
"<relay-hint>"
],
[
"p",
"<customer's-pubkey>"
],
[
"amount",
"requested-payment-amount",
"<optional-bolt11>"
],
[
"encrypted"
]
],
2024-09-03 13:11:31 -04:00
// other fields...
}
```
2023-07-11 09:22:30 -04:00
## Job feedback
Service providers can give feedback about a job back to the customer.
2023-07-03 08:21:13 -04:00
2024-09-03 13:11:31 -04:00
```jsonc
{
"kind": 7000,
"content": "<empty-or-payload>",
"tags": [
2024-11-22 06:31:09 -05:00
[
"status",
"<status>",
"<extra-info>"
],
[
"amount",
"requested-payment-amount",
"<bolt11>"
],
[
"e",
"<job-request-id>",
"<relay-hint>"
],
[
"p",
"<customer's-pubkey>"
]
],
2024-09-03 13:11:31 -04:00
// other fields...
}
```
2023-07-03 08:21:13 -04:00
* `content`: Either empty or a job-result (e.g. for partial-result samples)
2024-05-11 13:38:01 -04:00
* `amount` tag: as defined in the [Job Result](#job-result-kind6000-6999) section.
2024-11-22 06:31:09 -05:00
* `status` tag: Service Providers SHOULD indicate what this feedback status refers
to. [Job Feedback Status](#job-feedback-status) defines status. Extra human-readable information can be added as an
extra argument.
2024-11-22 06:31:09 -05:00
* NOTE: If the input params requires input to be encrypted, then `content` field will have encrypted payload with `p`tag
as key.
### Job feedback status
| status | description |
2024-11-22 06:31:09 -05:00
|--------------------|-------------------------------------------------------------------------------------------------------------|
| `payment-required` | Service Provider requires payment before continuing. |
| `processing` | Service Provider is processing the job. |
| `error` | Service Provider was unable to process the job. |
| `success` | Service Provider successfully processed the job. |
| `partial` | Service Provider partially processed the job. The `.content` might include a sample of the partial results. |
2024-11-22 06:31:09 -05:00
Any job feedback event MIGHT include results in the `.content` field, as described in
the [Job Result](#job-result-kind6000-6999) section. This is useful for service providers to provide a sample of the
results that have been processed so far.
2023-07-05 05:14:50 -04:00
# Protocol Flow
* Customer publishes a job request (e.g. `kind:5000` speech-to-text).
* Service Providers MAY submit `kind:7000` job-feedback events (e.g. `payment-required`, `processing`, `error`, etc.).
* Upon completion, the service provider publishes the result of the job with a `kind:6000` job-result event.
2024-11-22 06:31:09 -05:00
* At any point, if there is an `amount` pending to be paid as instructed by the service provider, the user can pay the
included `bolt11` or zap the job result event the service provider has sent to the user
2023-07-05 05:14:50 -04:00
2024-11-22 06:31:09 -05:00
Job feedback (`kind:7000`) and Job Results (`kind:6000-6999`) events MAY include an `amount` tag, this can be
interpreted as a suggestion to pay. Service Providers MUST use the `payment-required` feedback event to signal that a
payment is required and no further actions will be performed until the payment is sent.
2024-11-22 06:31:09 -05:00
Customers can always either pay the included `bolt11` invoice or zap the event requesting the payment and service
providers should monitor for both if they choose to include a bolt11 invoice.
2023-07-05 05:14:50 -04:00
2023-07-15 06:24:32 -04:00
## Notes about the protocol flow
2023-07-03 08:21:13 -04:00
2024-11-22 06:31:09 -05:00
The flow is deliberately ambiguous, allowing vast flexibility for the interaction between customers and service
providers so that service providers can model their behavior based on their own decisions/perceptions of risk.
Some service providers might choose to submit a `payment-required` as the first reaction before sending a `processing`or
before delivering results, some might choose to serve partial results for the job (e.g. a sample), send a
`payment-required` to deliver the rest of the results, and some service providers might choose to assess likelihood of
payment based on an npub's past behavior and thus serve the job results before requesting payment for the best possible
UX.
2023-07-05 05:14:50 -04:00
2023-07-23 17:38:47 -04:00
It's not up to this NIP to define how individual vending machines should choose to run their business.
2023-07-11 09:22:30 -04:00
# Cancellation
2024-11-22 06:31:09 -05:00
2024-05-11 12:52:32 -04:00
A job request might be canceled by publishing a `kind:5` delete request event tagging the job request event.
2023-07-05 05:14:50 -04:00
# Appendix 1: Job chaining
2023-07-03 08:21:13 -04:00
2024-11-22 06:31:09 -05:00
A Customer MAY request multiple jobs to be processed as a chain, where the output of a job is the input of another
job. (e.g. podcast transcription -> summarization of the transcription). This is done by specifying as input an event id
of a different job with the `job` type.
Service Providers MAY begin processing a subsequent job the moment they see the prior job's result, but they will likely
wait for a zap to be published first. This introduces a risk that Service Provider of job #1 might delay publishing the
zap event in order to have an advantage. This risk is up to Service Providers to mitigate or to decide whether the
service provider of job #1 tends to have good-enough results so as to not wait for an explicit zap to assume the job was
accepted.
2023-07-03 08:21:13 -04:00
2023-07-23 17:38:47 -04:00
This gives a higher level of flexibility to service providers (which sophisticated service providers would take anyway).
2023-07-03 08:21:13 -04:00
# Appendix 2: Service provider discoverability
2024-11-22 06:31:09 -05:00
Service Providers MAY use NIP-89 announcements to advertise their support for job kinds:
2024-09-03 13:11:31 -04:00
```jsonc
{
2024-11-22 06:41:25 -05:00
"kind": 31990,
"pubkey": "<pubkey>",
"content":
2024-11-22 06:31:09 -05:00
"{
2024-11-22 06:41:25 -05:00
\"name\": \"Translating DVM\",
\"picture\": \"https://domain.com/profile.jpg\",
\"lud16\": \"zap@address.com\",
\"about\": \"I'm a DVM specialized in translating Bitcoin content.\"
\"supportsEncryption\": true,
\"acceptsNutZaps\": true,
\"personalized\": true,
\"amount\": \"flexible\",
\"nip90Params\":
{
\"mode\": {
\"required\": False,
\"values\": [\" best\", \"classic\", \"fast\"],
\"description\": \"Method to do the translation\"
},
}",
"tags":
[
["k", "5005"], // e.g. translation
["t", "bitcoin"] // e.g. optionally advertises it specializes in bitcoin audio transcription that won't confuse "Drivechains" with "Ridechains"
],
// other fields...
}
```
2024-11-22 06:41:25 -05:00
### NIP89 Service provider params:
| param | description | default |
|----------------------|-------------------------------------------------------------------------------------------------------------|---------|
| `name` | Name of the DVM | - |
| `picture` | Link to a NIP89 preview picture of the DVM | - |
| `lud16` | The DVM's zappable lud16 | - |
| `about` | A description of what the DVM does. | - |
| `supportsEncryption` | `true` or `false`, depending on whether DVM accepts encrypted requests | false |
| `acceptsNutZaps` | `true` or `false`, depending on whether the DVM accepts NIP61 Nutzaps | false |
| `amount` | `free`, `flexible`, `str($amountinsats)`. The asking price of the DVM | none |
| `subscription` | `true` or `false`, signal whether the DVM requires a subscription | false |
| `personalized` | `true` or `false`, signal whether the result is personalized (e.g. for feeds) | false |
| `action` | `follow`, `unfollow`, `mute` `unmute`. Signal to client it can perform an action with the results | none |
2024-11-22 06:31:09 -05:00
| `nip90Params` | a list of parameters that manipulate the DVM's processing, e.g. a method, model or specific input parameters | {} |
Everything besides name, picture, about and lud16 is optional and clients should assume default params, if not defined
otherwise.
2023-10-30 17:21:53 -04:00
Customers can use NIP-89 to see what service providers their follows use.