Files
multica/server/internal/service/plugin_event_dispatch_test.go
T
659bb41abd MUL-6350: rebuild the plugin system (3/4) — hook engine (#7182)
* feat(plugins): hook engine — signed outbound calls, trigger-decided identity (MUL-6350)

The direction reverses here. PR 1 and 2 only ever ran inbound: a sandboxed
surface asked the host, and the host acted on the signed-in user's session, so
nothing left our infrastructure on a plugin's say-so. A hook leaves, and every
new check exists because of that.

Destination: the target host must be inside the granted `net:` set, resolve to
a public address, and be re-checked at dial. Body: HMAC-SHA256 over
timestamp.body, so a receiver can tell our call from anyone else's and a
captured one expires.

Identity follows the trigger, not the plugin. A ui/manual hook runs because a
person pressed something, so its writes stay theirs; an event hook has nobody
behind it and writes as the installation — hence the fourth author_type.

Two credentials, moving opposite ways, which is what decides how each is
stored. The install token goes plugin -> host and is only ever verified, so it
is hashed. The signing secret goes host -> plugin and must be reproduced to
sign with, so it is derived from the deployment key and stored nowhere.

Event hooks never block the host: Bus.Publish runs listeners inline on the
publishing request's goroutine, so the dispatcher hands off to a worker pool
immediately. Three attempts, then a circuit breaker, then silence.

Co-authored-by: multica-agent <[email protected]>

* feat(plugins): manual hook actions, ui trigger, and a worked hook example (MUL-6350)

The host owns the manual menu entry rather than letting a surface draw one,
because the trigger decides identity: a manual call acts as the person who
picked it, so the entry has to live where the host can prove somebody did.

The ui trigger goes through the bridge for the same reason a surface cannot
fetch its own backend directly — routing through the host is what makes the
call signed, rate limited, bounded to the granted net: domains and recorded.

buildActorNameResolver gains a plugin branch. Without it an event-written
comment rendered as "System", which is the one attribution that is actively
misleading: it reads as the platform having said something.

examples/plugins/triage-notify carries the half that does NOT run in Multica —
a reference handler showing the four things a receiver must do, including the
replay guard the host cannot do for it.

TestShippedExamplesParseAndInstallOnThisHost closes the gap that let an example
drift: nothing checked that shipped documentation still parses, or that it
declares only what this build can run.

TestCheckCapabilitiesReportsEveryUnavailableContribution rewritten the way the
other two were in PR 2 — it named today's unshipped set, so flipping ui/manual/
event on turned it red with a message about the flip rather than about the gate.
It now derives its expectation from HostCapabilities and survives a flip while
still failing if the gate stops checking a category.

Co-authored-by: multica-agent <[email protected]>

* feat(plugins): modal surface, invocation cleanup, honest capability guards (MUL-6350)

TestShippedHostCapabilitiesRunTheSurfacesTheHostMounts caught me flipping the
modal surface on without a renderer — an install that succeeds and then never
appears, which is the exact failure that guard exists to prevent. Built the
mount point rather than weakening the guard, and rewrote it to name the host
code behind each line so the next flip has to change both together.

plugin_invocation was missing from workspace teardown and from uninstall.
TestWorkspaceDeletionManifestCoversPublicSchema caught the first; the second
would have left rows naming an installation that no longer exists. Deleted by
workspace_id rather than through installation ids, so a record whose plugin was
already uninstalled does not outlive the workspace it describes.

A modal opens because a person picked it from the issue menu, never on the
plugin's own initiative — same sandbox as a panel, differing only in where it
appears.

Co-authored-by: multica-agent <[email protected]>

* test(plugins): prove the event path never blocks, and contain worker panics (MUL-6350)

Writing the never-blocks test found a real bug rather than confirming one.
Bus.Publish recovers panics in its listeners so one bad handler cannot kill the
request that published; moving delivery onto a worker goroutine stepped outside
that protection, where a panic is not a failed hook but a dead process.
runGuarded restores the guarantee the hand-off gave up.

The bridge now takes an EventSink rather than the concrete dispatcher, so the
vocabulary mapping — which internal event becomes which published one — is
asserted directly instead of through a live endpoint. That mapping is a
published contract; the internal names are not.

The backpressure test stops the workers rather than racing them, so it
reproduces a saturated pool without depending on timing, and asserts the exact
overflow instead of "something was dropped".

Co-authored-by: multica-agent <[email protected]>

* fix(plugins): two hook-contract bugs a live run found (MUL-6350)

Both were invisible to the tests because the tests made one call each, and a
real handler does not.

The callback token was single-use. The reference handler reads the issue,
decides, then posts a comment — and the second call died on a spent token.
Read-then-write is the floor for a handler that does anything with what it
read, so a single-use grant made the callback unusable.

The trade that decides it is not one call versus several. It is this token
versus the installation's standing token: a handler that cannot finish with the
callback gets written against the install token instead, which never expires
and is not scoped to an invocation. A control that pushes authors toward the
stronger credential is worse than the looser one they will actually use. The
grant is now invocation-scoped — minutes, this installation's scopes, the actor
fixed at dispatch — and revoked as soon as the call it was issued for returns.

The hook body also omitted the issue. The host resolves and permission-checks
it, then said nothing, so a handler had to read a client-supplied field —
unvalidated for ui/manual, and absent entirely for event, where there is no
client. issue_id now travels in the body.

Also adds MULTICA_PLUGIN_DEV_CA: a hook URL must be HTTPS, so an author testing
against localhost needs its certificate trusted by something. A named CA file
rather than InsecureSkipVerify, which survives into production behind a config
flag nobody remembers and cannot be spotted by reading the code.

Co-authored-by: multica-agent <[email protected]>

* fix(plugins): enforce the callback token's issue scope, sweep invocations (MUL-6350)

Addresses Fabel 5's review. The first item is the one that mattered.

The callback grant's issue narrowing existed only in two doc comments and the
PR description — pluginTokenCaller never read grant.IssueID, so a ui/manual
token was worth every issue in the workspace its actor could see, for the whole
five minutes it lived, on read and write alike. Now carried into the caller and
checked in pluginIssueForUser, after resolution so an identifier and a uuid for
the same issue agree. 404 rather than 403: "you are scoped elsewhere" confirms
the id exists.

DeleteExpiredPluginInvocations was generated and never called, while the table
comment and the PR both said TTL-swept. A sweeper now runs on the dispatcher's
lifecycle — same concern, bounded resources for something a third party drives.

Event subscriptions bypassed the read scopes. issue.* pushes the description
and comment.created pushes the body — the same content the Action API refuses
without issues:read / comments:read. Subscribing was a way to receive what
reading was not granted. Enforced at manifest validation so the consent screen
shows the read scope a subscription implies.

Migration 349's ADD CONSTRAINT copied 107's shape onto a table that is no
longer 107's size: it revalidated every comment row under ACCESS EXCLUSIVE.
NOT VALID plus a 352 that VALIDATEs under SHARE UPDATE EXCLUSIVE costs nothing
and stops nothing.

Plus the half-built breaker UI (a plugin could be enabled and silently
delivering nothing), redirect refusal on the dev hook client (a 302 would have
replayed the signed body and the callback token onward), and omitting
callback_url rather than sending a relative one.

Co-authored-by: multica-agent <[email protected]>

* fix(plugins): the invocation sweeper must not touch the database at construction (MUL-6350)

CI panicked in cmd/server: the sweeper I added last round fired immediately on
its own goroutine, and that test builds a router over a Queries whose pool was
never opened. pgxpool dereferenced the nil pool and the process died.

Two things were wrong, and only one of them is the obvious one.

The sweep no longer runs at construction. It waited for nothing and gained one
hour of retention on a cold start against a 7-day TTL; the cost was a goroutine
reaching for the database before the process is known to have one.

The nil check was also the wrong instrument. sqlc's Queries wraps an executor,
so a non-nil Queries over an unopened pool passes every comparison available at
that layer and only fails inside pgxpool — no amount of nil-checking here can
see it. The guard is a recover, for the same reason runGuarded exists: on a bare
goroutine a panic is not a failed sweep, it is a dead server. I had already
fixed that class once for delivery and then reintroduced it in the sweeper.

The regression test builds the exact shape CI hit — a dispatcher over db.New(nil)
— and fails if either the construction-time sweep or the recover comes back.
cmd/server cannot reproduce it locally, where DATABASE_URL supplies a real pool.

Co-authored-by: multica-agent <[email protected]>

* fix(plugins): gate the event dispatch path behind plugins_v1 (MUL-6350)

Answering "is this still behind the flag" turned up the one place it was not.

Every other plugin surface is refused by a handler that reads the flag off a
request. An event hook has no request: the dispatcher is subscribed to the bus
at startup and delivers on a worker. Nothing in it consulted the flag, so
turning plugins off hid the UI and refused the Action API while the OUTBOUND
calls kept going — fail-open on the one path that reaches a third party.

It only bites after a plugin has been installed, because installation is
flag-gated, so a deployment that never enabled plugins was never exposed. A
workspace that enabled it, installed something, then turned it off was.

The check reads the flag per delivery rather than once at subscription, so the
flip takes effect immediately instead of at the next restart. It also removes
the flag-off cost: every dispatched event used to run a
ListWorkspacePluginInstallations query to discover there was nothing to call.

Nil flags read as disabled — a deployment that never wired the flag service must
not get outbound hooks by omission.

The test lives in internal/handler because it needs a real installed plugin to
mean anything: with the flag on the endpoint is called, with it off nothing
leaves while the same installation stays enabled and still declares the hook.
Removing the check makes it fail on the second half.

Co-authored-by: multica-agent <[email protected]>

* perf(plugins): stop parsing event payloads on the publishing goroutine (MUL-6350)

Found while answering whether merging can affect existing users, and the answer
was "in one measurable way it can".

The bus listener passed issueIDFromPayload(e.Payload) as an argument, so a JSON
marshal plus unmarshal of the full event payload — for issue.created that is the
whole issue body, description included — ran inline on the goroutine of whatever
request published. Seven event types, every workspace, and the feature flag was
checked far downstream on the worker, which then threw the result away. A
deployment with plugins switched off paid for all of it.

The listener now hands the payload over unexamined and the id is extracted on
the worker, past the flag check. It also fits the rule this file already
claimed: the publishing request does the least it possibly can.

Not moved: the status_changed lookup, which is a map read, not a parse.

TestPublishingDoesNotParseThePayload counts MarshalJSON calls during Publish and
fails if any happen — restoring the old argument makes it fail with the count.

Co-authored-by: multica-agent <[email protected]>

---------

Co-authored-by: Lambda <[email protected]>
Co-authored-by: multica-agent <[email protected]>
2026-08-19 19:29:15 +08:00

320 lines
12 KiB
Go

package service
import (
"encoding/json"
"net/http"
"testing"
"time"
"github.com/multica-ai/multica/server/internal/events"
"github.com/multica-ai/multica/server/internal/featureflags"
db "github.com/multica-ai/multica/server/pkg/db/generated"
"github.com/multica-ai/multica/server/pkg/featureflag"
"github.com/multica-ai/multica/server/pkg/plugincontract"
"github.com/multica-ai/multica/server/pkg/protocol"
)
// The promise this file exists to keep: publishing an event NEVER waits for a
// third party.
//
// Bus.Publish calls listeners inline, on the goroutine of the request that
// published, so a listener that dialled an endpoint would put an outside server
// on the critical path of creating an issue. These tests hold the bus listener
// against an endpoint that never answers.
// A hung endpoint must not hold up the publisher. If Dispatch ever becomes
// synchronous this test hangs for the endpoint's full duration rather than
// returning in microseconds, which is the failure worth catching.
func TestEventDispatchNeverBlocksThePublisher(t *testing.T) {
blocked := make(chan struct{})
t.Cleanup(func() { close(blocked) })
harness := newHookTestServer(t)
harness.respond = func(w http.ResponseWriter, _ []byte) {
// Hold the connection open until the test finishes.
<-blocked
w.WriteHeader(http.StatusOK)
}
service := hookTestService(t, harness)
dispatcher := NewPluginEventDispatcher(service)
t.Cleanup(dispatcher.Close)
bus := events.New()
SubscribePluginEvents(bus, dispatcher)
started := time.Now()
bus.Publish(events.Event{
Type: protocol.EventIssueCreated,
WorkspaceID: "00000000-0000-4000-8000-000000000001",
ActorType: "member",
Payload: map[string]any{"issue": map[string]any{"id": "00000000-0000-4000-8000-000000000002"}},
})
elapsed := time.Since(started)
// Generous by three orders of magnitude: the point is "did not wait for the
// network", not a latency budget.
if elapsed > 250*time.Millisecond {
t.Fatalf("Publish took %v — an event hook is blocking the publishing request", elapsed)
}
}
// Backpressure is shed, not queued. An unbounded queue turns a slow plugin into
// a memory leak; dropping and counting keeps the host healthy and the loss
// visible rather than silent.
//
// Workers are stopped first so nothing drains — the same state a pool saturated
// by slow endpoints reaches, reproduced without depending on timing.
func TestEventDispatchShedsLoadRatherThanGrowingWithoutBound(t *testing.T) {
harness := newHookTestServer(t)
dispatcher := NewPluginEventDispatcher(hookTestService(t, harness))
dispatcher.Close()
// Well past the queue depth. Every call must return, none may panic, and
// Dispatch must stay safe after the pool has stopped.
for i := 0; i < dispatchQueueDepth*3; i++ {
dispatcher.Dispatch(plugincontract.EventIssueCreated, "00000000-0000-4000-8000-000000000001", nil)
}
dropped := dispatcher.Dropped()
if dropped == 0 {
t.Fatal("nothing was dropped past the queue depth — the queue is unbounded")
}
// Exactly the overflow: the queue holds its depth and sheds the rest.
if want := dispatchQueueDepth*3 - dispatchQueueDepth; dropped != want {
t.Fatalf("dropped %d, want %d — the queue is not bounded at its declared depth", dropped, want)
}
}
// The bus vocabulary and the plugin vocabulary are deliberately separate. This
// pins the mapping, including the one event that has no internal equivalent:
// issue.status_changed is derived from an issue:updated carrying
// status_changed=true, so a plugin can subscribe to the specific thing it cares
// about instead of filtering every field change itself.
func TestEventBridgeMapsInternalEventsToThePublishedVocabulary(t *testing.T) {
seen := []string{}
bus := events.New()
SubscribePluginEvents(bus, recordingSink(func(eventType string) { seen = append(seen, eventType) }))
workspace := "00000000-0000-4000-8000-000000000001"
bus.Publish(events.Event{Type: protocol.EventIssueCreated, WorkspaceID: workspace})
bus.Publish(events.Event{Type: protocol.EventCommentCreated, WorkspaceID: workspace})
bus.Publish(events.Event{Type: protocol.EventTaskRunning, WorkspaceID: workspace})
bus.Publish(events.Event{Type: protocol.EventTaskCompleted, WorkspaceID: workspace})
bus.Publish(events.Event{Type: protocol.EventTaskFailed, WorkspaceID: workspace})
// A plain field edit is issue.updated only.
bus.Publish(events.Event{Type: protocol.EventIssueUpdated, WorkspaceID: workspace, Payload: map[string]any{"title_changed": true}})
// A status change is BOTH, so a subscriber to either sees it.
bus.Publish(events.Event{Type: protocol.EventIssueUpdated, WorkspaceID: workspace, Payload: map[string]any{"status_changed": true}})
want := []string{
plugincontract.EventIssueCreated,
plugincontract.EventCommentCreated,
plugincontract.EventTaskStarted,
plugincontract.EventTaskCompleted,
plugincontract.EventTaskFailed,
plugincontract.EventIssueUpdated,
plugincontract.EventIssueUpdated,
plugincontract.EventIssueStatusChanged,
}
if len(seen) != len(want) {
t.Fatalf("dispatched %v, want %v", seen, want)
}
for index, expected := range want {
if seen[index] != expected {
t.Fatalf("dispatched[%d] = %q, want %q (full: %v)", index, seen[index], expected, seen)
}
}
// Every published event name must be one a manifest may subscribe to, or a
// plugin could never receive it.
for _, eventType := range want {
if !plugincontract.IsKnownEvent(eventType) {
t.Fatalf("%q is dispatched but not a subscribable event", eventType)
}
}
}
// The issue id travels with the event so the callback token can be narrowed to
// it. Each payload shape the product actually publishes is covered.
func TestEventBridgeFindsTheIssueInEveryPayloadShape(t *testing.T) {
issueID := "3fa85f64-5717-4562-b3fc-2c963f66afa6"
for name, payload := range map[string]any{
"issue event": map[string]any{"issue": map[string]any{"id": issueID}},
"comment event": map[string]any{"comment": map[string]any{"issue_id": issueID}},
"task event": map[string]any{"issue_id": issueID},
} {
found := issueIDFromPayload(payload)
if uuidString(found) != issueID {
t.Fatalf("%s: issue id = %q, want %q", name, uuidString(found), issueID)
}
}
// A payload with no issue yields the zero UUID, which simply means the
// grant is not issue-scoped — not an error.
if issueIDFromPayload(map[string]any{"unrelated": true}).Valid {
t.Fatal("a payload with no issue must not produce an issue-scoped grant")
}
if issueIDFromPayload(nil).Valid {
t.Fatal("a nil payload must not produce an issue-scoped grant")
}
// Not a UUID: refuse rather than pass a malformed id into a grant.
if issueIDFromPayload(map[string]any{"issue_id": "not-a-uuid"}).Valid {
t.Fatal("a malformed id must not produce an issue-scoped grant")
}
}
// An event hook writes as the installation. This asserts the actor the
// dispatcher stamps, which is what the callback token later carries.
func TestEventDispatchStampsThePluginActor(t *testing.T) {
harness := newHookTestServer(t)
service := hookTestService(t, harness)
host := hookTestHost(harness)
installation := hookTestInstallation(t, harness.server.URL+"/hooks/summarize", host,
[]string{plugincontract.TriggerEvent})
hook, err := FindHook(installation, "summarize")
if err != nil {
t.Fatalf("find hook: %v", err)
}
if _, err := service.callHookEndpoint(t.Context(), HookInvocation{
Installation: installation,
Hook: hook,
Trigger: plugincontract.TriggerEvent,
EventType: plugincontract.EventIssueCreated,
Actor: HookActor{Type: "plugin", ID: installation.ID},
}); err != nil {
t.Fatalf("event hook call: %v", err)
}
received := <-harness.received
var body hookRequestBody
if err := json.Unmarshal(received.Body, &body); err != nil {
t.Fatalf("decode delivered body: %v", err)
}
if body.Actor.Type != "plugin" {
t.Fatalf("actor.type = %q, want plugin: an event hook has no person behind it", body.Actor.Type)
}
if body.EventType != plugincontract.EventIssueCreated {
t.Fatalf("event_type = %q, want %q", body.EventType, plugincontract.EventIssueCreated)
}
if body.Trigger != plugincontract.TriggerEvent {
t.Fatalf("trigger = %q, want event", body.Trigger)
}
// Re-issued: callHookEndpoint revokes the grant once its call has returned.
token, err := service.Callbacks.Issue(t.Context(), HookInvocation{
Installation: installation,
Hook: hook,
Trigger: plugincontract.TriggerEvent,
Actor: HookActor{Type: "plugin", ID: installation.ID},
})
if err != nil {
t.Fatalf("issue: %v", err)
}
grant, err := service.Callbacks.Resolve(token)
if err != nil {
t.Fatalf("resolve: %v", err)
}
if grant.Actor.Type != "plugin" {
t.Fatalf("the grant must carry the plugin actor, got %q", grant.Actor.Type)
}
}
// recordingSink stands in for the dispatcher so the vocabulary mapping is
// asserted directly, with no worker pool or endpoint in the way.
type recordingSink func(eventType string)
func (r recordingSink) Dispatch(eventType, _ string, _ any) { r(eventType) }
// The shape that took down cmd/server's router test: a dispatcher built over a
// Queries whose pool was never opened.
//
// A nil check on Queries does not catch it — sqlc wraps an executor, so the
// value is non-nil and the nil pool is only reached inside pgxpool. Constructing
// a dispatcher must therefore never touch the database on its own, and a sweep
// that does must not be able to kill the process.
func TestNewDispatcherDoesNotTouchTheDatabase(t *testing.T) {
// A Queries over a nil pool: exactly what NewRouter holds in a test that
// never opens one.
dispatcher := NewPluginEventDispatcher(&PluginService{Queries: db.New(nil)})
t.Cleanup(dispatcher.Close)
// Long enough that a construction-time sweep would already have panicked and
// taken the process with it.
time.Sleep(150 * time.Millisecond)
// And the sweep itself, called directly, must survive the same pool.
dispatcher.sweepOnce()
}
func testFlagService(enabled bool) *featureflag.Service {
provider := featureflag.NewStaticProvider()
provider.Set(featureflags.PluginsV1, featureflag.Rule{Default: enabled})
return featureflag.NewService(provider)
}
// Nil flags read as disabled. A deployment that never wired the flag service
// must not have outbound hooks enabled by that omission.
func TestEventDispatchTreatsMissingFlagsAsDisabled(t *testing.T) {
harness := newHookTestServer(t)
service := hookTestService(t, harness)
service.Queries = db.New(nil)
service.FeatureFlags = nil
dispatcher := NewPluginEventDispatcher(service)
t.Cleanup(dispatcher.Close)
dispatcher.runGuarded(dispatchJob{
installation: db.PluginInstallation{WorkspaceID: testInstallationID(t)},
eventType: plugincontract.EventIssueCreated,
})
select {
case <-harness.received:
t.Fatal("a request left with no feature flag service configured")
default:
}
}
// countingPayload records how many times something serialized it.
//
// json.Marshal calls MarshalJSON, so this counts exactly the work the bus
// listener used to do on the publishing request's goroutine.
type countingPayload struct{ marshals *int }
func (c countingPayload) MarshalJSON() ([]byte, error) {
*c.marshals++
return []byte(`{"issue":{"id":"3fa85f64-5717-4562-b3fc-2c963f66afa6"}}`), nil
}
// Publishing must not parse the payload.
//
// The listener used to pass issueIDFromPayload(e.Payload) as an argument, which
// put a JSON marshal + unmarshal of a full issue body on the request goroutine
// for seven event types, in every workspace — including deployments with plugins
// switched off, where the flag check downstream then threw the result away.
// Finding the id belongs on a worker, past the flag.
func TestPublishingDoesNotParseThePayload(t *testing.T) {
marshals := 0
bus := events.New()
SubscribePluginEvents(bus, recordingSink(func(string) {}))
bus.Publish(events.Event{
Type: protocol.EventIssueCreated,
WorkspaceID: "00000000-0000-4000-8000-000000000001",
Payload: countingPayload{marshals: &marshals},
})
if marshals != 0 {
t.Fatalf("the payload was serialized %d time(s) on the publishing goroutine; the id must be extracted on a worker instead", marshals)
}
}
// And the id still arrives — moved, not dropped. issueIDFromPayload remains the
// one place that knows the payload shapes; only where it runs changed.
func TestTheIssueIDIsStillFoundOnTheWorker(t *testing.T) {
issueID := "3fa85f64-5717-4562-b3fc-2c963f66afa6"
found := issueIDFromPayload(map[string]any{"issue": map[string]any{"id": issueID}})
if uuidString(found) != issueID {
t.Fatalf("issue id = %q, want %q", uuidString(found), issueID)
}
}