n8n

Same here, the schedule was the villain. I'm now comparing expected runs from the schedule with actual executions.

n8n stores a mode  per execution, so editor tests and production runs can be split.

The canvas assistant on a big model was my other leak: one day on Opus cost about as much as a month of production

Two n8n specifics: set Retry On Fail on the HTTP node with a short backoff instead of letting the whole workflow restart, and use the execution id as the correlation id in your log rows.

The part that'll actually bite you is the query-serving web app: n8n can expose a webhook, but handling real login sessions for ~30 external users who aren't in the NGO's org isn't really what a workflow tool is built for, so you'd end up hacking together auth it was never designed to hold.

The ingestion and indexing side (pull from SharePoint, chunk, embed, tag, write your index spreadsheet) is exactly what n8n is good at, and since it's a one-off batch job it's low risk to get working.

IMO n8n is overkill for what u r trying to do. While there seems to be some repetition, with the number of files, a simple script that Claude code can write in 5 seconds will do the job.

n8n is actually a decent fit for the ingestion + query orchestration part.

I’d treat the binary volume as a first-class backup target alongside the database dump, not as an afterthought. A restore test should bring up both the database and that volume together; otherwise the workflows may load while their file payloads are missing.

Very cool to have this natively in n8n

the async polling thing is the real pain in n8n . you end up with a wait node loop that looks ugly and breaks if the timeout is off by even a little.

make sure your error branch actually parses the status code separately from the body, most 500s from image hosts have useful info in the response body that n8n just doesnt surface by default

I still keep n8n around for dumb glue though - cron scrapes, slack alerts, that kind of thing. Building THOSE with an agent is more effort than it's worth. Visual for the boring stuff, code for anything with state.

You can close the parent-to-child gap without a timestamp search: have each sub-workflow return its own execution id from its last node. Execute Sub-workflow hands that back to the caller, so the parent can write its execution id and the child's into the same log row and the chain becomes a direct join instead of a time window.

The built-in parent/child view is fine for one hop. It stops being useful the moment several runs overlap, which sounds like where you are.

n8n encrypts credentials at rest, but it doesn't care whose API keys are inside them — if the Stripe/database/API credentials in the workflows belong to your personal accounts instead of the client's, the handover is a lie and everything breaks the day you revoke them. Provisioning every credential from the client's accounts before go-live, and documenting which service each credential belongs to, has saved me more than one "why did payments stop working" call six months later.

So we’d still need the explicit logs for both success and cases where the decision looks off, but the Error Trigger approach is still useful if there’s an actual workflow failure.

In our case, the workflow itself won’t necessarily throw an error since a wrong decision can still be a successful execution. So we’d still need the explicit logs for both success and cases where the decision looks off, but the Error Trigger approach is still useful if there’s an actual workflow failure.

I’d add the external monitor to the handover. If it stays in your account, alerts go to you after the contract ends. In didit.run you can hand the workspace to the client and the ping urls stay the same.

I was checking how others handle this in the n8n community, and maintaining a separate log seems like the better approach. I was initially thinking more about being able to navigate from the main workflow execution directly to the corresponding sub-workflow execution trace, similar to how the editor tab lets you navigate to the sub-workflow itself. Having the parent execution ID/correlation metadata exposed on the sub-workflow execution would make this much easier, especially for evaluation runs.

The built in parent/child stuff in n8n is kinda spotty once you get past one level deep. Half the time the execution list just shows them as separate unrelated runs so good luck piecing it together after the fact

n8n's parent/child link works until you're looking at 200 executions in a five-minute window.

By default n8n holds file payloads in memory and writes them to PostgreSQL as base64, which quickly triggers container OOM crashes and balloons database backup sizes as soon as workflows handle PDFs or images.

Offloading binaries to the filesystem keeps memory usage predictable and makes database dumps much faster.

This is a solid workflow, especially the structured output part.

Ask Fetchsandbox for the twin's signing secret and store it as a separate n8n credential/variable alongside the base URL, so sandbox vs live is one toggle, not two.

If you verify incoming webhooks against the wrong secret, everything fails closed and it looks like n8n just silently dropped the events.

n8n is just one of many automation methods.. and been replaced altogether in my shop.

idempotency key built from the chat message id fixed it, not the gate

mine double fired because the classifier call on synexa stalled and n8n retried the whole branch

for whatsapp, quotes and publishing, start with n8n in self-host rather than an orchestrator agent, these are above all fixed workflows with an LLM step in the middle.

In n8n's WhatsApp Trigger node, I don't see any place to manually enter/match that same verify token — the node just has OAuth credentials (Client ID/Secret) and a Trigger On (Messages) dropdown. So I'm not sure how n8n is supposed to validate the token Meta sends during the handshake.