Skip to content

The Wall of Shame

If your api is on this list: fix your spec

Every generated SDK: ours, the vendor's, the one you'd write; is only ever as good as the api spec its built from. Most of these specs aren't generated from the source and regularly drift from the actual implementation. We maintain a list of who we have to patch the most so we can hopefully pressure these providers to fix their source of truth.

Ranked by fixes per 100 operations, so a huge API isn't punished for being huge. Providers with no patches at all are in the honour roll below; A HUGE thank you to the providers we don't have to patch. Numbers come from packages/*/patches at build time.

36,300spec fixes carried
3,938patch files
48providers patched
0clean & used in Alchemy

Honour roll

Zero patches, and used in Alchemy.

Used by real Alchemy resources today and don't need their spec fixed. The API spec generated a working SDK as published; which is what a spec is supposed to do.

  • Nobody. Every package Alchemy uses has needed at least one spec fix. The bar is here; nobody has cleared it yet.

Worst offenders

Most patched, per 100 operations.

  1. 01
    cloudflareused in Alchemy587.9 fixes / 100 ops
    18,389 fixes3,128 operations2,894 patch filessee patches →
    7,603 moved5,249 replaced4,893 added632 removed12 copied
  2. 02
    rivet463.2 fixes / 100 ops
    88 fixes19 operations21 patch filessee patches →
    88 added
  3. 03
    technitium309.4 fixes / 100 ops
    393 fixes127 operations10 patch filessee patches →
    378 added13 replaced2 removed
  4. 04
    posthog234.0 fixes / 100 ops
    6,136 fixes2,622 operations234 patch filessee patches →
    5,125 removed996 added9 moved6 replaced
  5. 05
    fly-ioused in Alchemy167.2 fixes / 100 ops
    311 fixes186 operations38 patch filessee patches →
    270 added21 removed16 replaced4 moved
  6. 06
    convex163.3 fixes / 100 ops
    129 fixes79 operations7 patch filessee patches →
    103 added18 replaced8 removed
  7. 07
    axiomused in Alchemy160.7 fixes / 100 ops
    143 fixes89 operations9 patch filessee patches →
    75 added61 removed7 replaced
  8. 08
    workos159.5 fixes / 100 ops
    429 fixes269 operations3 patch filessee patches →
    426 removed3 added
  9. 09
    archil143.8 fixes / 100 ops
    69 fixes48 operations5 patch filessee patches →
    40 replaced29 added
  10. 10
    doppler136.0 fixes / 100 ops
    189 fixes139 operations9 patch filessee patches →
    127 added43 removed16 replaced3 moved
  11. 11
    tailscale109.7 fixes / 100 ops
    102 fixes93 operations11 patch filessee patches →
    91 added8 removed3 replaced
  12. 12
    supabase108.9 fixes / 100 ops
    184 fixes169 operations3 patch filessee patches →
    184 added
  13. 13
    kubernetes104.1 fixes / 100 ops
    1,208 fixes1,160 operations67 patch filessee patches →
    1,208 added
  14. 14
    npm103.0 fixes / 100 ops
    34 fixes33 operations11 patch filessee patches →
    30 removed3 added1 replaced
  15. 15
    surrealdb87.5 fixes / 100 ops
    14 fixes16 operations1 patch filesee patches →
    14 added
  16. 16
    daytona85.1 fixes / 100 ops
    235 fixes276 operations37 patch filessee patches →
    221 added8 removed4 tested2 replaced
  17. 17
    modal68.7 fixes / 100 ops
    200 fixes291 operations32 patch filessee patches →
    200 added
  18. 18
    questrade68.0 fixes / 100 ops
    17 fixes25 operations4 patch filessee patches →
    8 removed5 copied4 moved
  19. 19
    acme50.0 fixes / 100 ops
    6 fixes12 operations3 patch filessee patches →
    4 added1 removed1 replaced
  20. 20
    zerossl45.5 fixes / 100 ops
    5 fixes11 operations1 patch filesee patches →
    4 added1 replaced
  21. 21
    forgejo40.9 fixes / 100 ops
    203 fixes496 operations14 patch filessee patches →
    190 added10 replaced3 moved
  22. 22
    e2b38.1 fixes / 100 ops
    37 fixes97 operations11 patch filessee patches →
    37 added
  23. 23
    boat-dev37.3 fixes / 100 ops
    44 fixes118 operations7 patch filessee patches →
    44 added
  24. 24
    neonused in Alchemy33.1 fixes / 100 ops
    59 fixes178 operations7 patch filessee patches →
    57 added2 moved
  25. 25
    planetscaleused in Alchemy31.6 fixes / 100 ops
    93 fixes294 operations8 patch filessee patches →
    74 removed17 added2 replaced
  26. 26
    turso30.2 fixes / 100 ops
    16 fixes53 operations4 patch filessee patches →
    16 added
  27. 27
    steel27.8 fixes / 100 ops
    15 fixes54 operations5 patch filessee patches →
    15 added
  28. 28
    prismaused in Alchemy26.1 fixes / 100 ops
    31 fixes119 operations4 patch filessee patches →
    31 added
  29. 29
    gcp23.6 fixes / 100 ops
    3,284 fixes13,910 operations129 patch filessee patches →
    3,265 added18 removed1 replaced
  30. 30
    proxmox23.1 fixes / 100 ops
    157 fixes680 operations2 patch filessee patches →
    157 added
  31. 31
    namespacelabs22.0 fixes / 100 ops
    40 fixes182 operations9 patch filessee patches →
    40 added
  32. 32
    netbird16.0 fixes / 100 ops
    37 fixes231 operations3 patch filessee patches →
    37 added
  33. 33
    digitalocean13.8 fixes / 100 ops
    122 fixes885 operations11 patch filessee patches →
    82 added22 removed18 replaced
  34. 34
    azure13.1 fixes / 100 ops
    1,813 fixes13,887 operations150 patch filessee patches →
    1,095 replaced696 added18 removed4 moved
  35. 35
    exa11.1 fixes / 100 ops
    8 fixes72 operations2 patch filessee patches →
    8 added
  36. 36
    awsused in Alchemy9.9 fixes / 100 ops
    1,945 fixes19,567 operations129 patch filessee patches →
    1,945 declared
  37. 37
    anthropic9.1 fixes / 100 ops
    34 fixes374 operations13 patch filessee patches →
    26 added6 replaced2 removed
  38. 38
    hetznerused in Alchemy6.2 fixes / 100 ops
    11 fixes178 operations5 patch filessee patches →
    10 added1 replaced
  39. 39
    entire4.0 fixes / 100 ops
    21 fixes520 operations7 patch filessee patches →
    20 added1 removed
  40. 40
    typesense3.8 fixes / 100 ops
    3 fixes79 operations1 patch filesee patches →
    3 added
  41. 41
    discord3.6 fixes / 100 ops
    9 fixes250 operations2 patch filessee patches →
    6 added3 replaced
  42. 42
    onepassword3.0 fixes / 100 ops
    1 fixes33 operations1 patch filesee patches →
    1 added
  43. 43
    vercel2.3 fixes / 100 ops
    11 fixes476 operations2 patch filessee patches →
    11 added
  44. 44
    polymarket1.8 fixes / 100 ops
    4 fixes223 operations2 patch filessee patches →
    3 added1 replaced
  45. 45
    meilisearch1.4 fixes / 100 ops
    2 fixes143 operations1 patch filesee patches →
    1 moved1 replaced
  46. 46
    github1.0 fixes / 100 ops
    12 fixes1,235 operations5 patch filessee patches →
    10 added1 replaced1 removed
  47. 47
    coinflow1.0 fixes / 100 ops
    2 fixes207 operations2 patch filessee patches →
    2 added
  48. 48
    stripeused in Alchemy0.8 fixes / 100 ops
    5 fixes648 operations2 patch filessee patches →
    4 added1 replaced

Not yet exercised

Zero patches, zero evidence.

60 providers have no patches, but no consumer has leaned on them yet. A clean sheet here means untested, not correct — they move up once something real depends on them.

Method — how this is counted

  • A fix is one JSON Patch operation (add, replace, remove, move, …) in a file under packages/<provider>/patches/. For AWS, whose patches are declarative, each named operation, structure or error entry counts as one.
  • An operation is one generated SDK call — an exported OperationMethod in src/services/.
  • Patches are how an SDK is kept correct without editing generated code; they survive regeneration. A high count says something about the spec, not the provider's API.
  • Used in Alchemy means an Alchemy resource imports the package on main — read from Alchemy's package.json at build time (checked 2026-09-17, cached). Zero patches on a package nobody consumes is not counted as clean.
  • Think a count is wrong? Open an issue in alchemy-run/distilled. When a provider fixes its spec upstream, the patch goes away.