molecule-ai/molecule-core
44
0
Fork 2
Code Issues 134 Pull Requests 156 Actions Packages Projects Releases Wiki Activity

Canary failing: staging SaaS smoke #424

New Issue
Closed
opened 2026-05-11 07:38:07 +00:00 by gitea-actions · 95 comments
gitea-actions bot commented 2026-05-11 07:38:07 +00:00
Copy Link
Copy Source

Canary run failed at 2026-05-11T07:38:06Z.

Run: https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/9377

This issue auto-closes on the next green canary run. Consecutive failures add a comment here rather than a new issue.

Canary run failed at 2026-05-11T07:38:06Z. Run: https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/9377 This issue auto-closes on the next green canary run. Consecutive failures add a comment here rather than a new issue.
gitea-actions bot commented 2026-05-11 08:08:13 +00:00
Copy Link
Copy Source

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/9571

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/9571
triage-operator added the tier:low label 2026-05-11 08:35:00 +00:00
gitea-actions bot commented 2026-05-11 08:38:15 +00:00
Copy Link
Copy Source

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/9699

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/9699
gitea-actions bot commented 2026-05-11 09:10:50 +00:00
Copy Link
Copy Source

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/9878

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/9878
gitea-actions bot commented 2026-05-11 09:40:31 +00:00
Copy Link
Copy Source

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/10056

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/10056
gitea-actions bot commented 2026-05-11 10:13:32 +00:00
Copy Link
Copy Source

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/10288

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/10288
gitea-actions bot commented 2026-05-11 10:51:50 +00:00
Copy Link
Copy Source

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/10474

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/10474
gitea-actions bot commented 2026-05-11 11:14:18 +00:00
Copy Link
Copy Source

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/10704

Canary still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/10704
gitea-actions bot commented 2026-05-11 11:37:18 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/10856

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/10856
gitea-actions bot commented 2026-05-11 12:06:00 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11115

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11115
gitea-actions bot commented 2026-05-11 12:35:49 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11341

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11341
gitea-actions bot commented 2026-05-11 13:05:31 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11498

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11498
gitea-actions bot commented 2026-05-11 13:35:50 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11629

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11629
gitea-actions bot commented 2026-05-11 14:06:23 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11796

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11796
gitea-actions bot commented 2026-05-11 14:36:56 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11930

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/11930
gitea-actions bot commented 2026-05-11 15:05:26 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12060

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12060
gitea-actions bot commented 2026-05-11 15:35:07 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12246

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12246
gitea-actions bot commented 2026-05-11 16:05:17 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12479

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12479
gitea-actions bot commented 2026-05-11 16:34:58 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12579

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12579
core-devops commented 2026-05-11 16:50:24 +00:00
Member
Copy Link
Copy Source

core-devops-agent triage (2026-05-11T17:15Z)

Likely root cause: missing/rotated LLM API key secret

The canary (staging-smoke.yml) fails at the "Verify LLM key present" step with exit 2 when neither MOLECULE_STAGING_MINIMAX_API_KEY nor MOLECULE_STAGING_ANTHROPIC_API_KEY is populated in the Gitea Actions secret store.

Relevant from the workflow source (e2e-staging-saas.yml lines 96/101):

E2E_MINIMAX_API_KEY: ${{ secrets.MOLECULE_STAGING_MINIMAX_API_KEY }}
E2E_ANTHROPIC_API_KEY: ${{ secrets.MOLECULE_STAGING_ANTHROPIC_API_KEY }}

The staging-admin token was canonicalised to CP_STAGING_ADMIN_API_TOKEN per internal#322, but the LLM API key secrets were NOT migrated to the CP_STAGING_ prefix. This means:

Option A (preferred): Register MOLECULE_STAGING_MINIMAX_API_KEY in the Gitea Actions secret store (set the actual MiniMax API key value). This is the primary LLM path per the workflow comment.

Option B: Register MOLECULE_STAGING_ANTHROPIC_API_KEY with a direct Anthropic key as fallback.

Either secret will unblock the smoke. Both will make the canary green.

What this is NOT

  • Not a config drift in the test script — the hard-fail is intentional (lesson from #2578 where a silent fallback masked a dead OpenAI key for 36h).
  • Not a code regression — the workflow has not changed since the RFC #219 migration.
  • Not a Gitea Actions parser issue (those are fixed by PR #516).

Action needed

A human with Gitea Actions secret store access (repo admin) must register MOLECULE_STAGING_MINIMAX_API_KEY or MOLECULE_STAGING_ANTHROPIC_API_KEY. This is a human gate, not a code change.

Filed by core-devops-agent.

## core-devops-agent triage (2026-05-11T17:15Z) ### Likely root cause: missing/rotated LLM API key secret The canary (staging-smoke.yml) fails at the "Verify LLM key present" step with exit 2 when neither `MOLECULE_STAGING_MINIMAX_API_KEY` nor `MOLECULE_STAGING_ANTHROPIC_API_KEY` is populated in the Gitea Actions secret store. Relevant from the workflow source (e2e-staging-saas.yml lines 96/101): E2E_MINIMAX_API_KEY: ${{ secrets.MOLECULE_STAGING_MINIMAX_API_KEY }} E2E_ANTHROPIC_API_KEY: ${{ secrets.MOLECULE_STAGING_ANTHROPIC_API_KEY }} The staging-admin token was canonicalised to `CP_STAGING_ADMIN_API_TOKEN` per internal#322, but the LLM API key secrets were NOT migrated to the `CP_STAGING_` prefix. This means: **Option A** (preferred): Register `MOLECULE_STAGING_MINIMAX_API_KEY` in the Gitea Actions secret store (set the actual MiniMax API key value). This is the primary LLM path per the workflow comment. **Option B**: Register `MOLECULE_STAGING_ANTHROPIC_API_KEY` with a direct Anthropic key as fallback. Either secret will unblock the smoke. Both will make the canary green. ### What this is NOT - Not a config drift in the test script — the hard-fail is intentional (lesson from #2578 where a silent fallback masked a dead OpenAI key for 36h). - Not a code regression — the workflow has not changed since the RFC #219 migration. - Not a Gitea Actions parser issue (those are fixed by PR #516). ### Action needed A human with Gitea Actions secret store access (repo admin) must register `MOLECULE_STAGING_MINIMAX_API_KEY` or `MOLECULE_STAGING_ANTHROPIC_API_KEY`. This is a human gate, not a code change. Filed by core-devops-agent.
gitea-actions bot commented 2026-05-11 17:05:18 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12705

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12705
gitea-actions bot commented 2026-05-11 17:35:09 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12866

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/12866
gitea-actions bot commented 2026-05-11 18:07:19 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/13045

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/13045
gitea-actions bot commented 2026-05-11 18:35:08 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/13232

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/13232
gitea-actions bot commented 2026-05-11 19:35:18 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/13721

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/13721
gitea-actions bot commented 2026-05-11 20:10:54 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/13989

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/13989
gitea-actions bot commented 2026-05-11 20:36:00 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/14181

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/14181
gitea-actions bot commented 2026-05-11 21:06:35 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/14377

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/14377
gitea-actions bot commented 2026-05-11 21:35:25 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/14526

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/14526
gitea-actions bot commented 2026-05-11 22:12:29 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/14750

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/14750
gitea-actions bot commented 2026-05-11 22:48:09 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/15057

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/15057
gitea-actions bot commented 2026-05-11 23:09:40 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/15234

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/15234
gitea-actions bot commented 2026-05-11 23:36:59 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/15561

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/15561
gitea-actions bot commented 2026-05-12 00:06:14 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/15864

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/15864
gitea-actions bot commented 2026-05-12 00:47:02 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/16142

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/16142
gitea-actions bot commented 2026-05-12 01:08:38 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/16322

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/16322
gitea-actions bot commented 2026-05-12 01:35:19 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/16533

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/16533
gitea-actions bot commented 2026-05-12 02:05:04 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/16765

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/16765
gitea-actions bot commented 2026-05-12 02:35:07 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/16943

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/16943
gitea-actions bot commented 2026-05-12 03:05:28 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/17162

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/17162
gitea-actions bot commented 2026-05-12 03:35:17 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/17453

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/17453
gitea-actions bot commented 2026-05-12 04:05:12 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/17767

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/17767
gitea-actions bot commented 2026-05-12 04:35:23 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/17851

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/17851
gitea-actions bot commented 2026-05-12 05:07:34 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/18089

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/18089
gitea-actions bot commented 2026-05-12 05:34:56 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/18304

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/18304
gitea-actions bot commented 2026-05-12 06:05:33 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/18587

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/18587
core-qa commented 2026-05-12 06:07:22 +00:00
Member
Copy Link
Copy Source

core-qa: root-cause located and fix PR filed.

Root cause: MoleculeTenantEICRole-staging IAM role lacks ec2-instance-connect:OpenTunnel permission. The AWS-managed EC2InstanceConnect policy attached to this role grants only DescribeInstances + SendSSHPublicKey, not OpenTunnel. The tenant workspace-server's aws ec2-instance-connect open-tunnel subprocess (workspace-server/internal/handlers/terminal.go:openTunnelCmd) exits AccessDenied, so terminal_diagnose step 5 (wait-for-port) times out — visible on every smoke run as step 7b/11 failure.

Verified via aws iam simulate-principal-policy → OpenTunnel: implicitDeny for this role.

Fix: molecule-ai/internal#353 — adds an inline Allow ec2-instance-connect:OpenTunnel statement to the existing MoleculeTenantSecretsAccess policy in infra/cloudformation/staging-account-bootstrap.yaml.

Post-merge: requires aws cloudformation deploy on molecule-staging-bootstrap stack (operator with AWS admin in 004947743811). After stack update, next */30 smoke run should go green and auto-close this issue.

Follow-up: tests/e2e/test_staging_full_saas.sh:514 drops the diagnose handler's Detail field — surfacing only error masked the AccessDenied cause as a generic timeout. To be filed as a separate observability nit.

core-qa: root-cause located and fix PR filed. **Root cause**: `MoleculeTenantEICRole-staging` IAM role lacks `ec2-instance-connect:OpenTunnel` permission. The AWS-managed `EC2InstanceConnect` policy attached to this role grants only `DescribeInstances` + `SendSSHPublicKey`, not `OpenTunnel`. The tenant workspace-server's `aws ec2-instance-connect open-tunnel` subprocess (`workspace-server/internal/handlers/terminal.go:openTunnelCmd`) exits AccessDenied, so `terminal_diagnose` step 5 (`wait-for-port`) times out — visible on every smoke run as step 7b/11 failure. Verified via `aws iam simulate-principal-policy` → `OpenTunnel: implicitDeny` for this role. **Fix**: molecule-ai/internal#353 — adds an inline `Allow ec2-instance-connect:OpenTunnel` statement to the existing `MoleculeTenantSecretsAccess` policy in `infra/cloudformation/staging-account-bootstrap.yaml`. **Post-merge**: requires `aws cloudformation deploy` on `molecule-staging-bootstrap` stack (operator with AWS admin in 004947743811). After stack update, next */30 smoke run should go green and auto-close this issue. **Follow-up**: `tests/e2e/test_staging_full_saas.sh:514` drops the diagnose handler's `Detail` field — surfacing only `error` masked the AccessDenied cause as a generic timeout. To be filed as a separate observability nit.
core-qa commented 2026-05-12 06:08:58 +00:00
Member
Copy Link
Copy Source

core-qa: Phase 4 status — fix merged-eligible but blocked at two-eyes gate.

CI on internal#353:

  • scripts-lint: green
  • sop-tier-check: red as expected (tier=tier:high no_approvers eligible_teams=ceo)

Per SOP, tier:high requires CEO approval. core-qa persona is not eligible. Awaiting Hongming (CEO) review on molecule-ai/internal#353.

Next steps after CEO approval + merge:

  1. Operator with AWS admin in 004947743811 runs aws cloudformation deploy --stack-name molecule-staging-bootstrap --template-file infra/cloudformation/staging-account-bootstrap.yaml --capabilities CAPABILITY_NAMED_IAM (core-qa lacks IAM write).
  2. Re-run aws iam simulate-principal-policy --policy-source-arn arn:aws:iam::004947743811:role/MoleculeTenantEICRole-staging --action-names ec2-instance-connect:OpenTunnel → expect allowed.
  3. Operator-dispatch the smoke workflow (or wait for next */30 cron) → expect step 7b green, full smoke green, auto-close on this issue.

Verification of root cause (read-only) is complete. The IAM simulator confirmed OpenTunnel: implicitDeny for MoleculeTenantEICRole-staging; no other infra change is needed.

core-qa: Phase 4 status — fix merged-eligible but blocked at two-eyes gate. **CI on internal#353**: - scripts-lint: green - sop-tier-check: red as expected (`tier=tier:high no_approvers eligible_teams=ceo`) Per SOP, tier:high requires CEO approval. core-qa persona is not eligible. **Awaiting Hongming (CEO) review on molecule-ai/internal#353.** Next steps after CEO approval + merge: 1. Operator with AWS admin in 004947743811 runs `aws cloudformation deploy --stack-name molecule-staging-bootstrap --template-file infra/cloudformation/staging-account-bootstrap.yaml --capabilities CAPABILITY_NAMED_IAM` (core-qa lacks IAM write). 2. Re-run `aws iam simulate-principal-policy --policy-source-arn arn:aws:iam::004947743811:role/MoleculeTenantEICRole-staging --action-names ec2-instance-connect:OpenTunnel` → expect `allowed`. 3. Operator-dispatch the smoke workflow (or wait for next */30 cron) → expect step 7b green, full smoke green, auto-close on this issue. Verification of root cause (read-only) is complete. The IAM simulator confirmed `OpenTunnel: implicitDeny` for `MoleculeTenantEICRole-staging`; no other infra change is needed.
gitea-actions bot commented 2026-05-12 06:35:09 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/18842

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/18842
gitea-actions bot commented 2026-05-12 07:06:06 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/18944

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/18944
gitea-actions bot commented 2026-05-12 07:42:11 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/19363

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/19363
gitea-actions bot commented 2026-05-12 08:12:11 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/19529

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/19529
gitea-actions bot commented 2026-05-12 08:36:10 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/19744

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/19744
gitea-actions bot commented 2026-05-12 09:05:25 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/19882

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/19882
gitea-actions bot commented 2026-05-12 09:43:45 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/20248

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/20248
gitea-actions bot commented 2026-05-12 10:15:14 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/20492

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/20492
gitea-actions bot commented 2026-05-12 10:39:46 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/20687

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/20687
gitea-actions bot commented 2026-05-12 11:04:58 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/20846

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/20846
gitea-actions bot commented 2026-05-12 11:35:08 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21024

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21024
gitea-actions bot commented 2026-05-12 12:05:57 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21224

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21224
gitea-actions bot commented 2026-05-12 12:34:56 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21307

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21307
gitea-actions bot commented 2026-05-12 13:05:12 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21415

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21415
gitea-actions bot commented 2026-05-12 13:34:53 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21536

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21536
gitea-actions bot commented 2026-05-12 14:07:52 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21663

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21663
gitea-actions bot commented 2026-05-12 14:35:35 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21809

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/21809
gitea-actions bot commented 2026-05-12 15:05:44 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22090

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22090
gitea-actions bot commented 2026-05-12 15:35:14 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22182

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22182
gitea-actions bot commented 2026-05-12 16:05:16 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22355

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22355
gitea-actions bot commented 2026-05-12 16:35:21 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22585

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22585
gitea-actions bot commented 2026-05-12 17:04:56 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22761

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22761
gitea-actions bot commented 2026-05-12 17:34:52 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22909

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/22909
gitea-actions bot commented 2026-05-12 18:05:23 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23112

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23112
gitea-actions bot commented 2026-05-12 18:35:33 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23290

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23290
gitea-actions bot commented 2026-05-12 19:06:03 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23328

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23328
gitea-actions bot commented 2026-05-12 19:41:56 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23512

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23512
gitea-actions bot commented 2026-05-12 20:05:16 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23548

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23548
gitea-actions bot commented 2026-05-12 20:35:07 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23676

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/23676
gitea-actions bot commented 2026-05-12 21:52:34 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/24468

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/24468
gitea-actions bot commented 2026-05-12 22:06:17 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25057

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25057
gitea-actions bot commented 2026-05-12 22:43:58 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25279

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25279
gitea-actions bot commented 2026-05-12 23:04:39 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25346

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25346
gitea-actions bot commented 2026-05-12 23:37:01 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25498

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25498
gitea-actions bot commented 2026-05-13 00:04:38 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25648

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25648
gitea-actions bot commented 2026-05-13 00:35:12 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25835

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/25835
gitea-actions bot commented 2026-05-13 01:12:55 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26182

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26182
gitea-actions bot commented 2026-05-13 01:37:12 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26360

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26360
gitea-actions bot commented 2026-05-13 02:04:35 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26470

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26470
gitea-actions bot commented 2026-05-13 02:34:29 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26642

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26642
gitea-actions bot commented 2026-05-13 03:05:44 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26819

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26819
gitea-actions bot commented 2026-05-13 03:37:20 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26967

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/26967
gitea-actions bot commented 2026-05-13 04:04:35 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/27110

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/27110
gitea-actions bot commented 2026-05-13 04:38:33 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/27349

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/27349
gitea-actions bot commented 2026-05-13 05:34:20 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/27939

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/27939
gitea-actions bot commented 2026-05-13 06:05:09 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/28200

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/28200
gitea-actions bot commented 2026-05-13 06:36:06 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/28445

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/28445
gitea-actions bot commented 2026-05-13 07:07:07 +00:00
Copy Link
Copy Source

Smoke recovered at 2026-05-13T07:07:07Z. Closing.

Smoke recovered at 2026-05-13T07:07:07Z. Closing.
gitea-actions bot closed this issue 2026-05-13 07:07:09 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
area/ci
CI/CD pipeline issues
 kind/infrastructure
Infrastructure-related issues
 merge-queue
Ready for serialized Gitea merge queue
 merge-queue-hold
Temporarily hold PR in merge queue
 platform/go
Go platform test issues
 release-blocker
Blocks the staging→main promotion / a release
 release-test
security
test-label-sre
tier:high
High risk per dev-sop §SOP-6 — ceo only, 24h cooldown
 tier:low
Low risk per dev-sop §SOP-6 — engineers/managers/ceo can approve
 tier:medium
Medium risk per dev-sop §SOP-6 — managers/ceo can approve
 triage-test
test
No Label tier:low
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
agent-dev-a agent-dev-b agent-pm app-fe (Molecule AI · app-fe) app-lead (Molecule AI · app-lead) app-qa (Molecule AI · app-qa) claude-ceo-assistant claude-ci-reader claude-status-reaper core-be (Molecule AI · core-be) core-devops (Molecule AI · core-devops) core-fe (Molecule AI · core-fe) core-lead (Molecule AI · core-lead) core-offsec (Molecule AI · core-offsec) core-qa (Molecule AI · core-qa) core-security (Molecule AI · core-security) core-uiux (Molecule AI · core-uiux) cp-be (Molecule AI · cp-be) cp-lead (Molecule AI · cp-lead) cp-qa (Molecule AI · cp-qa) cp-security (Molecule AI · cp-security) cui (Zhanlin Cui) dev-lead (Molecule AI · dev-lead) devops-engineer documentation-specialist (Molecule AI · documentation-specialist) fullstack-engineer (Molecule AI · fullstack-engineer) hongming hongming-codex-laptop hongming-kimi-laptop hongming-pc2 infra-lead (Molecule AI · infra-lead) infra-runtime-be (Molecule AI · infra-runtime-be) infra-sre (Molecule AI · infra-sre) integration-tester (Molecule AI · integration-tester) mc-drift-bot plugin-dev (Molecule AI · plugin-dev) pm publish-runtime-bot release-manager (Molecule AI · release-manager) sdk-dev (Molecule AI · sdk-dev) sdk-lead (Molecule AI · sdk-lead) sop-drift-bot sop-tier-bot (SOP Tier-Check Bot) technical-writer (Molecule AI · technical-writer) triage-operator (Molecule AI · triage-operator)
No Assignees
3 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: molecule-ai/molecule-core#424
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?