vscode(feat): Add VS Code extension E2E tests and CI pipeline

.github/copilot-instructions.md

@@ -25,6 +25,24 @@ pnpm run build:lib  # or pnpm turbo run build:lib
 pnpm run build:extension
 ```
 
+### VS Code Extension E2E Tests (ExTester)
+```bash
+# Build + run all phases
+cd apps/vs-code-designer
+npx tsup --config tsup.e2e.test.config.ts
+node src/test/ui/run-e2e.js
+
+# Run specific phases
+$env:E2E_MODE="createonly"     # Phase 4.1: workspace creation
+$env:E2E_MODE="designeronly"   # Phase 4.2: designer lifecycle
+$env:E2E_MODE="newtestsonly"   # Phases 4.3-4.6: new tests
+node src/test/ui/run-e2e.js
+```
+
+**Key knowledge files for E2E tests:**
+- `apps/vs-code-designer/src/test/ui/SKILL.md` — Complete learning document (700+ lines)
+- `apps/vs-code-designer/CLAUDE.md` — Critical rules for writing new tests
+
 ### Testing
 ```bash
 # Run all unit tests
@@ -71,6 +89,16 @@ eslint --cache --fix
 pnpm run check  # or biome check --write .
 ```
 
+**MANDATORY after every edit**: Run `npx biome check --write <files>` before committing.
+Do NOT use `--unsafe` flag — fix unsafe lint errors manually.
+Always verify compilation after changes: `npx tsup --config tsup.e2e.test.config.ts` (for E2E test files).
+
+**Biome rules to follow when writing code** (these cause errors if violated):
+- Use string literals (`'text'`) NOT template literals (`` `text` ``) when there are no interpolations
+- Avoid unnecessary `catch` bindings — use `catch {` not `catch (e) {` when `e` is unused
+- Keep imports organized and remove unused imports
+- Always use block statements with braces — `if (x) { break; }` not `if (x) break;`
+
 ### VS Code Extension
 ```bash
 # Pack VS Code extension

.github/workflows/pr-coverage.yml

@@ -135,6 +135,11 @@ jobs:
             **/webviewCommunication.tsx
             # VS Code React intl files (localization catalog, not unit-test target)
             apps/vs-code-react/src/intl/**
+            # VS Code extension E2E and UI test harness files
+            apps/vs-code-designer/src/test/e2e/**
+            apps/vs-code-designer/src/test/ui/**
+            # Environment-specific utility excluded from coverage policy
+            apps/vs-code-designer/src/app/utils/codeless/getAuthorizationToken.ts
 
       - name: Check coverage on changed files
         id: coverage-check
@@ -189,6 +194,12 @@ jobs:
               continue
             fi
 
+            # Defensive skip for files excluded from the PR coverage gate
+            if [[ "$file" =~ ^apps/vs-code-designer/src/test/(e2e|ui)/ ]] || [ "$file" = "apps/vs-code-designer/src/app/utils/codeless/getAuthorizationToken.ts" ]; then
+              SKIPPED_FILES="$SKIPPED_FILES\n⏭️ \`$file\` - Coverage check excluded by workflow policy"
+              continue
+            fi
+
             # Find the corresponding coverage file for this source file
             # Look in the package's coverage directory
             PKG_DIR=$(echo "$file" | sed 's|/src/.*||')

.github/workflows/vscode-e2e.yml

@@ -0,0 +1,99 @@
+name: VS Code Extension E2E Tests
+
+on:
+  push:
+    branches: [main, dev/*, hotfix/*]
+  pull_request:
+    branches: [main, dev/*, hotfix/*]
+
+concurrency:
+  group: vscode-e2e-${{ github.head_ref || github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  vscode-e2e:
+    timeout-minutes: 90
+    runs-on: ubuntu-latest
+
+    steps:
+      - name: Checkout
+        uses: actions/checkout@v4
+        with:
+          fetch-depth: 0
+
+      - name: Cache turbo build setup
+        uses: actions/cache@v4
+        with:
+          path: .turbo
+          key: ${{ runner.os }}-turbo-${{ github.sha }}
+          restore-keys: |
+            ${{ runner.os }}-turbo-
+
+      - name: Setup Node.js
+        uses: actions/setup-node@v4
+        with:
+          node-version: 20.x
+
+      - name: Setup .NET SDK
+        uses: actions/setup-dotnet@v4
+        with:
+          dotnet-version: '8.0.x'
+
+      - name: Setup pnpm
+        uses: pnpm/action-setup@v3
+        with:
+          version: 9.1.3
+          run_install: |
+            - recursive: true
+              args: [--frozen-lockfile, --strict-peer-dependencies]
+
+      - name: Build extension
+        run: pnpm turbo run build:extension --cache-dir=.turbo
+
+      - name: Compile E2E tests
+        working-directory: apps/vs-code-designer
+        run: npx tsup --config tsup.e2e.test.config.ts
+
+      - name: Install system dependencies for virtual display
+        run: |
+          sudo apt-get update
+          sudo apt-get install -y xvfb libgbm-dev libgtk-3-0 libnss3 libasound2t64 libxss1 libatk-bridge2.0-0 libatk1.0-0
+
+      # Cache the auto-downloaded runtime dependencies (func, dotnet, node)
+      # so subsequent runs don't re-download ~500MB each time.
+      - name: Cache Logic Apps runtime dependencies
+        uses: actions/cache@v4
+        with:
+          path: ~/.azurelogicapps/dependencies
+          key: la-runtime-deps-${{ runner.os }}-v1
+          restore-keys: |
+            la-runtime-deps-${{ runner.os }}-
+          # Save even when tests fail so deps are available on next run
+          save-always: true
+
+      - name: Run VS Code Extension E2E tests
+        run: xvfb-run --auto-servernum --server-args="-screen 0 1920x1080x24" node apps/vs-code-designer/src/test/ui/run-e2e.js
+        env:
+          # Run all phases (4.1 workspace creation through 4.7 smoke tests)
+          E2E_MODE: full
+          # Increase Node memory for CI
+          NODE_OPTIONS: --max-old-space-size=4096
+          # Set TEMP so screenshot paths are predictable on Linux
+          # (process.env.TEMP is undefined on Ubuntu, causing fallback to cwd)
+          TEMP: ${{ runner.temp }}
+
+      # Screenshots are written to $TEMP/test-resources/screenshots/ by both:
+      #   - Explicit test screenshots (e.g., inlineJS-after-request-trigger.png)
+      #   - ExTester auto-failure screenshots (captured on test failure)
+      # Upload ALL screenshots as artifacts so they're available for debugging
+      # after the pipeline finishes, even if the runner is recycled.
+      - name: Upload test screenshots (always)
+        uses: actions/upload-artifact@v4
+        if: always()
+        with:
+          name: vscode-e2e-screenshots
+          path: |
+            ${{ runner.temp }}/test-resources/screenshots/
+            test-resources/screenshots/
+          if-no-files-found: ignore
+          retention-days: 30

.gitignore

@@ -42,8 +42,10 @@ debug.log
 # vscode e2e exTester artifacts
 /apps/vs-code-designer/test-resources
 test-resources
+test-extensions
 /apps/vs-code-designer/out
 /apps/vs-code-designer/*.vsix
+.vscode-test
 
 # System Files
 .DS_Store

CLAUDE.md

@@ -163,6 +163,13 @@ Each app and library has its own CLAUDE.md with specific guidance.
    - `/libs/designer/src/lib/ui/settings/` - Operation settings
    - `/libs/designer/src/lib/core/parsers/` - Workflow parsers
 
+5. **VS Code Extension E2E Tests**:
+   - `/apps/vs-code-designer/src/test/ui/SKILL.md` - Complete test knowledge base (700+ lines)
+   - `/apps/vs-code-designer/src/test/ui/designerHelpers.ts` - Shared designer test helpers
+   - `/apps/vs-code-designer/src/test/ui/runHelpers.ts` - Shared debug/run test helpers
+   - `/apps/vs-code-designer/src/test/ui/run-e2e.js` - Test launcher (7 phases)
+   - `/apps/vs-code-designer/CLAUDE.md` - VS Code extension development guide with E2E test rules
+
 ### Debugging Tips
 
 1. **Standalone Development**: Use `pnpm run start` for rapid development with hot reload