diff --git a/docs/claude-master-design-20260415-atm-trading.md b/docs/claude-master-design-20260415-atm-trading.md deleted file mode 100644 index 6906a43..0000000 --- a/docs/claude-master-design-20260415-atm-trading.md +++ /dev/null @@ -1,149 +0,0 @@ -# Design: ATM — Automated Trading Monitor (M2D Strategy) - -Generated by /office-hours on 2026-04-15 -Branch: master -Repo: /workspace/atm (greenfield) -Status: APPROVED -Mode: Builder (personal live-trading tool, high-stakes) - -## Problem Statement - -User trades the M2D strategy on DIA (TradeStation chart with custom indicator) with execution on TradeLocker US30 CFD (prop firm account). Same strategy also applies to GLD → XAUUSD. Bridging signal source (TradeStation Windows app) with execution (TradeLocker web) currently requires user to watch both screens for 4 hours per evening. Goal: bot detects the trigger signal automatically and notifies user via Telegram/Discord with chart screenshot + SL/TP levels so user can execute the trade in TradeLocker. - -## Strategy M2D — Full Spec - -**Setup:** TradeStation, 3-minute chart, DIA (or GLD) symbol, custom indicator "M2D MAPS" that renders a horizontal strip of colored dots below the price panel. Dots are indexed by time, y-position is fixed. - -### BUY sequence (sequential in time, rightmost N dots): -1. **Turquoise dot** — 15-minute buy trigger -2. **Dark green dot** — 3-minute sell -3. **Light green dot** — 3-minute buy → **TRIGGER** - -At trigger: -- Execute BUY on TradeLocker, instrument US30 CFD -- Stop Loss 0.6% -- Volume 0.1 lots maximum -- TP1, TP2, SL are drawn automatically as horizontal lines on the TradeStation chart after entry -- User manual lifecycle: at TP1 close half, move SL to ~breakeven; at TP2 close remaining half - -### SELL sequence (mirror): -1. **Yellow dot** — 15-minute sell (red 15min candle) -2. **Dark red dot** — 3-minute buy -3. **Light red dot** — 3-minute sell → **TRIGGER** - -Same size (0.1 lots), same SL %, same TP management. - -### Instrument mapping (intentional asymmetry): -- DIA chart (TradeStation) ↔ US30 CFD (TradeLocker) -- GLD chart (TradeStation) ↔ XAUUSD CFD (TradeLocker) - -### Trading window: -- NY open first 2 hours + NY close last 2 hours -- RO summer time: 16:30-18:30 and 21:00-23:00 -- Typical frequency: 1 trade per evening - -## Constraints - -- **Prop firm account on TradeLocker.** Faza 2 (auto-execution) requires reading prop TOS first — many prop firms prohibit automation or detect robotic timing patterns. -- No API on TradeLocker. No signal export on TradeStation for compiled custom indicator. -- Bot runs on the same Windows machine as TradeStation. Cross-machine (RDP/VNC) screenshot adds latency and fragility. - -## Premises (agreed) - -1. Screenshot + visual detection is the only viable bridge. -2. Notification-first (Faza 1) is the right sequencing. Zero-click MVP removes all financial bug risk. -3. M2D MAPS dot strip has stable y-position on fixed TradeStation layout → ROI color sampling is the right detection method. -4. DIA→US30 price divergence is acceptable risk (user's judgment, has been trading this pairing live). -5. Bot runs on the same Windows machine as TradeStation. - -## Recommended Approach — B: Structured Service with Dry-Run and Audit Log - -Python package on Windows, structured for clean extension to Faza 2. - -### Components: -- **Detector core:** `mss` screenshot of TradeStation window (located by title via `pygetwindow`) → crop M2D MAPS ROI → scan rightmost N dot positions → classify each by closest-color match with tolerance → feed into state machine that tracks 3-dot sequences (turquoise→dark-green→light-green = BUY trigger; yellow→dark-red→light-red = SELL trigger). -- **Level extractor:** after trigger, scan chart region for horizontal colored lines (SL/TP1/TP2). Convert pixel y to price via calibration of y-axis scale. -- **Calibration tool (Tkinter):** interactive — user clicks on each dot color sample, captures RGB + tolerance, clicks on ROI corners, captures y-axis price references. Writes to `config.toml`. -- **Dry-run mode:** runs detector against a folder of saved screenshots (recorded during normal operation). Shows what notification WOULD have been sent for each. Used to validate new color thresholds or strategy tweaks without live risk. -- **Notifier abstraction:** interface with Discord webhook and Telegram bot implementations. Sends: annotated screenshot + decoded SL/TP1/TP2 prices + signal type (BUY/SELL) + timestamp. -- **Audit log (JSONL):** every detection cycle — timestamp, detected dots, classification, decision, notification sent y/n. Replayable, debuggable. -- **Scheduler:** Windows Task Scheduler entry, auto-start/stop at 16:30 / 18:30 / 21:00 / 23:00 local time (summer/winter offset aware). - -### Structure: -``` -atm/ -├── pyproject.toml -├── config.toml # populated by calibration tool -├── src/atm/ -│ ├── detector.py # screenshot + color classification + state machine -│ ├── levels.py # SL/TP1/TP2 pixel-to-price extraction -│ ├── notifier/ -│ │ ├── __init__.py # abstract Notifier -│ │ ├── discord.py -│ │ └── telegram.py -│ ├── audit.py # JSONL logger -│ ├── calibrate.py # Tkinter UI -│ ├── dryrun.py # replay on saved screenshots -│ └── main.py # orchestration + scheduler hooks -├── samples/ # saved screenshots for dry-run corpus -└── logs/ # JSONL audit -``` - -### Detection algorithm (core loop): -1. Every 1 second during trading window: - - Locate TradeStation window - - If not foreground or minimized, log + skip - - Screenshot M2D MAPS ROI (fixed offsets from window bounds) - - For rightmost N=5 dot positions, sample center pixel, classify to nearest labeled color within tolerance - - Update rolling window of last 10 dots with their timestamps - - Evaluate state machine: did the last 3 classified dots (within a bounded time window) complete a BUY or SELL sequence? - - If trigger fired AND not already fired for this bar: extract SL/TP1/TP2 levels, send notification, log, mark fired. - -### Anti-duplicate logic: -- Each trigger dot is keyed by (x-pixel position at capture, color). Once fired, stored in "recently fired" set with 10-minute TTL. Prevents re-fire if same dot persists across cycles. - -### Sanity guards: -- If classification confidence (color distance) low for 3+ cycles in a row → push "bot lost sight" alert to user. Layout may have changed. -- If TradeStation window not found for 60 seconds → push "bot cannot find chart" alert. - -## Open Questions (non-blocking) - -- Exact color tolerance values — determined during calibration session, not a design question. -- GLD/XAUUSD: same M2D indicator on GLD chart? Assume yes, confirm during calibration. -- Multi-symbol monitoring — single window switched manually, or two TradeStation windows side by side? Defer; v1 = single chart at a time, user switches manually. - -## Success Criteria (Faza 1) - -- Over 20 live trading sessions, bot detects ≥95% of signals user also spotted manually. -- Zero false-positive notifications during the bot's first 5 sessions (tune tolerances aggressively). -- Notification delivered within 3 seconds of trigger dot appearing. -- Audit log lets user reproduce "why was no notification sent" for any missed signal. - -## Distribution Plan - -Personal tool, single user. No distribution channel needed — runs locally on user's Windows box. Git repo at `/workspace/atm`. `pyproject.toml` + `pip install -e .` for local dev. No CI/CD; user's own `scheduled task` starts/stops it. - -## Risk Flag — Faza 2 (deferred) - -Before extending to auto-execution in TradeLocker: -1. Read prop firm TOS (search for "EA", "automation", "bot", "copy trading", "external signal"). If prohibited, **Faza 2 is off the table** — tool stays notification-only. -2. If permitted, implement via Playwright browser automation against TradeLocker web UI. -3. Add human-like click timing randomization (100-400ms jitter) to avoid robotic detection. -4. Dry-run mode then becomes: "click coordinates resolved, action NOT sent" — user reviews the intended click before enabling live. - -## Next Steps (concrete) - -1. Init `/workspace/atm` as Python project. `pyproject.toml`, basic structure. -2. Build calibration tool first. Without calibrated config, nothing works. -3. Record 20-30 sample screenshots across several trading sessions (can start this today — doesn't need any code yet; just `mss` screenshot on a 5-second timer dumping to disk). -4. Build detector + state machine. Validate against recorded screenshots in dry-run mode. -5. Wire Discord webhook first (simpler than Telegram bot). Test end-to-end on live session. -6. Add audit log. -7. Schedule Windows task for trading hours. - -## What I noticed about how you think - -- You explicitly asked for dry-run before writing a line of code. "Să verific dacă vrea să apese corect, fără să apese efectiv." That's not a common instinct for someone building their own tool; it's the instinct of someone who has already had something break expensively. -- You phased the project yourself — "faza 2 după ce mă conving că merge." That's the right ordering and you arrived at it unprompted. -- When I challenged the API premise, you answered with specifics: the indicator is custom, the account doesn't support API. You knew the constraint, not guessed it. -- You flagged the prop account almost casually at the end. A lot of builders would have skipped that detail. It turned out to be the most important constraint in the entire design. diff --git a/docs/happy-swinging-mccarthy.md b/docs/happy-swinging-mccarthy.md deleted file mode 100644 index 1d31520..0000000 --- a/docs/happy-swinging-mccarthy.md +++ /dev/null @@ -1,43 +0,0 @@ -# Plan: ATM Eng Review — Findings Applied - -## Context - -User ran `/plan-eng-review` on `partitioned-honking-unicorn.md` (ATM trading monitor, Faza 1). Eng review complete. All 4 decisions resolved, obvious fixes applied, plan file updated in place. - -## Where the changes live - -The reviewed plan (with all eng-review edits) is at: -**`/home/claude/.claude/plans/partitioned-honking-unicorn.md`** - -Test plan artifact at: -**`~/.gstack/projects/romfast-workspace/claude-master-eng-review-test-plan-20260415-212932.md`** - -## What changed in the reviewed plan - -### 4 decisions (AskUserQuestion) -1. **Bar flicker** → debounce depth=1 (configurable); screenshot in alert = visual check. -2. **Phase A entry price** → dropped; Phase A is direction + screenshot only; user puts manual 0.6% SL in TradeLocker; Phase B sends real levels from chart. -3. **Notifier blocking** → fire-and-forget worker threads per backend, bounded queue, retry + dead-letter. -4. **Alert SPoF** → Discord + Telegram parallel from day 1. - -### Obvious fixes (stated, applied) -- Exhaustive state transition table (default-noise rule, SELL mirror explicit, phase-skip handling). -- Python 3.11+ pin → drop `tomli`, use stdlib `tomllib`. -- Windows symlink replaced by `configs/current.txt` marker file. -- New `vision.py` shared module (ROI/hash/interp/Hough). -- `@dataclass Config` with load-time validation. -- DPI check added to calibrate + README note. - -### Test coverage -Expanded from state-machine-only to: every module + 1 E2E replay harness. Acceptance gate unchanged (precision=100%, recall≥95% on labeled corpus). - -## Verification (post-implementation) - -Run the full verification checklist from `partitioned-honking-unicorn.md` (sections 1-9). Specifically: -- `pytest tests/` — all new unit tests + E2E replay pass. -- `atm dryrun ./samples` hits acceptance gate. -- Live 2-session test: both Discord and Telegram fire; kill one mid-session and confirm the other still delivers + dead-letter file gets the failed alert. - -## Status - -**CEO + ENG CLEARED.** No further reviews required before implementation. Design + DX reviews properly skipped (no UI scope; personal single-user tool). Run `/ship` after implementation. diff --git a/docs/image.png b/docs/image.png deleted file mode 100644 index be291ad..0000000 Binary files a/docs/image.png and /dev/null differ diff --git a/docs/partitioned-honking-unicorn.md b/docs/partitioned-honking-unicorn.md deleted file mode 100644 index b2eca75..0000000 --- a/docs/partitioned-honking-unicorn.md +++ /dev/null @@ -1,258 +0,0 @@ -# Plan: ATM — Automated Trading Monitor (M2D, Faza 1) — ENG-REVIEWED - -**Source plan:** `/home/claude/.claude/plans/swirling-drifting-starfish.md` -**CEO plan artifact:** `~/.gstack/projects/romfast-workspace/ceo-plans/2026-04-15-atm-trading.md` -**Eng review mode:** FULL_REVIEW (4 decisions made, 0 unresolved) -**Design doc:** `~/.gstack/projects/romfast-workspace/claude-master-design-20260415-atm-trading.md` (APPROVED) -**Eng test plan:** `~/.gstack/projects/romfast-workspace/claude-master-eng-review-test-plan-20260415-212932.md` - ---- - -## Context - -User trades M2D strategy manually on DIA (TradeStation) with execution on TradeLocker US30 CFD (prop firm). Same strategy on GLD → XAUUSD. 4h/evening dual-screen monitoring. Faza 1 goal: bot auto-detects M2D trigger, sends Discord/Telegram notification with screenshot + SL/TP1/TP2 levels; user executes manually in TradeLocker. Faza 2 (auto-execution) deferred until prop firm TOS verified and Faza 1 proven over 20+ sessions. - -**Review changed two things from the original plan:** -1. **State machine spec corrected.** Original "last 3 consecutive non-gray dots" is wrong. Actual M2D is phased: Phase 1 arming (turquoise → gray/dark-green) → Phase 2 trigger (light-green). -2. **Levels extraction corrected.** Original plan had levels.py extracting SL/TP at trigger. But those lines only appear on TradeStation chart *after* user enters trade in TradeLocker. Corrected to two-phase: spec-math at trigger, chart-scan after entry. - -Plus 5 accepted expansions (labeled corpus, level fallback, layout canary, trade journal, TOS checklist). - ---- - -## Approach: B (Structured Python service, dry-run, audit log) + CEO-reviewed additions - -Runs on Windows machine alongside TradeStation. `mss` screenshots → ROI color-sample on M2D MAPS strip → phased state machine → Discord webhook + Telegram bot → JSONL audit + trade journal → dry-run replay against labeled corpus. - ---- - -## State Machine Spec (corrected + exhaustive) - -States: -- `IDLE` -- `ARMED_BUY` — turquoise seen -- `PRIMED_BUY` — turquoise + at least one dark-green seen -- `ARMED_SELL` — yellow seen -- `PRIMED_SELL` — yellow + at least one dark-red seen - -**Default rule:** any (state, event) pair not listed below → stay in current state, no action, log as `noise`. - -Transitions — BUY side: - -| From | Event | To | Action | -|------|-------|-----|--------| -| IDLE | turquoise | ARMED_BUY | log arm_ts | -| IDLE | yellow | ARMED_SELL | log arm_ts (sell) | -| IDLE | dark-green / dark-red / light-green / light-red / gray | IDLE | noise (log phase-skip if light-green/light-red) | -| ARMED_BUY | gray | ARMED_BUY | persist | -| ARMED_BUY | turquoise | ARMED_BUY | refresh arm_ts | -| ARMED_BUY | dark-green | PRIMED_BUY | log prime_ts | -| ARMED_BUY | yellow | ARMED_SELL | opposite rearm | -| ARMED_BUY | dark-red | ARMED_BUY | ignore (minority noise) | -| ARMED_BUY | light-green | IDLE | **skip detected** — no FIRE, log phase_skip | -| ARMED_BUY | light-red | IDLE | skip detected, log | -| PRIMED_BUY | dark-green | PRIMED_BUY | accumulate | -| PRIMED_BUY | dark-red | PRIMED_BUY | ignore (minority noise) | -| PRIMED_BUY | **light-green** | IDLE | **FIRE BUY**, lockout(BUY)=4min | -| PRIMED_BUY | light-red | IDLE | skip detected (wrong trigger) | -| PRIMED_BUY | gray | IDLE | **COOLED** — signal dead, log | -| PRIMED_BUY | turquoise | ARMED_BUY | rearm fresh | -| PRIMED_BUY | yellow | ARMED_SELL | opposite rearm | - -SELL side mirrors exactly: swap turquoise↔yellow, dark-green↔dark-red, light-green↔light-red, BUY↔SELL. - -Notes: -- No time-based TTL on ARMED/PRIMED. State persists until trigger fires, cooled by gray after PRIMED, opposite-color rearm, or process restart (Windows Task Scheduler stops bot at session end → natural session-boundary reset). -- Cooling rule: "gray after dark-green" = signal racit (user's term). Gray during ARMED_BUY (before any dark-green) is OK. -- After FIRE: 4-minute lockout per-direction. BUY lockout doesn't block SELL and vice versa. Single timestamp per direction. -- Opposite-color-Phase-1 triggers rearm to opposite side (captures direction flip). -- Phase-skip (arming color → trigger color with no phase-2 step) → IDLE, no FIRE, logged. Would be legitimate only if indicator collapses phases, which it doesn't per observed behavior. - ---- - -## Detection Details - -- **Loop interval:** 5 seconds (36 cycles per 3-min bar; stays well inside notification-latency target). -- **Rightmost-dot detection:** scan ROI from right edge leftward, find first non-background pixel cluster → that's the rightmost dot. Don't hardcode x-pixel positions (chart scrolls; hardcoded positions drift). -- **Debounce:** configurable `debounce_depth` in config.toml (default `1` — single-read acceptance). Increase if future sessions show mid-bar color flicker. Screenshot-in-notification is the user's visual verification on top. -- **Rolling window:** keep last 20 classified dots with their detection timestamps. State machine consumes the newest *accepted* (post-debounce) dot per cycle. -- **Classification:** nearest-color match in RGB Euclidean distance, per-color tolerance from calibration. Report confidence = `1 - distance_nearest / distance_second_nearest`. Log confidence every cycle. If all distances > tolerance → `UNKNOWN`, state unchanged. - ---- - -## Levels Extraction (two-phase, simplified) - -**Phase A — at trigger (immediate alert to Discord + Telegram):** -- No entry-price compute. No spec-math SL/TP. User places a manual 0.6% SL in TradeLocker at entry; actual TP1/TP2/SL come in Phase B from the chart. -- Notification: `🟢 BUY signal DIA→US30 | 22:47:03` + annotated screenshot (detected dot highlighted). - -**Phase B — after user trades (chart-scan confirmation):** -- After Phase A fires, detector keeps watching the chart ROI for horizontal colored lines (red=SL, green=TP1/TP2). -- When lines appear (user has entered trade in TradeLocker and TradeStation drew them) → scan y-pixels via Hough + color mask, convert via y-axis calibration → send second alert to both channels: `✅ Levels: SL=484.35 | TP1=485.20 | TP2=485.88`. -- If chart-line scan times out (no lines in 10 min) → silent (user didn't trade). -- If only 2 lines detected (user didn't set TP2 or line not rendered yet) → partial-result alert. -- Phase B overlap with next signal: guarded by per-direction lockout + Phase-B completion flag; a new FIRE cannot issue until prior Phase B closes (timeout or success). - ---- - -## Dedup / Lockout - -- Time-based lockout: after any FIRE, block re-fire for 4 minutes (one 3-min bar + 1 min safety). -- Tracked per-direction: BUY lockout doesn't block SELL. -- Stored as single timestamp per direction (not pixel-keyed). - ---- - -## Observability - -- **Heartbeat:** every 30 min to a separate Discord thread (not main alerts channel): `🟢 22:00 alive | 0 triggers | confidence avg 0.85 | chart OK`. Silence >35 min = watchdog concern (user notices). -- **Layout canary:** every 60 cycles (5 min), hash a stable reference region (axis labels, chart border). Stored baseline in config. On significant divergence (>threshold) → `⚠️ Layout changed — auto-paused, recalibrate` to alerts channel. Bot pauses detection until operator acknowledges (touch a pause-file or restart). -- **Low-confidence alert:** 3+ consecutive cycles with confidence below threshold → `⚠️ Bot lost sight` (already in original plan). -- **Window-lost alert:** TradeStation window not found for 60s → `⚠️ Cannot find chart`. -- **Audit JSONL:** per-cycle, daily rotation (`logs/YYYY-MM-DD.jsonl`), fields: `{ts, window_found, roi_ok, rightmost_dot_color, confidence, state, transition, trigger, notified, reason}`. - ---- - -## Files to Create - -- `/workspace/atm/pyproject.toml` — Python 3.11+ required. Deps: `mss`, `opencv-python`, `numpy`, `requests`, `pygetwindow`, `pywin32` (DPI + window capture), `rich` (CLI), `pillow` (screenshot annotation). **No `tomli` — use stdlib `tomllib`.** -- `/workspace/atm/config.toml` — populated by calibration tool (ROI coords, per-color RGB + tolerance, `debounce_depth`, y-axis scale, canary-region baseline hash, Discord webhook URL, Telegram bot token + chat_id) -- `/workspace/atm/src/atm/config.py` — **[ENG-REVIEW]** `@dataclass Config` with `Config.load(path)` that validates on load (RGB tuples, positive tolerances, both notifier credentials present, y-axis 2-point pair). Fail fast at startup. -- `/workspace/atm/src/atm/vision.py` — **[ENG-REVIEW]** shared primitives: ROI crop, perceptual hash, pixel-to-price linear interp, Hough line detection with color mask. Used by detector/canary/levels to avoid drift. -- `/workspace/atm/src/atm/detector.py` — screenshot loop, rightmost-dot scan, color classification, rolling window, debounce -- `/workspace/atm/src/atm/state_machine.py` — explicit phased state machine (spec above), exhaustive transition table -- `/workspace/atm/src/atm/levels.py` — Phase B chart-scan only (Phase A entry-price compute removed after ENG-REVIEW) -- `/workspace/atm/src/atm/canary.py` — layout fingerprint hash + drift check + auto-pause -- `/workspace/atm/src/atm/notifier/__init__.py` — abstract `Notifier` protocol: `send_alert()`, `send_heartbeat()`, `send_levels_confirm()` -- `/workspace/atm/src/atm/notifier/fanout.py` — **[ENG-REVIEW]** `FanoutNotifier` wraps N backends, each with its own worker thread + bounded queue (size 50, drop-oldest on overflow) + retry with exponential backoff + dead-letter file on total failure. Main loop never blocks. -- `/workspace/atm/src/atm/notifier/discord.py` — webhook POST, annotated screenshot upload (multipart) -- `/workspace/atm/src/atm/notifier/telegram.py` — **[ENG-REVIEW]** built in parallel with Discord (no longer deferred); bot API, photo upload -- `/workspace/atm/src/atm/audit.py` — JSONL logger with daily local-midnight rotation, line-buffered write for crash safety -- `/workspace/atm/src/atm/calibrate.py` — Tkinter: window pick → DPI check → ROI corners → per-color sample → y-axis scale → canary region → save versioned config -- `/workspace/atm/src/atm/labeler.py` — **[EXPANSION]** Tkinter label UI → `labels.json` -- `/workspace/atm/src/atm/dryrun.py` — replay with precision/recall/confusion matrix when labels present -- `/workspace/atm/src/atm/journal.py` — **[EXPANSION]** `atm journal` CLI → `trades.jsonl` -- `/workspace/atm/src/atm/report.py` — **[EXPANSION]** weekly aggregation -- `/workspace/atm/src/atm/main.py` — CLI: `atm calibrate`, `atm label `, `atm dryrun `, `atm run [--duration Xh]`, `atm journal`, `atm report [--week YYYY-WW]` -- `/workspace/atm/tests/` — **[ENG-REVIEW]** unit + E2E per test plan at `~/.gstack/projects/romfast-workspace/claude-master-eng-review-test-plan-20260415-212932.md` -- `/workspace/atm/samples/`, `/workspace/atm/logs/` -- `/workspace/atm/configs/` — versioned config archive. **[ENG-REVIEW]** No symlink (Windows admin-required); use `configs/current.txt` marker file storing the active filename. `Config.load()` reads the marker. -- `/workspace/atm/docs/phase2-prop-firm-audit.md` — structured TOS checklist -- `/workspace/atm/README.md` — setup, calibration workflow, per-session operating checklist, DPI/multi-monitor notes - ---- - -## Build Order - -1. **`pyproject.toml` + package scaffold** — Python 3.11+, `pip install -e .`, `atm --help` works. -2. **Standalone screenshot-dump script** — `mss` timer dumps to `samples/` every 5s during trading sessions. Build corpus in parallel. -3. **`config.py` + `vision.py`** — Config dataclass with validation; shared vision primitives. Ship with unit tests for config load + pixel-to-price interp. -4. **`calibrate.py`** — versioned config in `configs/YYYY-MM-DD-HHMM.toml`; `configs/current.txt` marker file points at active. DPI check + canary region capture. -5. **`labeler.py`** — once ~30 samples exist, tag them. `labels.json` is ground truth. -6. **`state_machine.py`** + **unit tests** (clean BUY, clean SELL, cooling, opposite-rearm, lockout per-direction, noise, phase-skip, all state×color pairs via parameterized test). -7. **`detector.py`** + **unit tests** (empty/background ROI, rightmost-cluster, rolling window FIFO, debounce depth=1, classification edges including UNKNOWN). -8. **`canary.py`** + **unit tests** (drift threshold, pause-file gating). -9. **`levels.py`** (Phase B only) + **unit tests** (Hough line detection with color mask, 2 vs 3 lines, 10-min timeout, pixel-to-price roundtrip). -10. **`notifier/fanout.py` + `discord.py` + `telegram.py`** + **unit tests** (queue overflow drop-oldest, 429 backoff, dead-letter on total failure, fanout: one backend down still delivers). Both channels built in parallel — fire together from day 1. -11. **`audit.py`** + **unit tests** (daily rotation at local midnight, line-buffered flush crash safety). -12. **`dryrun.py`** — replay on `samples/` against `labels.json`. **Acceptance gate before live: precision = 100%, recall ≥ 95%.** -13. **E2E replay test** — feed `samples/` through detector → state_machine → notifier-mock → in-memory audit; assert labels match FIREs. -14. **`journal.py`**, **`report.py`**, **`main.py`** (unified CLI). -15. **Windows Task Scheduler setup** — 16:30→18:30, 21:00→23:00. `atm run --duration 2h`. Manual DST check twice yearly. -16. **`docs/phase2-prop-firm-audit.md`** — TOS checklist template. - ---- - -## Existing Utilities to Reuse - -Greenfield Python project. No internal utilities. External libs: `mss` (screenshot), `pygetwindow` (window locate), `opencv-python` (line detection in Phase B), `numpy` (color math), `requests` (Discord webhook), `tomli` (config parsing), `pillow` (annotated screenshots). - ---- - -## Verification - -End-to-end, in build order: - -1. **State machine unit tests:** `pytest tests/test_state_machine.py` — all scenarios (clean BUY, clean SELL, cooling, rearm, lockout, noise) pass. -2. **Calibration:** `atm calibrate` → step through → `config.toml` populated with plausible RGBs for described colors + y-axis scale sane + canary region picked. -3. **Labeled corpus:** ≥30 screenshots in `samples/`, `atm label ./samples` tags each. -4. **Dry-run with metrics:** `atm dryrun ./samples` → precision + recall + confusion matrix printed. **Acceptance gate:** precision = 100%, recall ≥ 95%. If not met → tune tolerances, re-run. -5. **Live test notification-only (2 sessions):** `atm run`. Verify: - - Discord + Telegram notifications within 5s of trigger, both channels receive. - - Phase A message: direction + timestamp + annotated screenshot. - - Phase B levels-alert fires once TradeStation draws SL/TP lines; correct SL/TP1/TP2 prices. - - Heartbeat messages every 30 min in thread. - - Audit JSONL complete, state transitions visible. - - Kill one notifier (e.g. wrong token) → other still delivers, dead-letter file for failed one. -6. **Canary test:** manually move TradeStation window during session → layout-changed alert within 5 min. Move back → restart bot → resumes. -7. **Scheduler test:** Windows Task Scheduler starts bot at 16:30, stops at 18:30 cleanly, log rotates at midnight. -8. **Journal test:** after real trade, `atm journal` → prompt flow complete → `trades.jsonl` entry present. -9. **Report test:** after 1 week of live use, `atm report --week 2026-16` → precision per color, slippage distribution, P&L summary. - ---- - -## Risk Register - -- **Prop firm TOS (Faza 2 blocker):** read TOS using `docs/phase2-prop-firm-audit.md` checklist before any auto-execution work. If EA/automation prohibited → Faza 2 dead, stay on Faza 1 permanently. -- **TradeStation layout change:** canary catches it within 5 min → auto-pause. Recalibrate. Losing a session to a layout change is acceptable cost. -- **Calibration drift over time:** versioned configs in `configs/` let you roll back to last-known-good if new calibration misfires. -- **DIA↔US30 price divergence:** accepted (user's judgment). Phase 1 journal captures slippage per signal, feeding Faza 2 go/no-go. -- **Screen sharing / RDP during trading:** overlay can break classification. Low prob, documented in README as operator hygiene. -- **Windows Task Scheduler DST transitions:** twice per year, schedule may misfire. Manual check first week of each DST change. - ---- - -## Out of Scope (Faza 1) - -- Any automated click in TradeLocker (Faza 2 work) -- Multi-symbol concurrent monitoring (single chart at a time; user switches manually between DIA and GLD) -- Backtesting on historical data (strategy already manually validated) -- Web UI / dashboard (headless + Discord/Telegram only) -- Ack feedback loop (react-on-notification labeling) — deferred to TODOS.md as `P2-ack-loop`: shipping baseline first, adding feedback once detection quality verified -- Telegram notifier — built only after Discord is stable 5+ sessions - ---- - -## Accepted Expansions (CEO review, SELECTIVE mode) - -1. ✅ **Labeled sample corpus + dry-run metrics** — `labeler.py`, `labels.json`, automated precision/recall in dryrun. Makes acceptance criteria ("false-positives = 0, false-negatives ≤ 5%") machine-checkable. -2. ✅ **Level-extractor fallback (spec-math)** — Phase A always uses spec-math; Phase B validates against chart. Redundancy on fragile piece. -3. ✅ **Layout canary + auto-pause** — `canary.py` hashes stable UI region, auto-pauses on drift. Catches silent classification-with-wrong-positions failure mode. -4. ✅ **Trade journal CLI** — `atm journal` + `trades.jsonl` + weekly report. Data for Faza 2 go/no-go decision. -5. ✅ **Prop-firm TOS audit checklist** — `docs/phase2-prop-firm-audit.md`. Structured Faza 2 evaluation framework shipped now. - -## Deferred to TODOS.md - -- **Ack feedback loop** — Discord reaction emojis feeding precision tuning. High value, operationally heavier (bot vs webhook). Add after Faza 1 baseline stable. - ---- - -## GSTACK REVIEW REPORT - -| Review | Trigger | Why | Runs | Status | Findings | -|--------|---------|-----|------|--------|----------| -| CEO Review | `/plan-ceo-review` | Scope & strategy | 1 | CLEAR (SELECTIVE EXPANSION) | 6 proposals, 5 accepted, 1 deferred; 2 arch corrections | -| Codex Review | `/codex review` | Independent 2nd opinion | 0 | — | — | -| Eng Review | `/plan-eng-review` | Architecture & tests (required) | 1 | CLEAR (FULL_REVIEW) | 9 issues found, 0 critical gaps; 4 decisions made, 0 unresolved | -| Design Review | `/plan-design-review` | UI/UX gaps | 0 | — | SKIPPED (no UI scope — CLI + Discord/Telegram) | -| DX Review | `/plan-devex-review` | Developer experience gaps | 0 | — | SKIPPED (personal tool, single user) | - -**UNRESOLVED:** 0 - -**ENG REVIEW DECISIONS:** -1. **Bar flicker** → debounce depth=1 (configurable), rely on screenshot-in-notification for visual verification. -2. **Phase A entry price** → dropped. User places manual 0.6% SL in TradeLocker at entry. Phase A = direction + screenshot only. Phase B = real SL/TP1/TP2 from chart. -3. **Notifier blocking** → fire-and-forget worker threads per backend, bounded queue (size 50, drop-oldest), retry w/ backoff, dead-letter on total failure. -4. **Alert SPoF** → Discord + Telegram built in parallel from day 1, both fire together. - -**ENG REVIEW OBVIOUS FIXES (stated, no decision):** -- Exhaustive state transition table (all state×color pairs, default-noise rule, SELL mirror explicit). -- Python 3.11+ pin, drop `tomli` dep, use stdlib `tomllib`. -- Windows symlink → `configs/current.txt` marker file. -- Shared `vision.py` module (ROI, hash, interp, Hough). -- `@dataclass Config` with fail-fast load-time validation. -- DPI check + multi-monitor note in calibrate + README. - -**ENG REVIEW TEST SCOPE (accepted: FULL):** unit tests for every module (state_machine, detector, levels Phase B, canary, audit, notifier fanout/retry, calibrate roundtrip, config validate) + 1 E2E replay harness asserting labeled-corpus precision/recall. Test plan artifact: `~/.gstack/projects/romfast-workspace/claude-master-eng-review-test-plan-20260415-212932.md`. - -**VERDICT:** CEO + ENG CLEARED — ready to implement. Run `/ship` after implementation. No further reviews required before build. diff --git a/docs/swirling-drifting-starfish.md b/docs/swirling-drifting-starfish.md deleted file mode 100644 index 08b5643..0000000 --- a/docs/swirling-drifting-starfish.md +++ /dev/null @@ -1,74 +0,0 @@ -# Plan: ATM — Automated Trading Monitor (M2D, Faza 1) - -## Context - -User tranzacționează manual strategia M2D pe DIA (TradeStation) cu execuție pe TradeLocker US30 CFD (cont prop firm). Aceeași strategie merge și pe GLD → XAUUSD. 4 ore/seară trebuie să urmărească 2 ecrane. Obiectiv Faza 1: bot detectează automat trigger-ul și trimite notificare Telegram/Discord cu screenshot + nivele SL/TP1/TP2, user execută manual în TradeLocker. Faza 2 (auto-execution) deferată până prop firm TOS verificat + Faza 1 dovedită. - -Design doc complet salvat la `~/.gstack/projects/romfast-workspace/claude-master-design-20260415-atm-trading.md` (include strategia M2D cu toate detaliile). - -## Approach: B — Structured Python service + dry-run + audit log - -Rulează pe aceeași mașină Windows cu TradeStation. ROI color sampling pe strip-ul M2D MAPS, state machine pentru secvența 3-dot, notifier abstraction (Discord/Telegram), calibration Tkinter, dry-run pe screenshot-uri salvate. - -## Files to Create - -- `/workspace/atm/pyproject.toml` — packaging, deps: `mss`, `opencv-python`, `numpy`, `requests`, `pygetwindow`, `tomli` -- `/workspace/atm/config.toml` — populat de calibration tool (ROI coords, culori referință + toleranțe, y-axis scale) -- `/workspace/atm/src/atm/detector.py` — screenshot loop + color classification + state machine 3-dot -- `/workspace/atm/src/atm/levels.py` — extragere SL/TP1/TP2 din liniile orizontale (pixel y → preț) -- `/workspace/atm/src/atm/notifier/__init__.py` — interface `Notifier.send(signal, screenshot, levels)` -- `/workspace/atm/src/atm/notifier/discord.py` — webhook POST -- `/workspace/atm/src/atm/notifier/telegram.py` — bot API -- `/workspace/atm/src/atm/audit.py` — JSONL logger, fiecare ciclu -- `/workspace/atm/src/atm/calibrate.py` — Tkinter UI: click pe dot → capture RGB + tolerance; click pe colț ROI → salvează; click pe 2 puncte pe axa Y cu prețurile → calibrare scale -- `/workspace/atm/src/atm/dryrun.py` — replay detector pe folder de screenshot-uri -- `/workspace/atm/src/atm/main.py` — orchestration, CLI (`atm run`, `atm calibrate`, `atm dryrun `) -- `/workspace/atm/samples/` — director screenshot-uri pentru dry-run corpus -- `/workspace/atm/logs/` — director JSONL audit -- `/workspace/atm/README.md` — setup + calibration workflow - -## Build Order - -1. **`pyproject.toml` + scaffold package** — `pip install -e .`, `atm --help` funcționează. -2. **Script standalone de capture samples** (înainte de orice logică) — rulezi în timpul următoarelor sesiuni trading, dump screenshot la 5s interval în `samples/`. Ai corpus pentru dry-run. -3. **`calibrate.py`** — fără config calibrat, nimic nu merge. Tkinter cu: pas 1 (select TradeStation window by title), pas 2 (click pe colțuri ROI M2D MAPS), pas 3 (click pe fiecare culoare: turquoise, verde închis, verde deschis, galben, roșu închis, roșu deschis + gri neutru; capturează RGB + rază de toleranță implicită 20), pas 4 (2 click-uri pe axa Y + valori preț introduse → scale factor pixel→preț). Salvează `config.toml`. -4. **`detector.py`** — loop 1s: locate window, screenshot ROI, sample rightmost 5 dots pe pozițiile calibrate, clasifică fiecare la cea mai apropiată culoare (Euclidean in RGB cu toleranță). Rolling window ultimele 10 clasificări + timestamp. State machine: ultimele 3 non-gri consecutive = secvență BUY sau SELL? Fire o dată pe trigger (dedup set cu TTL 10min). -5. **`levels.py`** — după trigger, scan chart region pentru liniile orizontale roșii (SL) și verzi (TP1/TP2). Extrage y-pixel al fiecărei linii, convertește la preț folosind scale-ul calibrat. -6. **`notifier/discord.py`** — POST multipart cu screenshot adnotat + mesaj formatat: `🟢 BUY DIA→US30 | SL: 484.35 | TP1: 485.20 | TP2: 485.90 | 22:47:03`. -7. **`dryrun.py`** — iterează `samples/`, rulează detector, printează ce AR fi trimis. Validare logică detecție înainte de live. -8. **`audit.py`** — wrap detector loop, scrie JSONL: `{ts, window_found, roi_ok, dots:[...], classification:[...], trigger:null|"BUY"|"SELL", notified:true|false, reason}`. -9. **`main.py`** — CLI unificat. `atm calibrate`, `atm dryrun ./samples`, `atm run` (loop live cu audit). -10. **Windows Task Scheduler** — 2 task-uri: start 16:30 (stop 18:30), start 21:00 (stop 23:00). `atm run --duration 2h`. -11. **`notifier/telegram.py`** — opțional după ce Discord e stabil. - -## Existing Utilities to Reuse - -N/A — greenfield project. No internal utilities to reuse. - -## Verification - -End-to-end, în ordinea din build: - -1. **Calibration workflow:** `atm calibrate` → urmezi pașii → rezultă `config.toml` complet. Verifică manual că RGB-urile sunt plauzibile pentru culorile descrise. -2. **Dry-run corpus:** ai ≥20 screenshot-uri din sesiuni reale în `samples/`. Rulezi `atm dryrun ./samples` → output per screenshot: clasificare + decizie trigger. Manual verifici că cazurile unde ai văzut tu semnal reali → trigger; cazurile neutre → no-trigger. False-positives = 0 țintă, false-negatives ≤ 5%. -3. **Live test notification-only (2 sesiuni):** `atm run` în fereastra trading. Verifici: - - Notificările Discord apar în 3s de când vezi trigger-ul pe chart. - - Screenshot atașat e clar, lizibil. - - SL/TP1/TP2 extrase sunt la ≤$0.05 de nivelele reale pe chart. - - Audit log (`logs/YYYY-MM-DD.jsonl`) conține fiecare ciclu; poți reproduce un missed signal. -4. **Sanity alerts:** mută/redimensionează fereastra TradeStation → bot detectează "window lost" în 60s → notificare. Restabilește fereastra → bot reia. -5. **Scheduler validation:** Windows Task Scheduler pornește `atm run` la 16:30, se oprește curat la 18:30, audit log salvează fără corupere. - -## Risk Register - -- **Prop firm TOS (Faza 2 blocker, NU Faza 1):** înainte de orice extensie spre auto-execution în TradeLocker, citești TOS-ul prop-ului, cauți "EA / automation / bot / copy trading / external signals". Dacă e interzis, Faza 2 e moartă și rămâi permanent pe Faza 1. -- **Indicator layout change:** dacă TradeStation update schimbă render-ul M2D MAPS → re-calibration. Audit log va arăta degradare graduală a confidence-ului → alert activ via "bot lost sight". -- **Price divergence DIA↔US30:** trigger-ul se dă pe DIA; poate fi o secundă unde US30 deja a mișcat diferit. Risc acceptabil (judgment user), dar monitorizat în Faza 2 prin slippage analysis. -- **Screenshot pe ecran sharing / AnyDesk / RDP:** dacă cineva se conectează remote la Windows-ul tău în timpul trading, screenshot-urile pot cuprinde overlay-uri nepotrivite. Mic, dar notabil. - -## Out of Scope (Faza 1) - -- Orice click automat în TradeLocker -- Multi-symbol concurrent monitoring (single chart la un moment dat) -- Backtesting pe date istorice (strategia e deja validată manual) -- UI / dashboard web — totul rulează headless cu notificări externe