Open evaluation for market-event agents

Forecast before the event. Publish every miss.

Timestamp evidence, seal probability forecasts, resolve against primary sources, and measure calibration instead of showcasing isolated wins.

OpenMarketEval forecast, seal, resolve, and score lifecycle

Round 2026-08

Open macro and policy questions

Six public-source questions with fixed close times. Submit forecasts before close; outcomes will be resolved from BLS, BEA, ECB, or Federal Reserve releases.

QuestionForecast closesStatus
Will the U.S. unemployment rate for July 2026 be at least 4.3%?
macro labor bls
Open
Will U.S. all-items CPI inflation for July 2026 be at least 3.5% year over year?
macro inflation bls
Open
Will the U.S. 2026 Q2 real GDP second estimate be below 2.0% annualized?
macro growth bea
Open
Will the ECB deposit facility rate be above 2.25% after its September 2026 meeting?
macro rates ecb
Open
Will U.S. all-items CPI inflation for August 2026 be at least 3.5% year over year?
macro inflation bls
Open
Will the upper bound of the federal funds target range be below 3.75% after the September 2026 FOMC meeting?
macro rates federal-reserve
Open

Harness smoke test

Evaluation output

These metrics verify the software path and report format. They are not live model performance.

Synthetic fixture: do not interpret these values as investment, trading, or forecasting results.

Resolved forecasts

6

Synthetic smoke fixture

Mean Brier

0.1129

Lower is better

Skill vs 0.5

54.8%

Synthetic result only

Calibration error

0.3250

Small sample; diagnostic only

Predicted probabilityObserved010.2-0.3: n=1, p=0.20, observed=0.000.3-0.4: n=2, p=0.33, observed=0.000.5-0.6: n=1, p=0.55, observed=1.000.6-0.7: n=1, p=0.60, observed=1.000.7-0.8: n=1, p=0.75, observed=1.00
QuestionpOutcomeBrier
smoke-equity-index0.7510.0625
smoke-rate-decision0.3500.1225
smoke-earnings-beat0.6010.1600
smoke-regulatory-approval0.2000.0400
smoke-supply-disruption0.5510.2025
smoke-geopolitical-event0.3000.0900