Research methods

A study starts with a question and a comparator. It ends with a recorded decision: continue, revise the hypothesis or stop.

Three principles

Keep the claim specific

A conclusion belongs to the tested market, period, horizon and transaction assumptions. A different scope needs new evidence.

Design for risk

Assess drawdown, concentration, liquidity and operating failure alongside return. Preserve adverse observations.

Test implementation

Costs, turnover, borrowing, size and delay can overturn an attractive statistical result.

Testing

1

Define the question

State the portfolio job, comparator and result that would disprove the idea.

2

Fix the data boundary

Check publication times, membership, missing periods and corporate actions before constructing decisions.

3

Evaluate later periods

Choose settings on earlier data, then evaluate the next unseen period. Retain fold and regime variation, unsuccessful tests and trial counts.

4

Stress the transaction

Apply fees, spread, slippage, impact and relevant financing or borrow. Compare delayed execution and harder cost assumptions.

5

Observe prospectively

Freeze the decision process for paper observation; keep losses and gaps. A live pilot would add actual fills and operating consequences.

Market assumptions

Examples of transaction assumptions
MarketData clockExecution issue
EquitiesCompany information and corporate actions as known on each dateBorrow, corporate actions and whole-share completion
Digital assetsCompleted hourly observations across continuous tradingVenue liquidity, funding, fees and interruptions
OptionsUnderlying observations and timestamped option quotesBid/ask, multi-leg fills, margin, assignment and expiry