Building models for the Numerai tournament
Many people who learn machine learning want a hard problem with real data behind it. Numerai runs a tournament that gives anyone a free dataset of stock market data to try.
We are a small research project. We build our own models from scratch, on our own servers, and we are entering them in the tournament. This page sets out how the tournament works and how researchers test a model before they trust it.
What the tournament is
Numerai calls it a data science tournament. Numerai gives out the dataset free. Participants build models on it and send in predictions, and Numerai scores those predictions over time.
Numerai also runs a hedge fund. Numerai combines the staked predictions into one ensemble, which they call the Meta Model. The fund trades on that ensemble.
What the data holds
Each row in the dataset is one stock on one date. Numerai describes the stock with features known on that date. Its target records how the stock went on to perform against the rest of the market. Numerai builds the target this way because its fund looks for returns that broad market moves leave unexplained.
In version 6.0 the main target looks 60 business days ahead. The training file runs to 28 December 2018, and the validation file starts on 4 January 2019. Most of the new features come in five bins, numbered 0 to 4. Numerai publishes the files in Parquet, a format built for large tables of columns.
Numerai released version 6.0 on 16 October 2026. Participants can send in predictions made with it from the round that starts on 6 November 2026.
Testing a model fairly
Numerai groups the rows by date, and calls each group an era. Its guide advises researchers to treat each era as one data point. Targets on nearby dates can cover overlapping future periods, so a test needs care.
Numerai trained its earlier benchmark models only on data from before the dates they predicted. For a 60-day target, its staff left a gap of 16 eras between the training data and each test period.
The scikit-learn guide calls it overfitting when a model scores well on data it has already seen and fails on new data. For data in time order, the guide recommends tests that always come after the training dates. Numerai gives a similar warning. Researchers who tune a model too often against the validation years can end up fitting it to those years.
How the scores work
Numerai releases new live data every day from Tuesday to Saturday. A participant sends in one prediction for each stock in it. Numerai scores the order of the predictions, so only their ranks count.
The two main scores are correlation with the target (CORR) and contribution to the Meta Model (MMC). MMC measures how much the unique part of a prediction adds to the Meta Model. A round scored on a 60-day target takes about 12 weeks to resolve. Numerai keeps every score on a model's record for good.
Staking and the NMR token
Participants can stake NMR, Numerai's own token, on their predictions. Numerai pays out more NMR for a positive score. For a negative score it burns part of the stake, which destroys it. Numerai scores unstaked predictions in the same way, and only staked ones carry weight in the Meta Model.
We stake nothing. The Financial Conduct Authority treats crypto as high risk. It tells anyone who buys crypto to be prepared to lose all the money they put in.
Useful links
- Numerai docs: getting started
- Numerai docs: the dataset, eras and targets
- Numerai docs: how predictions are scored
- Numerai docs: questions new participants ask
- Numerai: the list of data files
- Numerai's example scripts on GitHub
- The Numerai forum
- scikit-learn: cross-validation, including data in time order
- LightGBM documentation
- FCA: crypto, the basics