weltby Ergodic Sign inGet started
All use cases

What Will This Film Score on IMDb?

From its year, genre, runtime, votes, box office, Metascore and director, what IMDb rating did this film get? It's a fun way to see how much critics and audiences agree.

Use caseMedia and gamesPredictionModel evaluation

The table

5,834 films released from 1972 to 2019 with year, genre, runtime, votes, revenue, Metascore and director, and the IMDb rating. It's in Welt's research catalogue as IMDB Movies 1972-2019, 5,834 rows by 12 columns, licensed CC0: Public Domain. The catalogue measures its signal at 0.60. At 5,834 rows and 11 features, TabICLv2 and Kumo Tabular Medium take the table as it is. The others can't take a table this size, so the walkthrough leaves them out.

Walkthrough

  1. Load it from the catalogue

    Find the table, read its recorded target and print the column names.

    import pandas as pd
    from welt import Client
    
    with Client() as client:
        item = client.research_datasets(q="IMDB movies 1972-2019", limit=1)["items"][0]
        info = client.research_dataset(item["id"])
        data = client.load_research_dataset(item["id"])
    
    target = info["targets"][0]
    target = target["name"] if isinstance(target, dict) else target
    print([column["name"] for column in info["schema"]], target)
  2. Pick the rows

    Set aside 20 rows to predict at the end, and keep the rest for the models to learn from.

    known = data.dropna(subset=[target])
    new_rows = known.sample(20, random_state=1)
    table = known.drop(new_rows.index)
  3. Compare the models and predict

    The models compete on the same folds against a simple guess, then the top-ranked one is fitted on the whole table. RMSE and MAE are average errors in the target's own units, so lower is better. The last table puts each prediction next to the real answer.

    with Client() as client:
        evaluation = client.evaluate(table, target, task="regression", seed=7,
                                     models=["tabicl-v2", "kumo-medium"])
        model = evaluation.fit()
    
    print(evaluation.summary()[["name", "rank", "rmse_mean", "mae_mean"]])
    features = new_rows.drop(columns=target)
    print(pd.DataFrame({"actual": new_rows[target].values, "predicted": model.predict(features)}))

What you get

A predicted ratingFor any film you can describe.
Critics and crowdsSee how much the Metascore predicts the audience.
Text columns handledGenres and directors go in as they are.

Try it

Use Open with to run the research datasets notebook in Colab, Kaggle or Jupyter and search for "IMDB movies 1972-2019", or run the code above after pip install "welt-client[parquet]".