weltby Ergodic Sign inGet started
All use cases

How Will Viewers Rate This Anime?

From its media type, episodes, years, studio, content warnings and viewing counts, what average rating does this title get on Anime-Planet? Streaming teams use estimates like this to pick what to license.

Use caseMedia and gamesPredictionModel evaluation

The table

3,767 anime titles with media type, episode count, years aired, studios, warnings and viewer counts, and the average rating. It's in Welt's research catalogue as Anime Dataset from Anime-Planet, 3,767 rows by 18 columns, licensed CC0: Public Domain. The catalogue measures its signal at 0.76. At 3,767 rows and 17 features, TabICLv2, Kumo Tabular Medium and Mitra-v2 take the table as it is. The others can't take a table this size, so the walkthrough leaves them out.

Walkthrough

  1. Load it from the catalogue

    Find the table, read its recorded target and print the column names.

    import pandas as pd
    from welt import Client
    
    with Client() as client:
        item = client.research_datasets(q="anime-planet", limit=1)["items"][0]
        info = client.research_dataset(item["id"])
        data = client.load_research_dataset(item["id"])
    
    target = info["targets"][0]
    target = target["name"] if isinstance(target, dict) else target
    print([column["name"] for column in info["schema"]], target)
  2. Pick the rows

    Set aside 20 rows to predict at the end, and keep the rest for the models to learn from.

    known = data.dropna(subset=[target])
    new_rows = known.sample(20, random_state=1)
    table = known.drop(new_rows.index)
  3. Compare the models and predict

    The models compete on the same folds against a simple guess, then the top-ranked one is fitted on the whole table. RMSE and MAE are average errors in the target's own units, so lower is better. The last table puts each prediction next to the real answer.

    with Client() as client:
        evaluation = client.evaluate(table, target, task="regression", seed=7,
                                     models=["tabicl-v2", "kumo-medium", "mitra-v2"])
        model = evaluation.fit()
    
    print(evaluation.summary()[["name", "rank", "rmse_mean", "mae_mean"]])
    features = new_rows.drop(columns=target)
    print(pd.DataFrame({"actual": new_rows[target].values, "predicted": model.predict(features)}))

What you get

A predicted ratingFor any title.
What fans valueCompare predictions across studios and formats.
A strong signalThe catalogue measures a high signal.

Try it

Use Open with to run the research datasets notebook in Colab, Kaggle or Jupyter and search for "anime-planet", or run the code above after pip install "welt-client[parquet]".