weltby Ergodic Sign inGet started
All use cases

How Much Energy Are This Home's Appliances Using?

From room-by-room temperature and humidity and the weather outside, how much energy are the appliances in this house drawing? It tests how much a smart home can learn from cheap sensors.

Use caseEnergyPredictionModel evaluation

The table

Readings every ten minutes from a low-energy house in Belgium, with temperature and humidity in each room, outdoor weather and appliance energy use. It's in Welt's research catalogue as Appliances Energy Prediction, 19,735 rows by 28 columns, licensed CC BY 4.0. The catalogue measures its signal at 0.27. At 19,735 rows and 27 features the table is larger than the model limits allow, so the walkthrough evaluates and fits on a seeded sample of 4,000 rows. TabICLv2 and Kumo Tabular Medium compete.

Walkthrough

  1. Load it from the catalogue

    Find the table, read its recorded target and print the column names.

    import pandas as pd
    from welt import Client
    
    with Client() as client:
        item = client.research_datasets(q="appliances energy prediction", limit=1)["items"][0]
        info = client.research_dataset(item["id"])
        data = client.load_research_dataset(item["id"])
    
    target = info["targets"][0]
    target = target["name"] if isinstance(target, dict) else target
    print([column["name"] for column in info["schema"]], target)
  2. Pick the rows

    Set aside 20 rows to predict at the end. The models learn from a seeded sample of 4,000 of the rest, the most this table's width allows.

    known = data.dropna(subset=[target])
    new_rows = known.sample(20, random_state=1)
    table = known.drop(new_rows.index).sample(4000, random_state=7)
  3. Compare the models and predict

    The models compete on the same folds against a simple guess, then the top-ranked one is fitted on the whole table. RMSE and MAE are average errors in the target's own units, so lower is better. The last table puts each prediction next to the real answer.

    with Client() as client:
        evaluation = client.evaluate(table, target, task="regression", seed=7,
                                     models=["tabicl-v2", "kumo-medium"])
        model = evaluation.fit()
    
    print(evaluation.summary()[["name", "rank", "rmse_mean", "mae_mean"]])
    features = new_rows.drop(columns=target)
    print(pd.DataFrame({"actual": new_rows[target].values, "predicted": model.predict(features)}))

What you get

An energy estimateAppliance use predicted from room sensors.
A realistic testThe catalogue measures a weak signal, so the baseline comparison is the point.
Which rooms matterCompare models to see how much the sensors explain.

Try it

Use Open with to run the research datasets notebook in Colab, Kaggle or Jupyter and search for "appliances energy prediction", or run the code above after pip install "welt-client[parquet]".