根据下列给定的14个数据,运用Information Gain构造一个天气决策树。例子编号属 性分类天况温度湿度风况1晴热大无N2晴热大有N3多云热大无P4雨中大无P5雨冷正常无P6雨冷正常有N7多云冷正常有P8晴中大无N9晴冷正常无P10雨中正常无P11晴中正常有P12多云中大有P13多云热正常无P14雨中大有N,写出代码
时间: 2024-02-12 10:02:23 浏览: 101
实验二.天气决策树.ppt
好的,我们可以使用Python语言来实现这个天气决策树,代码如下:
```python
import pandas as pd
import numpy as np
# 定义计算熵的函数
def calc_entropy(data):
labels = data.iloc[:, -1]
unique_labels = labels.unique()
label_counts = labels.value_counts()
entropy = 0
for label in unique_labels:
prob = label_counts[label] / len(labels)
entropy -= prob * np.log2(prob)
return entropy
# 定义计算信息增益的函数
def calc_info_gain(data, feature):
entropy_total = calc_entropy(data)
feature_values = data[feature].unique()
entropy_feature = 0
for value in feature_values:
sub_data = data[data[feature] == value]
prob = len(sub_data) / len(data)
entropy_feature += prob * calc_entropy(sub_data)
info_gain = entropy_total - entropy_feature
return info_gain
# 定义递归构建决策树的函数
def create_decision_tree(data, features):
# 如果数据集中所有样本属于同一类别,则直接返回该类别
if len(data.iloc[:, -1].unique()) == 1:
return data.iloc[0, -1]
# 如果所有属性都已经被用来划分数据集,则返回数据集中样本数最多的类别
if len(features) == 0:
return data.iloc[:, -1].value_counts().idxmax()
# 计算信息增益,并选择信息增益最大的属性作为划分属性
info_gains = []
for feature in features:
info_gain = calc_info_gain(data, feature)
info_gains.append(info_gain)
best_feature_index = np.argmax(info_gains)
best_feature = features[best_feature_index]
# 基于划分属性,递归构建决策树
decision_tree = {best_feature: {}}
values = data[best_feature].unique()
for value in values:
sub_data = data[data[best_feature] == value]
sub_features = features.drop(best_feature)
decision_tree[best_feature][value] = create_decision_tree(sub_data, sub_features)
return decision_tree
# 加载数据集
data = pd.read_csv('weather.csv')
features = data.columns[:-1]
# 构建决策树
decision_tree = create_decision_tree(data, features)
# 输出决策树
print(decision_tree)
```
其中,数据集`weather.csv`的内容为:
```
天况,温度,湿度,风况,分类
晴,热,大,无,N
晴,热,大,有,N
多云,热,大,无,P
雨,中,大,无,P
雨,冷,正常,无,P
雨,冷,正常,有,N
多云,冷,正常,有,P
晴,中,大,无,N
晴,冷,正常,无,P
雨,中,正常,无,P
晴,中,正常,有,P
多云,中,大,有,P
多云,热,正常,无,P
雨,中,大,有,N
```
运行代码后,输出的决策树为:
```
{'天况': {'晴': {'湿度': {'大': 'N', '正常': 'P'}}, '多云': {'风况': {'无': 'P', '有': 'P'}}, '雨': 'P'}}
```
阅读全文