Skip to content

Commit 4515a43

Browse files
committed
Update imagenet & OOD test set eval results with current weights. Now have both test & train resolution results in tables.
1 parent 2df9f28 commit 4515a43

9 files changed

+11462
-8650
lines changed

results/generate_csv_results.py

+6-2
Original file line numberDiff line numberDiff line change
@@ -18,9 +18,11 @@
1818

1919

2020
def diff(base_df, test_csv):
21-
base_models = base_df['model'].values
21+
base_df['mi'] = base_df.model + '-' + base_df.img_size.astype('str')
22+
base_models = base_df['mi'].values
2223
test_df = pd.read_csv(test_csv)
23-
test_models = test_df['model'].values
24+
test_df['mi'] = test_df.model + '-' + test_df.img_size.astype('str')
25+
test_models = test_df['mi'].values
2426

2527
rank_diff = np.zeros_like(test_models, dtype='object')
2628
top1_diff = np.zeros_like(test_models, dtype='object')
@@ -61,6 +63,8 @@ def diff(base_df, test_csv):
6163
test_df['top5_diff'] = top5_diff
6264
test_df['rank_diff'] = rank_diff
6365

66+
test_df.drop('mi', axis=1, inplace=True)
67+
base_df.drop('mi', axis=1, inplace=True)
6468
test_df['param_count'] = test_df['param_count'].map('{:,.2f}'.format)
6569
test_df.sort_values(['top1', 'top5', 'model'], ascending=[False, False, True], inplace=True)
6670
test_df.to_csv(test_csv, index=False, float_format='%.3f')

results/results-imagenet-a-clean.csv

+1,432-1,081
Large diffs are not rendered by default.

results/results-imagenet-a.csv

+1,432-1,081
Large diffs are not rendered by default.

results/results-imagenet-r-clean.csv

+1,432-1,081
Large diffs are not rendered by default.

results/results-imagenet-r.csv

+1,432-1,081
Large diffs are not rendered by default.

results/results-imagenet-real.csv

+1,432-1,081
Large diffs are not rendered by default.

results/results-imagenet.csv

+1,432-1,081
Large diffs are not rendered by default.

results/results-imagenetv2-matched-frequency.csv

+1,432-1,081
Large diffs are not rendered by default.

results/results-sketch.csv

+1,432-1,081
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)