Added basic structure of details data processing and testing. For downloading huggingface details dataset files
ee9e25e
Corey Morriscommited on
added todo for test
9f7d306
Corey Morriscommited on
added a TODO
201a72d
Corey Morriscommited on
changed to save and load in a directory
dd61816
Corey Morriscommited on
updated gitignore
a89ad93
Corey Morriscommited on
Updated regression test
5d87f13
Corey Morriscommited on
comparing current code to the saved file from the last commit
ff055eb
Corey Morriscommited on
script to save dataframe to a file only if there are no uncommitted files
7a88af3
Corey Morriscommited on
Added a first regression test attempt. It currently fails and values are hardcoded
3ec98e7
Corey Morriscommited on
fixed test_streamlit_app_runs
5603e9f
Corey Morriscommited on
Fixed type error
e79bcf3
Corey Morriscommited on
WIP commit. Currently have nlargest error
d506f10
Corey Morriscommited on
Added test to test the specific method that is currently producting an error
5b83d0b
Corey Morriscommited on
Added failing integration test. Currently fails because of the addition of the organization to the dataframe
de65005
Corey Morriscommited on
Added organization to dataframe
52d3b03
Corey Morriscommited on
added failing test for new behavior of organization column. Updated test for rows for the newly added rows
02b1702
Corey Morriscommited on
removed code to print the number of outliers. could add it back later as logging potentially
cd21f99
Corey Morriscommited on
renamed file for clarity
229d6d1
Corey Morriscommited on
Added .gitignore file
368802d
Corey Morriscommited on
Added new results from hugging face
49d555f
Corey Morriscommited on
MC1 column had 8 rows with a value of 1. It didn't make sense given the next highest value was 0.47 . Assuming they were data errors, they were removed
e03b231
Corey Morriscommited on
truthfulqa data added to dataframe
abac22e
Corey Morriscommited on
Refactor to make later code changes easier
6d41115
Corey Morriscommited on
Added test for removal of undesired columns. fixed code error in column removal
9549fcc
Corey Morriscommited on
Added initial tests. test_columns and test_rows will be updated or removed later as they test for the exact number of columns and rows. the number of rows will change as more models are added
85667d0
Corey Morriscommited on
Updated the last updated date to 18Aug
42ff7b9
Corey Morriscommited on
updated with new hugging face results
8ccc242
Corey Morriscommited on
Updated description with more models
7f24726
Corey Morriscommited on
updated results
80c79bd
Corey Morriscommited on
fixed error
d7b89ce
Corey Morriscommited on
Added google analytics snippet
9444cd2
Corey Morriscommited on
Increased size of scatter plot
2b16774
Corey Morriscommited on
Made the radar plot larger
f52387e
Corey Morriscommited on
Moved radar plots to higher in the page
12a9766
Corey Morriscommited on
Modified title and explanation to better reflect what the site is
18ec1ba
Corey Morriscommited on
Moved radar chart to after analysis
fb25b1e
Corey Morriscommited on
Added a default model to compare
7b77065
Corey Morriscommited on
Improved clarity of explanation for Radar charts
a450af5
Corey Morriscommited on
Fixed some of the diplicate model issue
618dcce
Corey Morriscommited on
Table now displays the columns that have the top differences
dc21a69
Corey Morriscommited on
removed charts with hardcoded tasks. removed hardcoding of model for other charts
a125eb8
Corey Morriscommited on
Finding top differences between tasks from the target model
627e0f9
Corey Morriscommited on
Added explanation for the plot and a dataframe of the models
2db58a0
Corey Morriscommited on
Added radar chart. Compares a model to the 5 models that have the closest performance on MMLU_average
9695a47
Corey Morriscommited on
added new results from hugging face
b9b6115
Corey Morriscommited on
Added header back for the table
2a7f691
Corey Morriscommited on
Added citation for the site
ea8703d
Corey Morriscommited on
Changed streamlit to wide layout to see more of the table