Human Generated Data

Title

Spectators at county fair, central Ohio

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3037

Human Generated Data

Title

Spectators at county fair, central Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.9
Human 99.9
Clothing 99.9
Apparel 99.9
Person 99.8
Person 99.6
Person 99.1
Hat 99
Person 98.7
Hat 98.7
Person 98.3
Person 97.5
Person 95.4
Person 94.4
Sailor Suit 86.7
Pants 82.4
Shorts 79
Crowd 75.2
Cap 73.6
Baseball Cap 71.7
Hat 71.6
Suspenders 60.6
Shoe 57.5
Footwear 57.5
Undershirt 56.4
Sun Hat 55.7
Factory 55.3
Building 55.3
Person 51.8

Imagga
created on 2021-12-15

hat 83.7
cowboy hat 58.8
man 41
headdress 37.2
male 36.1
people 31.2
clothing 30.5
person 29.4
portrait 25.2
adult 21.5
happy 21.3
two 19.5
cowboy 19
senior 15.9
couple 15.7
smile 15.7
shirt 14.9
outdoors 14.9
guy 14.8
men 14.6
smiling 14.5
handsome 14.3
hand 13.7
looking 13.6
western 13.6
consumer goods 13
covering 12.8
love 12.6
old 12.5
together 12.3
attractive 11.9
work 11.8
leisure 11.6
lifestyle 11.6
worker 11.5
nurse 11.4
uniform 11.3
face 10.6
standing 10.4
engineer 10.4
mature 10.2
black 10.2
happiness 10.2
model 10.1
vacation 9.8
fashion 9.8
job 9.7
child 9.7
elderly 9.6
boy 9.6
horse 9.5
expression 9.4
relationship 9.4
care 9
summer 9
fun 9
style 8.9
spectator 8.8
look 8.8
married 8.6
husband 8.6
father 8.5
industry 8.5
pair 8.5
business 8.5
romance 8
family 8
hair 7.9
travel 7.7
outside 7.7
life 7.7
retirement 7.7
youth 7.7
loving 7.6
casual 7.6
wearing 7.6
field 7.5
emotion 7.4
occupation 7.3
friendly 7.3
lady 7.3
indoor 7.3
sexy 7.2
gray 7.2
women 7.1
posing 7.1
medical 7.1
sky 7

Google
created on 2021-12-15

Hat 93.5
Sun hat 89.6
Fedora 86.3
Gesture 85.3
Headgear 80.9
Cowboy hat 76.3
Cap 76.1
Monochrome photography 75.5
Monochrome 73.9
Event 73.2
Vintage clothing 71.2
Art 70.9
Crowd 68.3
Crew 68
Font 67
History 64.8
Photo caption 64.4
Motor vehicle 61.3
Classic 59.2
Paper product 58.8

Microsoft
created on 2021-12-15

person 100
clothing 98.8
text 98.5
man 96.1
hat 94.4
people 87.1
standing 81.6
fashion accessory 81.3
group 76.4
cowboy hat 64.5
fedora 53.9
crowd 34.5

Face analysis

Amazon

Google

AWS Rekognition

Age 39-57
Gender Female, 87.8%
Calm 97.6%
Sad 1.9%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Happy 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 27-43
Gender Female, 54.6%
Calm 91.6%
Sad 3.7%
Angry 2.5%
Happy 1%
Confused 0.6%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 36-52
Gender Female, 89%
Calm 63.3%
Sad 17.9%
Happy 11.7%
Confused 3.1%
Surprised 1.5%
Fear 1.1%
Angry 0.9%
Disgusted 0.5%

AWS Rekognition

Age 35-51
Gender Female, 67.9%
Calm 86.7%
Happy 3.6%
Confused 2.4%
Angry 2.2%
Sad 2.1%
Surprised 1.7%
Disgusted 1%
Fear 0.2%

AWS Rekognition

Age 51-69
Gender Female, 70%
Calm 84.5%
Happy 7.7%
Disgusted 3.4%
Surprised 1.8%
Sad 1.2%
Fear 0.6%
Angry 0.5%
Confused 0.3%

AWS Rekognition

Age 22-34
Gender Female, 70.2%
Calm 59.8%
Happy 20.2%
Surprised 6.7%
Sad 6.1%
Angry 2%
Fear 1.8%
Disgusted 1.8%
Confused 1.6%

AWS Rekognition

Age 21-33
Gender Female, 67%
Happy 48.2%
Calm 41.8%
Sad 5.5%
Angry 2.3%
Fear 0.8%
Surprised 0.6%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 50-68
Gender Female, 82.7%
Sad 55.9%
Calm 26.3%
Happy 10.7%
Confused 2.5%
Angry 2.1%
Disgusted 1.1%
Fear 0.9%
Surprised 0.5%

AWS Rekognition

Age 9-19
Gender Male, 95.7%
Calm 73.5%
Sad 17.6%
Angry 2.9%
Fear 2.3%
Happy 1.6%
Confused 0.9%
Surprised 0.7%
Disgusted 0.6%

AWS Rekognition

Age 38-56
Gender Female, 69.9%
Calm 64.6%
Sad 26.1%
Happy 3.7%
Surprised 1.8%
Confused 1.7%
Angry 1.3%
Fear 0.6%
Disgusted 0.2%

AWS Rekognition

Age 40-58
Gender Female, 78.9%
Calm 69.2%
Happy 17.3%
Disgusted 7.7%
Surprised 1.5%
Angry 1.3%
Sad 1.2%
Fear 1.1%
Confused 0.7%

AWS Rekognition

Age 22-34
Gender Female, 73.1%
Disgusted 62.3%
Calm 15.9%
Confused 11.9%
Angry 4.6%
Surprised 2.2%
Sad 1.4%
Happy 1.4%
Fear 0.4%

AWS Rekognition

Age 25-39
Gender Female, 80.7%
Fear 55.1%
Calm 26.9%
Surprised 5.3%
Happy 5%
Sad 2.9%
Confused 2.1%
Angry 1.4%
Disgusted 1.3%

AWS Rekognition

Age 11-21
Gender Female, 58.1%
Calm 38.3%
Happy 23.3%
Sad 18.6%
Angry 6.4%
Surprised 4.8%
Fear 4%
Disgusted 3.2%
Confused 1.4%

AWS Rekognition

Age 41-59
Gender Female, 53.6%
Calm 49.6%
Sad 32.7%
Surprised 5.2%
Happy 5%
Fear 3.3%
Angry 1.9%
Disgusted 1.5%
Confused 0.8%

AWS Rekognition

Age 18-30
Gender Female, 84.6%
Calm 43.4%
Happy 39.9%
Sad 6.2%
Confused 3.1%
Disgusted 2.3%
Angry 2%
Fear 1.8%
Surprised 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.9%
Hat 99%
Shoe 57.5%

Captions

Microsoft

a group of people standing in front of a crowd 95.8%
a group of people standing in front of a crowd of people 95.2%
a group of people standing in front of a large crowd of people 93.4%