Human Generated Data

Title

Untitled (county fair, central Ohio)
Date

August 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.439
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (county fair, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.439

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

People 99.8
Clothing 98.6
Hat 98.6
Animal 98.2
Bull 98.2
Mammal 98.2
Person 97.2
Person 97.2
Adult 97.2
Male 97.2
Man 97.2
Person 96.7
Person 95.9
Adult 95.9
Male 95.9
Man 95.9
Person 94.5
Person 93.8
Adult 93.8
Male 93.8
Man 93.8
Person 92.3
Person 92.1
Person 91.8
Person 91.4
Adult 91.4
Male 91.4
Man 91.4
Person 91.3
Person 89.9
Person 89.4
Horse 89.4
Person 88.4
Horse 88.1
Person 87.1
Person 86.7
Horse 81.9
Person 79
Person 78.7
Face 77.7
Head 77.7
Person 74.4
Person 72.7
Person 72.5
Person 71.6
Horse 71.1
Person 70.8
Person 70.3
Person 69.7
Person 69.4
Person 68.5
Person 65.6
Person 63.1
Cattle 62.8
Livestock 62.8
Person 60.6
Person 60.6
Person 60.3
Equestrian 57.6
Crowd 57.1
Ox 56.8
Outdoors 56.6
Person 56.3
Rodeo 55.5

Clarifai
created on 2018-05-11

people 100
many 99.6
group 98.8
cavalry 98.6
group together 98.2
man 95.1
adult 95
administration 92.3
recreation 88.9
military 88.6
mammal 88.1
seated 86.8
spectator 85.1
several 83.7
outfit 83.3
crowd 83.1
police 82.4
leader 81
woman 79.3
war 76.6

Imagga
created on 2023-10-05

horse 56.1
cattle 42.6
ranch 41.9
farm 41.1
cowboy 40.5
horses 34.1
cow 30.7
pen 28.5
grass 28.5
dairy 28
animals 25.9
rural 25.6
animal 24
enclosure 22.3
livestock 22
brown 21.4
saddle 21.3
field 20.9
pasture 20.1
riding 19.5
country 19.3
bovine 19.1
ox 18
horseback 17.8
cows 17.8
herd 17.7
sport 17.3
equine 16.9
agriculture 16.7
ride 16.5
outdoors 16.4
countryside 15.5
rider 14.8
meadow 14.4
bull 13.6
farming 13.3
outdoor 13
summer 12.2
grazing 11.8
equestrian 11.8
mammals 11.7
western 11.6
resort 11.5
fence 10.8
mare 10.8
active 10.8
stallion 10.8
laborer 10.7
beef 10.3
black 10.2
speed 10.1
structure 9.8
hay 9.8
group 9.7
landscape 9.7
milk 9.5
outside 9.4
competition 9.2
stock saddle 9.2
hat 9
people 8.9
trees 8.9
corral 8.9
stable 8.9
male 8.8
mammal 8.8
calf 8.8
man 8.7
running 8.6
dirt 8.6
two 8.5
tree 8.5
sky 8.3
jockey 7.9
day 7.9
standing 7.8
fields 7.7
walking 7.6
freedom 7.3
sun 7.3
cute 7.2
mountain 7.1

Google
created on 2018-05-11

black and white 88.5
horse 87
horse like mammal 86.2
pack animal 80.4
monochrome photography 70
stallion 57.5
monochrome 57
stock photography 52.5
tree 52.4
ranch 50.6

Microsoft
created on 2018-05-11

outdoor 99.5
person 95.1
standing 92.3
group 86.7
black 77.2
white 70.5
old 64
people 63.6
posing 42.5
bovine 32.5
clothes 22.4
horse 13.2
crowd 1.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Female, 99.7%
Calm 61.4%
Confused 17.2%
Surprised 8.1%
Fear 7.7%
Angry 7.1%
Sad 4.1%
Disgusted 1.2%
Happy 1%

AWS Rekognition

Age 12-20
Gender Female, 94.8%
Calm 83.6%
Disgusted 8.3%
Surprised 6.9%
Fear 6.1%
Sad 3%
Angry 2.1%
Confused 1%
Happy 0.6%

AWS Rekognition

Age 41-49
Gender Male, 99.8%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Confused 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 16-24
Gender Male, 91.7%
Sad 100%
Calm 10.7%
Surprised 6.7%
Fear 6.6%
Angry 1%
Confused 0.9%
Happy 0.5%
Disgusted 0.5%

AWS Rekognition

Age 27-37
Gender Female, 99.9%
Fear 91.1%
Angry 10.7%
Surprised 7.8%
Confused 6.9%
Sad 2.4%
Calm 1.8%
Disgusted 0.7%
Happy 0.5%

AWS Rekognition

Age 21-29
Gender Male, 94.7%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Disgusted 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 24-34
Gender Female, 54.7%
Sad 99.4%
Confused 31.8%
Surprised 6.6%
Fear 6.5%
Disgusted 2.4%
Calm 0.6%
Angry 0.6%
Happy 0.2%

AWS Rekognition

Age 26-36
Gender Female, 95.3%
Disgusted 35.2%
Calm 26.2%
Angry 22.9%
Surprised 7.6%
Fear 6.2%
Sad 5.1%
Happy 3.8%
Confused 2.4%

AWS Rekognition

Age 19-27
Gender Male, 89.3%
Calm 66.8%
Happy 13.7%
Surprised 13.1%
Fear 6.5%
Disgusted 3.3%
Sad 2.8%
Confused 2.3%
Angry 1.1%

AWS Rekognition

Age 18-24
Gender Female, 97.2%
Calm 37.4%
Disgusted 30%
Fear 17.4%
Surprised 6.8%
Sad 6.4%
Happy 2.9%
Angry 1.6%
Confused 0.9%

AWS Rekognition

Age 22-30
Gender Male, 54.3%
Calm 95.6%
Surprised 6.4%
Fear 6%
Sad 3%
Confused 0.5%
Angry 0.3%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Male, 97%
Calm 70%
Sad 13.6%
Confused 11.1%
Surprised 6.5%
Fear 6.1%
Happy 1.8%
Angry 1.3%
Disgusted 1.1%

AWS Rekognition

Age 28-38
Gender Male, 99.4%
Surprised 45%
Calm 17.2%
Fear 16.1%
Sad 9.2%
Happy 9.1%
Angry 7.3%
Disgusted 4.9%
Confused 4.8%

AWS Rekognition

Age 11-19
Gender Female, 65%
Calm 61%
Fear 13.5%
Confused 7.7%
Surprised 7.7%
Sad 6.3%
Angry 3.6%
Happy 1.9%
Disgusted 1.6%

AWS Rekognition

Age 16-22
Gender Female, 69.3%
Happy 89%
Fear 8.7%
Surprised 7%
Sad 2.5%
Calm 0.8%
Angry 0.7%
Disgusted 0.4%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Female, 56.7%
Happy 57.9%
Surprised 26.8%
Calm 15%
Fear 6.4%
Angry 2.5%
Sad 2.4%
Disgusted 1.3%
Confused 1.2%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Happy 77.2%
Surprised 7.3%
Confused 7.1%
Fear 6.2%
Sad 4.6%
Calm 3.5%
Angry 2.6%
Disgusted 1.4%

AWS Rekognition

Age 7-17
Gender Male, 90.6%
Sad 83.7%
Calm 38.4%
Surprised 11.1%
Confused 9.8%
Fear 6.4%
Angry 1.9%
Disgusted 1.8%
Happy 1.4%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 95.2%
Surprised 6.5%
Fear 5.9%
Happy 3.1%
Sad 2.3%
Angry 0.3%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 6-12
Gender Male, 95.8%
Fear 90.8%
Happy 13.2%
Surprised 6.9%
Calm 3.5%
Confused 3.2%
Sad 2.8%
Disgusted 0.9%
Angry 0.7%

AWS Rekognition

Age 2-8
Gender Male, 89.2%
Calm 41.2%
Fear 35.5%
Surprised 9.7%
Happy 7.3%
Sad 5.3%
Angry 4%
Confused 2%
Disgusted 0.9%

AWS Rekognition

Age 20-28
Gender Male, 94.5%
Calm 64.1%
Disgusted 15.6%
Fear 8.3%
Surprised 7.7%
Confused 4%
Sad 3.3%
Angry 3.1%
Happy 2.2%

AWS Rekognition

Age 19-27
Gender Male, 95.9%
Calm 88%
Surprised 7.2%
Fear 6.2%
Sad 3.6%
Happy 2.4%
Angry 1.7%
Disgusted 0.8%
Confused 0.6%

AWS Rekognition

Age 22-30
Gender Male, 96.2%
Calm 50.9%
Sad 28.5%
Fear 16.2%
Surprised 6.7%
Happy 3.6%
Angry 3.4%
Confused 2.6%
Disgusted 1.5%

AWS Rekognition

Age 10-18
Gender Male, 100%
Calm 59.4%
Happy 21.7%
Angry 9.8%
Surprised 6.7%
Fear 6.2%
Sad 5.2%
Confused 0.6%
Disgusted 0.4%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 56.6%
Surprised 14.8%
Sad 10.5%
Happy 8.3%
Fear 8.2%
Angry 3.6%
Disgusted 2%
Confused 1.3%

AWS Rekognition

Age 4-10
Gender Male, 59.3%
Calm 92.1%
Surprised 6.6%
Fear 6.5%
Sad 2.7%
Angry 1.7%
Confused 1.3%
Disgusted 0.8%
Happy 0.4%

AWS Rekognition

Age 18-24
Gender Male, 99.8%
Calm 85.1%
Surprised 6.4%
Fear 5.9%
Sad 5.7%
Confused 4.6%
Disgusted 1.3%
Angry 0.9%
Happy 0.6%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 93.1%
Surprised 6.4%
Fear 5.9%
Happy 2.6%
Sad 2.4%
Angry 2%
Disgusted 0.6%
Confused 0.3%

AWS Rekognition

Age 27-37
Gender Male, 98.3%
Calm 56.5%
Fear 19.6%
Surprised 7.5%
Sad 5.8%
Angry 4.8%
Confused 3.6%
Happy 3.2%
Disgusted 2.2%

AWS Rekognition

Age 6-14
Gender Female, 65.4%
Happy 59%
Calm 13.6%
Surprised 12.8%
Fear 7.6%
Angry 4.6%
Sad 4.6%
Disgusted 2.1%
Confused 1.9%

AWS Rekognition

Age 22-30
Gender Male, 99.5%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.2%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 12-20
Gender Male, 97.7%
Calm 43.1%
Angry 23.8%
Fear 9.2%
Sad 8.3%
Surprised 7.5%
Happy 6.8%
Confused 4%
Disgusted 2.8%

AWS Rekognition

Age 10-18
Gender Male, 98.7%
Calm 42.8%
Happy 22.6%
Sad 16.3%
Fear 13.5%
Surprised 6.6%
Angry 3.1%
Disgusted 1.1%
Confused 0.8%

AWS Rekognition

Age 16-24
Gender Male, 97.1%
Sad 99.9%
Calm 10.6%
Fear 8.2%
Surprised 6.8%
Confused 2.3%
Happy 1.4%
Angry 1.1%
Disgusted 1%

AWS Rekognition

Age 16-24
Gender Male, 94.1%
Sad 69.2%
Calm 35.3%
Fear 10.6%
Surprised 8.5%
Happy 7.6%
Angry 6.6%
Confused 2.9%
Disgusted 1.9%

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.2%
Adult 97.2%
Male 97.2%
Man 97.2%
Horse 89.4%