Human Generated Data

Title

Untitled (county fair, central Ohio)
Date

August 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.400
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (county fair, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.400

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Animal 98.4
Bull 98.4
Mammal 98.4
People 97.9
Person 97.9
Adult 97.9
Male 97.9
Man 97.9
Person 97.8
Person 97.3
Person 97.1
Adult 97.1
Male 97.1
Man 97.1
Person 95.7
Person 95.6
Person 94.4
Adult 94.4
Male 94.4
Man 94.4
Person 94.2
Person 93
Person 92.5
Horse 92.4
Person 92.2
Clothing 91.9
Hat 91.9
Horse 91.1
Person 90.5
Person 90.2
Person 90.1
Person 88.4
Horse 88.4
Person 88.2
Horse 86.3
Person 86.1
Horse 85
Person 84.6
Person 84
Person 83.3
Person 82.9
Person 82.7
Person 81.6
Person 78.9
Face 78.1
Head 78.1
Person 76.8
Person 75.4
Person 74.6
Person 72.3
Person 70.3
Person 70
Person 68.1
Horseback Riding 68
Leisure Activities 68
Person 67.8
Person 67.4
Person 66.9
Rodeo 57.9
Cattle 57.9
Livestock 57.9
Ox 57.3
Equestrian 56.6
Outdoors 55.9
Crowd 55.2

Clarifai
created on 2018-05-11

people 100
many 99.5
group 99.4
group together 99.3
adult 97.6
cavalry 96.2
mammal 94.7
administration 94.5
man 94.1
military 93.4
outfit 91.4
vehicle 91.2
seated 89.1
war 88.4
several 88
recreation 87.3
leader 86.3
spectator 83.8
crowd 81.8
transportation system 81.6

Imagga
created on 2023-10-06

horse 91.6
animal 46.2
cowboy 44.5
horses 37
ranch 36.4
saddle 35.9
farm 35.7
vaulting horse 30.3
riding 28.3
animals 25
equine 23.9
horseback 23.7
ride 23.3
cattle 22.5
grass 22.2
brown 22.1
field 21.8
equestrian 21.6
sport 21.4
rider 20.7
cow 19.5
mammal 19.3
stallion 18.6
rural 18.5
pen 18.4
gymnastic apparatus 18.2
pasture 17.2
outdoors 17.2
livestock 16.9
country 16.7
mane 15.7
seat 14.1
resort 14.1
enclosure 13.9
mare 13.8
sidesaddle 13.6
western 13.6
laborer 13.5
cows 12.8
competition 12.8
jockey 12.8
agriculture 12.3
sports equipment 12.1
herd 11.8
grazing 11.8
meadow 11.7
fence 11.6
black 11.4
bridle 11.3
hat 11.2
people 11.2
speed 11
summer 10.9
active 10.8
bull 10.7
countryside 10.1
support 10
outdoor 9.9
dairy 9.6
stock saddle 9.6
two 9.3
male 9.1
trees 8.9
mammals 8.8
man 8.7
forest 8.7
race 8.6
outside 8.6
farming 8.5
action 8.3
sky 8.3
pet 8.3
trainer 8.1
dressage 7.9
paddock 7.9
gallop 7.9
stable 7.9
wild 7.8
racing 7.8
tree 7.7
dirt 7.6
fun 7.5
cute 7.2
day 7.1

Google
created on 2018-05-11

black and white 87.3
horse like mammal 86.6
horse 85.8
pack animal 82
cattle like mammal 68.1
monochrome photography 64
ox 62.6
livestock 60.5
tree 58.6
monochrome 56.2
stallion 50.2

Microsoft
created on 2018-05-11

outdoor 99.9
ground 97.8
person 96.8
standing 93.4
people 79.5
group 71.9
mammal 71.1
posing 36.5
horse 21.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Male, 89.1%
Sad 91.8%
Confused 52.9%
Surprised 6.6%
Fear 6.3%
Disgusted 0.7%
Calm 0.5%
Angry 0.2%
Happy 0.2%

AWS Rekognition

Age 42-50
Gender Male, 96.9%
Calm 97%
Surprised 6.3%
Fear 5.9%
Happy 2.7%
Sad 2.2%
Disgusted 0.1%
Angry 0%
Confused 0%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Angry 89.9%
Surprised 6.9%
Fear 6.3%
Confused 3.3%
Sad 3.1%
Disgusted 0.9%
Calm 0.6%
Happy 0.4%

AWS Rekognition

Age 18-26
Gender Male, 96.9%
Fear 26.4%
Surprised 21.5%
Calm 18.9%
Sad 13.7%
Disgusted 9.6%
Angry 5.8%
Happy 5.1%
Confused 4.3%

AWS Rekognition

Age 25-35
Gender Female, 99.9%
Confused 51.2%
Calm 30.7%
Surprised 7.5%
Fear 6.4%
Sad 6%
Angry 5.2%
Disgusted 1%
Happy 0.8%

AWS Rekognition

Age 30-40
Gender Female, 63.2%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.6%
Confused 0.3%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 28-38
Gender Male, 85.7%
Calm 64.6%
Happy 22.9%
Surprised 8.9%
Fear 6.1%
Sad 3.1%
Angry 2.1%
Disgusted 1.7%
Confused 0.9%

AWS Rekognition

Age 13-21
Gender Female, 99.9%
Fear 88.8%
Calm 21.2%
Surprised 6.9%
Sad 2.6%
Happy 1.3%
Confused 1.2%
Disgusted 1.1%
Angry 0.6%

AWS Rekognition

Age 22-30
Gender Female, 98.2%
Sad 70.6%
Disgusted 42.3%
Calm 14.8%
Fear 7.2%
Surprised 7.2%
Angry 2.5%
Confused 1.3%
Happy 1.1%

AWS Rekognition

Age 20-28
Gender Female, 88.2%
Sad 99.9%
Calm 13.4%
Fear 7.5%
Surprised 7%
Confused 1.7%
Disgusted 1.5%
Angry 1.3%
Happy 0.5%

AWS Rekognition

Age 20-28
Gender Male, 99.4%
Confused 55.3%
Calm 27.2%
Sad 9.2%
Surprised 7%
Fear 6.1%
Disgusted 1.8%
Angry 1.6%
Happy 1.3%

AWS Rekognition

Age 11-19
Gender Male, 88.3%
Happy 57.7%
Surprised 14.9%
Angry 13%
Fear 6.3%
Confused 5.3%
Disgusted 4.8%
Sad 4%
Calm 2.5%

AWS Rekognition

Age 21-29
Gender Male, 99.1%
Calm 93.8%
Surprised 6.3%
Fear 5.9%
Sad 4.9%
Happy 0.1%
Disgusted 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Surprised 58.7%
Calm 34.7%
Happy 22.6%
Fear 6.5%
Sad 2.8%
Angry 1.7%
Disgusted 1.1%
Confused 1%

AWS Rekognition

Age 12-20
Gender Male, 99.9%
Surprised 49.7%
Happy 47.7%
Calm 10.3%
Fear 6.5%
Sad 3.2%
Confused 2.3%
Disgusted 2.2%
Angry 1.7%

AWS Rekognition

Age 23-31
Gender Male, 95.1%
Angry 47.3%
Calm 14.8%
Disgusted 12.9%
Fear 9.1%
Surprised 8.9%
Sad 6.3%
Happy 4%
Confused 1.7%

AWS Rekognition

Age 2-8
Gender Female, 97.8%
Fear 62.3%
Calm 38.1%
Surprised 7.1%
Angry 5.9%
Happy 3%
Sad 2.5%
Confused 0.9%
Disgusted 0.7%

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Happy 47.6%
Sad 18.2%
Fear 14.1%
Calm 9.2%
Surprised 7.6%
Confused 4.9%
Angry 3.7%
Disgusted 1.6%

AWS Rekognition

Age 6-14
Gender Male, 97.5%
Sad 75.8%
Calm 27.9%
Happy 19.9%
Fear 10%
Surprised 7.4%
Angry 3.9%
Disgusted 1.4%
Confused 1.3%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Fear 66.6%
Calm 34.7%
Surprised 6.8%
Angry 5.3%
Sad 3%
Confused 2.4%
Disgusted 1.2%
Happy 1.2%

AWS Rekognition

Age 20-28
Gender Male, 77.3%
Calm 66.1%
Fear 12.7%
Disgusted 11.1%
Surprised 7.4%
Angry 3%
Sad 2.6%
Confused 2.2%
Happy 1.5%

AWS Rekognition

Age 25-35
Gender Male, 100%
Sad 70.4%
Surprised 24.2%
Confused 19.2%
Fear 8.8%
Calm 8.7%
Disgusted 6.6%
Happy 5%
Angry 3.1%

AWS Rekognition

Age 7-17
Gender Female, 69.3%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 1.1%
Calm 0.3%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 14-22
Gender Female, 99.1%
Fear 97.8%
Surprised 6.3%
Sad 2.3%
Calm 0.5%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 13-21
Gender Male, 97.9%
Calm 77.9%
Fear 8.1%
Surprised 6.6%
Disgusted 4.9%
Sad 4.3%
Angry 3.8%
Confused 1.6%
Happy 1.1%

AWS Rekognition

Age 11-19
Gender Female, 82.6%
Angry 33.7%
Calm 27.5%
Happy 15.9%
Fear 13.4%
Surprised 8.1%
Sad 3.4%
Confused 1.4%
Disgusted 1.3%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 16-24
Gender Male, 100%
Calm 54.3%
Sad 17%
Happy 11.8%
Surprised 8.1%
Fear 7.7%
Angry 7%
Disgusted 2.1%
Confused 1.7%

AWS Rekognition

Age 18-24
Gender Male, 93.2%
Calm 80.4%
Fear 10.3%
Angry 7.7%
Surprised 6.4%
Sad 2.4%
Happy 1.2%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 18-26
Gender Male, 78.7%
Happy 53.5%
Calm 26.2%
Fear 13.6%
Surprised 6.7%
Sad 3%
Confused 1.4%
Disgusted 1%
Angry 0.9%

AWS Rekognition

Age 41-49
Gender Male, 83.4%
Happy 65.1%
Calm 22.6%
Fear 6.7%
Surprised 6.6%
Sad 4.6%
Confused 2%
Disgusted 1%
Angry 0.9%

AWS Rekognition

Age 14-22
Gender Male, 99.7%
Calm 68.6%
Sad 35.2%
Surprised 7.1%
Fear 6.9%
Confused 2.4%
Angry 1.2%
Disgusted 0.8%
Happy 0.6%

AWS Rekognition

Age 13-21
Gender Male, 97.2%
Calm 67.7%
Sad 12%
Fear 7.9%
Happy 7.6%
Surprised 7.2%
Disgusted 2.3%
Angry 2%
Confused 1.2%

AWS Rekognition

Age 16-24
Gender Male, 62.1%
Calm 62.5%
Fear 11.7%
Sad 9.3%
Angry 8.1%
Surprised 7.8%
Happy 2.6%
Disgusted 1.2%
Confused 0.7%

AWS Rekognition

Age 26-36
Gender Male, 99.7%
Calm 81.1%
Surprised 11.8%
Fear 6%
Disgusted 3.7%
Sad 3.7%
Happy 1.3%
Confused 1%
Angry 0.8%

AWS Rekognition

Age 20-28
Gender Male, 51.9%
Disgusted 53.8%
Calm 20.6%
Surprised 8.9%
Fear 6.9%
Angry 6.7%
Sad 4.6%
Confused 4.5%
Happy 2.1%

AWS Rekognition

Age 16-24
Gender Male, 97.6%
Calm 92.7%
Fear 7.2%
Surprised 6.7%
Sad 2.4%
Angry 1.5%
Confused 0.4%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Female, 86.6%
Confused 53.1%
Calm 35.7%
Fear 7.3%
Surprised 6.8%
Sad 3.2%
Angry 2.1%
Happy 1%
Disgusted 0.8%

AWS Rekognition

Age 11-19
Gender Male, 100%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 21-29
Gender Female, 75.7%
Calm 80.4%
Surprised 9.4%
Fear 8.3%
Sad 2.7%
Happy 2.5%
Angry 2.2%
Disgusted 1.4%
Confused 1.2%

AWS Rekognition

Age 12-20
Gender Male, 100%
Angry 49%
Calm 36.9%
Happy 7.4%
Surprised 6.7%
Fear 6.6%
Sad 2.9%
Confused 1.1%
Disgusted 0.7%

AWS Rekognition

Age 18-24
Gender Male, 98.5%
Calm 53.3%
Sad 35.3%
Surprised 9.4%
Fear 7.1%
Angry 5.5%
Happy 5%
Disgusted 3.1%
Confused 2.4%

AWS Rekognition

Age 6-16
Gender Male, 99.1%
Calm 64.4%
Fear 22.2%
Surprised 6.8%
Happy 4.1%
Angry 3.5%
Sad 2.8%
Disgusted 1.5%
Confused 1.1%

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Horse
Person 97.9%
Person 97.8%
Person 97.3%
Person 97.1%
Person 95.7%
Person 95.6%
Person 94.4%
Person 94.2%
Person 93%
Person 92.5%
Person 92.2%
Person 90.5%
Person 90.2%
Person 90.1%
Person 88.4%
Person 88.2%
Person 86.1%
Person 84.6%
Person 84%
Person 83.3%
Person 82.9%
Person 82.7%
Person 81.6%
Person 78.9%
Person 76.8%
Person 75.4%
Person 74.6%
Person 72.3%
Person 70.3%
Person 70%
Person 68.1%
Person 67.8%
Person 67.4%
Person 66.9%
Adult 97.9%
Adult 97.1%
Adult 94.4%
Male 97.9%
Male 97.1%
Male 94.4%
Man 97.9%
Man 97.1%
Man 94.4%
Horse 92.4%
Horse 91.1%
Horse 88.4%
Horse 86.3%
Horse 85%

Captions

Microsoft
created on 2018-05-11

a group of people standing next to a horse 97.6%
a group of people posing for a photo 94.3%
a group of people standing on top of a horse 94.2%

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of men in uniforms and hats are standing in a line -100%