Human Generated Data

Title

Farm people at fair in central Ohio

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2973

Human Generated Data

Title

Farm people at fair in central Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.7
Human 99.7
Person 99.7
Person 99.7
Person 99.5
Clothing 98.5
Apparel 98.5
Person 97
Hat 88.7
Shorts 85.6
Person 84.2
Military Uniform 84.1
Military 84.1
People 75.1
Sailor Suit 74
Tie 72.2
Accessories 72.2
Accessory 72.2
Officer 69.9
Police 68.1
Crowd 65.9
Shirt 60.8
Person 59.2
Female 58.1
Funeral 55.5

Imagga
created on 2021-12-15

uniform 44.8
military uniform 42.3
man 41.6
male 40.5
people 28.4
person 27.9
clothing 26.5
professional 24.2
happy 22.5
adult 20.9
doctor 20.7
portrait 20
senior 19.7
job 19.4
medical 19.4
covering 17.9
consumer goods 17.6
smiling 17.3
work 17.3
business 17
health 16.7
mature 15.8
worker 15.2
businessman 15
stethoscope 14.7
hospital 14.4
elderly 14.4
handsome 14.3
care 14
medicine 13.2
couple 13.1
smile 12.8
looking 12.8
old 12.5
profession 12.4
serious 12.4
patient 12.2
office 12
coat 11.6
lifestyle 11.6
home 11.2
occupation 11
happiness 11
holding 10.7
men 10.3
suit 10.2
aged 9.9
working 9.7
glasses 9.2
confident 9.1
nurse 9
black 9
team 9
guy 8.9
middle aged 8.8
student 8.7
love 8.7
staff 8.6
corporate 8.6
camera 8.3
private 8.1
commodity 8.1
engineer 8
practitioner 8
hair 7.9
hands 7.8
face 7.8
physician 7.8
clinic 7.7
casual 7.6
illness 7.6
hand 7.6
tie 7.6
joy 7.5
room 7.5
teamwork 7.4
photographer 7.4
success 7.2
history 7.2
indoors 7
modern 7
together 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

person 100
text 99.9
clothing 98.8
human face 91.2
smile 90.9
outdoor 90
group 89.4
man 85.1
people 81.8
posing 80.1
old 46.6
crowd 0.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 51-69
Gender Male, 64.2%
Calm 69.3%
Sad 29.3%
Angry 0.9%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 22-34
Gender Female, 98.2%
Happy 98.9%
Calm 0.3%
Angry 0.3%
Fear 0.1%
Sad 0.1%
Disgusted 0.1%
Surprised 0.1%
Confused 0%

AWS Rekognition

Age 51-69
Gender Male, 96.8%
Calm 99.6%
Angry 0.2%
Sad 0.1%
Happy 0.1%
Surprised 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 3-9
Gender Female, 99.5%
Calm 79.3%
Sad 8.9%
Happy 5.3%
Angry 4.3%
Confused 1.2%
Disgusted 0.5%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 31-47
Gender Male, 59.3%
Calm 56.1%
Happy 30.1%
Sad 13%
Angry 0.4%
Confused 0.2%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 26-42
Gender Male, 88.4%
Sad 75.7%
Calm 19%
Happy 1.6%
Fear 1.6%
Angry 1%
Confused 0.5%
Surprised 0.5%
Disgusted 0.2%

AWS Rekognition

Age 16-28
Gender Male, 92.5%
Sad 93.8%
Calm 5.3%
Happy 0.2%
Fear 0.2%
Angry 0.2%
Confused 0.2%
Disgusted 0%
Surprised 0%

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Hat 88.7%
Tie 72.2%

Captions

Microsoft

a group of people posing for a photo 98.3%
a group of people posing for the camera 98.2%
a group of people posing for a picture 98.1%