Human Generated Data

Title

Untitled (group of men sitting in a meeting, one man standing up)

Date

1945

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14695

Human Generated Data

Title

Untitled (group of men sitting in a meeting, one man standing up)

People

Artist: Jack Gould, American

Date

1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.6
Human 99.6
Nature 99.5
Person 99.3
Person 99
Person 99
Person 98.6
Person 97.9
Person 97
Person 96.4
Person 96.1
Person 95.5
Person 94.6
Person 91.5
Person 88.7
Smoke 86.8
Outdoors 86.1
Person 85.8
Accessories 84.1
Accessory 84.1
Sunglasses 84.1
Sunglasses 81.7
Fog 81.6
Sunglasses 79.5
Sunglasses 78.3
Person 72.9
Person 71.8
Smog 70.4
Snow 66.5
Crowd 61.2

Imagga
created on 2022-01-29

man 46.4
male 39.7
person 36
senior 33.8
people 33.5
couple 27.9
patient 25.8
sitting 24.9
indoors 23.7
adult 23.5
home 23.1
happy 21.9
together 21.9
smiling 21.7
meeting 21.7
medical 20.3
businessman 20.3
coat 20
office 19.8
room 19.7
business 19.4
table 19
work 18.8
worker 18.3
elderly 18.2
professional 18.2
talking 18.1
lab coat 18.1
men 18
nurse 17.8
hospital 17.7
mature 17.7
team 17
doctor 16.9
group 16.1
women 15.8
working 15
occupation 14.7
businesspeople 14.2
desk 14.2
job 14.2
specialist 14.2
teamwork 13.9
health 13.9
lifestyle 13.7
colleagues 13.6
looking 13.6
30s 13.5
indoor 12.8
businesswoman 12.7
retired 12.6
mid adult 12.5
husband 12.5
wife 12.3
portrait 12.3
cheerful 12.2
executive 12
two 11.9
laptop 11.8
happiness 11.8
two people 11.7
surgeon 11.7
practitioner 11.6
to 11.5
smile 11.4
grandma 11.3
computer 11.2
corporate 11.2
groom 10.9
suit 10.9
70s 10.8
care 10.7
face 10.7
illness 10.5
old 10.5
student 10.4
grandfather 10.2
casual 10.2
holding 9.9
modern 9.8
hairdresser 9.7
40s 9.7
case 9.7
education 9.5
color 9.5
clothing 9.4
clinic 9.3
family 8.9
discussion 8.8
love 8.7
retirement 8.6
married 8.6
bright 8.6
communication 8.4
inside 8.3
confident 8.2
meal 8.1
success 8
medicine 7.9
senior adult 7.9
restaurant 7.8
conference 7.8
thirties 7.8
laboratory 7.7
busy 7.7
sick person 7.7
exam 7.7
serious 7.6
ethnic 7.6
college 7.6
enjoying 7.6
adults 7.6
showing 7.5
wine 7.4
teacher 7.3
school 7.2
handsome 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

person 100
man 98.8
human face 95.8
text 89.9
clothing 87.4

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 99.5%
Sad 52.5%
Calm 31.5%
Confused 10.5%
Surprised 2.9%
Disgusted 1.6%
Angry 0.4%
Happy 0.3%
Fear 0.3%

AWS Rekognition

Age 48-54
Gender Male, 99.7%
Sad 96.6%
Calm 1.7%
Confused 0.5%
Disgusted 0.4%
Angry 0.3%
Fear 0.2%
Happy 0.2%
Surprised 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.6%
Calm 99.6%
Happy 0.2%
Surprised 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 52-60
Gender Male, 64.6%
Calm 99.2%
Sad 0.7%
Disgusted 0%
Confused 0%
Happy 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 90%
Calm 79.3%
Confused 6.1%
Surprised 5.4%
Sad 4.3%
Disgusted 2%
Angry 1.5%
Happy 0.9%
Fear 0.4%

AWS Rekognition

Age 51-59
Gender Male, 99.8%
Calm 97.8%
Sad 0.6%
Angry 0.5%
Confused 0.5%
Surprised 0.3%
Disgusted 0.2%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Male, 98.9%
Calm 64.5%
Happy 29.2%
Disgusted 2.3%
Sad 1.4%
Surprised 1.1%
Confused 0.7%
Angry 0.6%
Fear 0.3%

AWS Rekognition

Age 6-16
Gender Female, 84.2%
Calm 94.6%
Sad 2.1%
Happy 1.7%
Confused 1%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Calm 96.9%
Confused 1.3%
Sad 0.8%
Surprised 0.3%
Disgusted 0.3%
Fear 0.1%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 19-27
Gender Female, 99.8%
Happy 67.6%
Calm 16.3%
Sad 10.4%
Confused 2%
Angry 1.3%
Surprised 1.1%
Fear 0.8%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Sunglasses 84.1%

Captions

Microsoft

a group of people standing in front of a window 87.5%
a group of people standing in a room 87.4%
a group of people looking at each other 87.3%

Text analysis

Amazon

002NA
MJI3 002NA
MJI3