Human Generated Data

Title

Untitled (group of people smiling)
Date

1948
People

Artist: Peter James Studio, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20255

Human Generated Data

Title

Untitled (group of people smiling)

People

Artist: Peter James Studio, American

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.3
Person 99.3
Person 99.2
Person 99.1
Person 98.3
Person 97.8
Person 96.8
Person 94.5
Clothing 94
Apparel 94
Person 90.6
Person 89.3
Clinic 86.2
Room 76.9
Indoors 76.9
People 76.4
Person 74.7
Doctor 63
Crowd 59.3
Female 58.7
Hospital 58
Girl 55.2
Person 50.9

Imagga
created on 2022-03-05

nurse 100
people 34
man 28.9
male 27.6
adult 25.9
men 24.9
business 22.5
person 21.3
businessman 21.2
professional 20.7
women 19.8
corporate 18.9
group 18.5
team 17
patient 16.9
medical 16.8
occupation 16.5
doctor 16
indoors 15.8
happy 15
hospital 14.7
worker 14.3
job 14.1
businesswoman 13.6
human 13.5
work 13.3
health 12.5
case 12.4
portrait 11.6
medicine 11.4
teamwork 11.1
two 11
smiling 10.8
interior 10.6
uniform 10.6
room 10.4
meeting 10.4
day 10.2
lifestyle 10.1
window 10.1
communication 10.1
smile 10
clothing 9.9
modern 9.8
full length 9.7
office 9.6
profession 9.6
education 9.5
walking 9.5
adults 9.5
happiness 9.4
life 9.2
success 8.8
scientist 8.8
looking 8.8
home 8.8
together 8.8
discussion 8.8
lab 8.7
colleagues 8.7
couple 8.7
standing 8.7
corporation 8.7
laboratory 8.7
businesspeople 8.5
sick person 8.4
executive 8.3
suit 8.1
coat 8
family 8
working 7.9
assistant 7.8
chemistry 7.7
chemical 7.7
blurred 7.7
research 7.6
clothes 7.5
instrument 7.4
mature 7.4
20s 7.3
indoor 7.3
black 7.2
activity 7.2
clinic 7.1

Google
created on 2022-03-05

Photograph 94.2
White 92.2
Black-and-white 85.5
Monochrome 77.2
Monochrome photography 76.6
Snapshot 74.3
Event 73.8
Fashion design 71.6
Sleeve 69.1
Room 67.9
Uniform 66.8
Vintage clothing 66.7
Service 65.6
Stock photography 64.5
Art 56.1
Nurse uniform 52.8
Photography 51.8
History 50.8

Microsoft
created on 2022-03-05

person 99.8
clothing 93.9
standing 79.7
woman 79.3
text 77.2
group 72.5
man 67.6
dress 60
people 57.3
posing 54.6
clothes 16.4

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Happy 51%
Calm 35%
Surprised 4.7%
Fear 3.9%
Confused 2%
Sad 1.4%
Disgusted 1.3%
Angry 0.8%

AWS Rekognition

Age 36-44
Gender Male, 94.2%
Sad 51.3%
Calm 40.5%
Fear 3.9%
Surprised 1.5%
Angry 0.9%
Happy 0.9%
Confused 0.7%
Disgusted 0.4%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Confused 37.1%
Sad 19.7%
Calm 15.9%
Happy 12.8%
Surprised 6.8%
Disgusted 5.3%
Angry 1.3%
Fear 1%

AWS Rekognition

Age 35-43
Gender Male, 99.5%
Calm 50.1%
Surprised 16.8%
Confused 10.3%
Sad 6.8%
Happy 6.7%
Disgusted 3.4%
Angry 3.4%
Fear 2.4%

AWS Rekognition

Age 37-45
Gender Female, 96.1%
Sad 49.9%
Calm 32.1%
Surprised 9.3%
Confused 2.8%
Disgusted 2.7%
Happy 1.4%
Fear 1%
Angry 0.9%

AWS Rekognition

Age 31-41
Gender Female, 52.8%
Calm 65.8%
Happy 10.4%
Surprised 6.8%
Confused 6.2%
Fear 4.7%
Disgusted 2.6%
Sad 2.4%
Angry 1%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Happy 85.4%
Calm 10.9%
Surprised 0.9%
Confused 0.9%
Fear 0.6%
Sad 0.5%
Disgusted 0.4%
Angry 0.4%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Sad 74.1%
Happy 10.2%
Surprised 8.6%
Calm 2.8%
Confused 2%
Fear 0.9%
Disgusted 0.8%
Angry 0.5%

AWS Rekognition

Age 36-44
Gender Female, 87.5%
Calm 92.9%
Sad 5.6%
Happy 0.5%
Disgusted 0.3%
Angry 0.2%
Surprised 0.2%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Male, 92.3%
Calm 99.6%
Happy 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 41-49
Gender Female, 95.6%
Calm 92.3%
Happy 6.6%
Surprised 0.4%
Sad 0.3%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0%

AWS Rekognition

Age 47-53
Gender Male, 98.9%
Calm 62.5%
Surprised 17.3%
Happy 13.3%
Confused 3.1%
Sad 1.3%
Disgusted 1.2%
Fear 1%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 97.1%
a group of people standing in front of a crowd 97%
a group of people posing for a photo 96.7%

Text analysis

Amazon

8
M 113
M 113 YT37A2-002MA
YT37A2-002MA

Google

YT3RA2-002
MI3
00 MI3 YT3RA2-002
00