Human Generated Data

Title

Untitled (six adults at family reunion)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3030

Human Generated Data

Title

Untitled (six adults at family reunion)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Person 99.5
Human 99.5
Person 98.6
Person 98.2
Person 98
Accessories 97.4
Tie 97.4
Accessory 97.4
Person 97
Person 96.6
Clothing 95.6
Apparel 95.6
Furniture 87.3
Chair 87.3
Tie 83.7
Tie 76
Clinic 73.7
Sleeve 71.6
Scientist 71.1
Coat 70.4
Face 65.9
Suit 65.4
Overcoat 65.4
Sport 61.9
Sports 61.9
Fencing 61.9
Lab 61.3
Lab Coat 60.1
Portrait 60.1
Photography 60.1
Photo 60.1
People 58.9
Long Sleeve 55.7

Imagga
created on 2022-01-21

nurse 86.1
person 44.8
man 42.3
male 38.3
professional 35.8
people 35.7
doctor 34.8
patient 33
businessman 32.7
medical 32.7
business 31.6
team 30.5
job 30.1
adult 29.5
hospital 28.8
coat 28.6
worker 27.7
colleagues 26.2
lab coat 26.1
happy 25.7
clinic 24.7
group 24.2
working 23
occupation 22.9
office 22.5
smiling 22.4
men 22.3
medicine 22
health 21.5
work 21.2
businesswoman 20.9
businesspeople 20.9
teamwork 20.4
30s 19.2
case 18.8
indoors 18.5
portrait 18.1
mature 17.7
stethoscope 17.7
corporate 17.2
looking 16.8
standing 16.5
care 16.5
desk 16.1
women 15.8
associates 15.7
coworkers 15.7
sick person 15.2
meeting 15.1
smile 15
20s 14.7
uniform 14.5
profession 14.4
talking 14.3
practitioner 13.9
doctors 13.8
indoor 13.7
confident 13.7
room 13.6
40s 13.6
casual 13.6
cheerful 13
clothing 12.9
surgeon 12.8
employee 12.7
suit 12.7
specialist 12.7
mid adult 12.5
elderly 12.4
waiter 12.4
successful 11.9
day 11.8
clinical 11.7
handsome 11.6
lifestyle 11.6
four 11.5
human 11.2
senior 11.2
manager 11.2
camera 11.1
happiness 11
cooperation 10.6
laboratory 10.6
color 10.6
together 10.5
illness 10.5
success 10.5
computer 10.4
golfer 10.4
technology 10.4
bright 10
face 9.9
crew 9.8
50s 9.8
attractive 9.8
staff 9.8
assistant 9.7
expertise 9.7
diversity 9.6
partnership 9.6
table 9.5
building 9.5
ethnic 9.5
research 9.5
two 9.3
company 9.3
black 9
fifties 8.9
discussing 8.8
30 35 years 8.8
forties 8.8
garment 8.8
home 8.8
discussion 8.8
middle aged 8.8
executive 8.7
couple 8.7
partner 8.7
modern 8.4
dining-room attendant 8.3
friendly 8.2
laptop 8.2
student 8.1
player 8
chemical 7.9
diagnosis 7.8
diverse 7.8
businessmen 7.8
consultant 7.8
thirties 7.8
lab 7.8
workers 7.8
sitting 7.7
busy 7.7
test 7.7
serious 7.6
hand 7.6
adults 7.6
career 7.6
light 7.4
treatment 7.3
life 7.3

Google
created on 2022-01-21

Trousers 96
Black 89.7
Style 83.9
Snapshot 74.3
White-collar worker 74.3
Monochrome 74.2
Event 72.6
Blazer 71.7
Monochrome photography 70.4
Vintage clothing 70.4
Formal wear 69.2
Suit 69
Chair 69
Team 68.2
Hat 67.3
Uniform 66.2
Sitting 65.9
Room 63.6
Crew 58.4
History 56.5

Microsoft
created on 2022-01-21

text 99.3
person 91.9
clothing 84.5
smile 70.2
posing 65.8
man 65.2

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Calm 86.4%
Happy 7%
Sad 2.3%
Confused 1.8%
Disgusted 0.9%
Angry 0.8%
Surprised 0.5%
Fear 0.2%

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Sad 44.1%
Calm 33%
Happy 10.5%
Confused 6.8%
Disgusted 1.9%
Angry 1.6%
Surprised 1.1%
Fear 0.9%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 94.7%
Surprised 2.1%
Sad 1.7%
Angry 0.6%
Confused 0.3%
Happy 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 100%
Happy 50.6%
Surprised 16.6%
Confused 8.6%
Sad 7.7%
Angry 5.2%
Calm 5.1%
Disgusted 4.5%
Fear 1.7%

AWS Rekognition

Age 54-62
Gender Male, 100%
Surprised 44.2%
Calm 22.4%
Sad 13.9%
Happy 8.1%
Confused 4.4%
Angry 3.2%
Disgusted 2.7%
Fear 1.2%

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Calm 65.9%
Happy 8.6%
Surprised 8%
Confused 7.8%
Sad 4.9%
Angry 2.3%
Disgusted 1.2%
Fear 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 97.4%
Suit 65.4%

Captions

Microsoft

a group of people posing for a photo 91.1%
a group of people posing for the camera 91%
a group of men posing for a photo 90%

Text analysis

Amazon

MJI7
MJI7 YOX
YOX