Human Generated Data

Title

Untitled (older man and woman with birthday cake)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2273

Human Generated Data

Title

Untitled (older man and woman with birthday cake)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Apparel 99.8
Clothing 99.8
Person 99.2
Human 99.2
Person 99
Person 98.2
Person 95.7
Person 94.6
Person 89.2
Accessory 85.1
Accessories 85.1
Sunglasses 85.1
Meal 78.2
Food 78.2
People 77.5
Person 77.1
Icing 72.3
Dessert 72.3
Creme 72.3
Cake 72.3
Cream 72.3
Clinic 69.6
Sleeve 68.1
Coat 62.8
Face 60.5
Photography 60.5
Photo 60.5
Portrait 60.5
Long Sleeve 59
Dish 58.8
Fashion 55.5
Gown 55.5

Imagga
created on 2022-01-30

lab coat 96.4
coat 81.7
man 41
person 38.4
male 36.9
garment 36.2
people 32.9
doctor 32
medical 30
adult 28
professional 27.8
clothing 27.5
hospital 26.5
clinic 25.1
patient 25.1
men 22.3
health 21.6
indoors 20.2
happy 20.1
nurse 17.8
office 17.7
business 17.6
medicine 17.6
occupation 17.4
care 17.3
businessman 16.8
sitting 16.3
worker 16.3
smiling 15.9
work 15.9
colleagues 15.6
portrait 15.5
laboratory 15.4
job 15.1
mature 14.9
indoor 14.6
lab 14.6
color 14.5
looking 14.4
team 14.3
bright 14.3
face 14.2
senior 14.1
couple 13.9
casual 13.6
day 13.3
desk 13.2
specialist 12.9
smile 12.8
computer 12.8
suit 12.6
30s 12.5
working 12.4
uniform 12.4
businesspeople 12.3
table 12.1
women 11.9
scientist 11.8
elderly 11.5
corporate 11.2
happiness 11
room 10.9
practitioner 10.9
associates 10.8
chemistry 10.6
together 10.5
research 10.5
old 10.5
home 10.4
stethoscope 10.3
two 10.2
lifestyle 10.1
businesswoman 10
modern 9.8
handsome 9.8
attractive 9.8
assistant 9.7
black 9.6
illness 9.5
study 9.3
teamwork 9.3
inside 9.2
20s 9.2
hand 9.1
surgeon 9.1
laptop 9.1
confident 9.1
groom 9
cheerful 8.9
technology 8.9
science 8.9
group 8.9
doctors 8.9
50s 8.8
businessmen 8.8
40s 8.8
sick person 8.7
education 8.7
case 8.7
profession 8.6
treatment 8.3
human 8.3
healing 8
look 7.9
coworkers 7.9
30 35 years 7.9
standing 7.8
clinical 7.8
instrument 7.8
chemical 7.8
expertise 7.8
busy 7.7
using 7.7
student 7.7
teacher 7.7
exam 7.7
staff 7.7
biology 7.6
adults 7.6
one 7.5
focus 7.4

Google
created on 2022-01-30

Coat 86.8
Tie 85
Headgear 82.1
Hat 81.3
Curtain 77.2
Cooking 73.9
Vintage clothing 73.6
Monochrome photography 72.5
Event 71.6
Monochrome 70.5
Suit 68.6
Room 66.3
Formal wear 65
Plant 64.9
History 61.8
Service 58
Art 56.5

Microsoft
created on 2022-01-30

birthday cake 95.1
person 89.6
clothing 87.7
man 87.2
wedding cake 85.9
text 83.3
candle 79.9
wedding dress 76.2
funeral 72.1
bride 69.2
old 63.2
cake 53.4
posing 37.7

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 99.5%
Calm 94.8%
Happy 1.3%
Sad 1.2%
Angry 1.1%
Disgusted 0.7%
Surprised 0.5%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 50-58
Gender Male, 94%
Sad 71%
Happy 20.2%
Confused 2.6%
Disgusted 2%
Angry 1.4%
Calm 1%
Surprised 0.9%
Fear 0.9%

AWS Rekognition

Age 53-61
Gender Female, 73.2%
Happy 83.6%
Calm 10.8%
Sad 2.8%
Confused 1.1%
Disgusted 0.7%
Angry 0.5%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 28-38
Gender Male, 83.6%
Calm 63.8%
Confused 22.2%
Fear 5%
Sad 4.1%
Happy 1.5%
Disgusted 1.3%
Surprised 1.2%
Angry 0.8%

AWS Rekognition

Age 10-18
Gender Female, 90.2%
Sad 62.9%
Fear 18.3%
Angry 5.5%
Confused 5.1%
Calm 3.9%
Surprised 2%
Happy 1.5%
Disgusted 0.8%

AWS Rekognition

Age 47-53
Gender Female, 69.2%
Calm 95%
Sad 3%
Happy 0.9%
Confused 0.4%
Angry 0.2%
Fear 0.2%
Surprised 0.2%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Sunglasses 85.1%

Captions

Microsoft

a group of people posing for a photo 94.2%
an old photo of a group of people posing for the camera 94.1%
an old photo of a group of people posing for a picture 94%

Text analysis

Amazon

018801
KODAK--VA--

Google

ap
EE
ap KODVK--2 EE -
KODVK--2
-