Human Generated Data

Title

Untitled (groom and groomsmen by cake and coffee table)

Date

c. 1955

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6999

Human Generated Data

Title

Untitled (groom and groomsmen by cake and coffee table)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.2
Human 99.2
Person 99
Person 98.8
Person 98.1
Person 97.9
Person 97.4
Person 95.7
Person 93.4
Sailor Suit 88.1
Meal 86.4
Food 86.4
Chair 71.9
Furniture 71.9
Tablecloth 71.4
Dessert 69.8
Cake 69.8
Wedding Cake 69.8
Flower 67.6
Plant 67.6
Blossom 67.6
Coat 64
Clothing 64
Suit 64
Overcoat 64
Apparel 64
Dish 60.6
Home Decor 59.3
Flower Arrangement 59.1
Linen 58.7
Icing 58.2
Cream 58.2
Creme 58.2
Flooring 56.6

Imagga
created on 2022-01-23

nurse 100
person 39
man 35.6
professional 34.5
people 33.5
patient 32.9
male 32.6
medical 31.8
adult 31.6
doctor 30.1
happy 27.6
office 24.1
hospital 22.9
business 22.5
smiling 22.4
men 22.3
work 22
indoors 21.1
businessman 20.3
clinic 20.3
medicine 20.2
health 20.1
room 20
portrait 19.4
home 19.1
job 18.6
businesswoman 18.2
smile 17.8
women 16.6
occupation 16.5
team 16.1
desk 16.1
coat 16
working 15.9
happiness 15.7
colleagues 15.5
attractive 15.4
businesspeople 15.2
lifestyle 15.2
meeting 15.1
care 14.8
modern 14.7
corporate 14.6
group 14.5
casual 14.4
two 14.4
case 14.3
talking 14.3
mature 13.9
computer 13.6
sick person 13.6
together 13.1
cheerful 13
practitioner 12.8
worker 12.4
holding 12.4
table 12.1
looking 12
indoor 11.9
color 11.7
examination 11.7
teacher 11.5
specialist 11.4
life 11.3
sitting 11.2
associates 10.8
doctors 10.8
30s 10.6
lab coat 10.5
success 10.5
couple 10.5
teamwork 10.2
laptop 10
clinical 9.8
interior 9.7
stethoscope 9.6
brunette 9.6
exam 9.6
standing 9.6
adults 9.5
manager 9.3
house 9.2
clothing 8.9
consultant 8.8
assistant 8.7
lab 8.7
hands 8.7
diversity 8.6
uniform 8.5
senior 8.4
pretty 8.4
camera 8.3
executive 8.3
successful 8.2
technology 8.2
family 8
love 7.9
coworkers 7.9
surgeon 7.8
expertise 7.8
partner 7.7
mid adult 7.7
partnership 7.7
expression 7.7
loving 7.6
career 7.6
communication 7.6
inside 7.4
treatment 7.3
20s 7.3
lady 7.3
kitchen 7.2
educator 7.1

Google
created on 2022-01-23

Table 95.3
Coat 89.7
Chair 80.5
Event 73.8
Suit 73.5
Tie 71.5
Vintage clothing 71.4
Picture frame 69.8
Monochrome photography 69
Monochrome 68.3
Team 67.5
Room 67.3
Classic 67.1
Formal wear 66.3
History 62.9
Tablecloth 62.5
Uniform 58.9
Photo caption 55.6
Crew 55.5
Ceremony 54.6

Microsoft
created on 2022-01-23

wall 99.5
person 98.9
posing 94.5
indoor 91
man 90.8
clothing 89.1
old 89.1
white 82.7
standing 76.8
black 76.7
group 65
text 61.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Male, 100%
Happy 45.6%
Calm 32.9%
Angry 7.5%
Sad 5.5%
Confused 2.7%
Disgusted 2.2%
Surprised 1.9%
Fear 1.6%

AWS Rekognition

Age 11-19
Gender Male, 100%
Happy 99.8%
Confused 0.1%
Surprised 0.1%
Calm 0%
Angry 0%
Disgusted 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 31-41
Gender Male, 100%
Happy 99.3%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Calm 0.1%
Fear 0.1%
Sad 0.1%
Confused 0%

AWS Rekognition

Age 22-30
Gender Male, 100%
Angry 62.2%
Happy 34.9%
Confused 0.7%
Disgusted 0.5%
Surprised 0.5%
Sad 0.4%
Calm 0.4%
Fear 0.3%

AWS Rekognition

Age 52-60
Gender Female, 99.7%
Calm 91.8%
Fear 3.2%
Surprised 2.4%
Sad 1.9%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Happy 97.7%
Surprised 0.6%
Fear 0.5%
Angry 0.5%
Disgusted 0.3%
Sad 0.2%
Confused 0.2%
Calm 0.1%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Happy 55%
Calm 15.7%
Surprised 10.9%
Fear 6.3%
Confused 3.5%
Sad 2.9%
Disgusted 2.8%
Angry 2.8%

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Chair 71.9%
Wedding Cake 69.8%
Suit 64%

Captions

Microsoft

a group of people posing for a photo 98.1%
a vintage photo of a group of people posing for the camera 97.1%
a vintage photo of a group of people posing for a picture 97%

Text analysis

Amazon

10
I