Human Generated Data

Title

Untitled (Frank Natal wedding portrait)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2331

Human Generated Data

Title

Untitled (Frank Natal wedding portrait)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Apparel 99.8
Clothing 99.8
Dress 99.7
Person 99.2
Human 99.2
Person 99.1
Person 99.1
Person 98.2
Person 98.1
Person 97.5
Person 97.5
Person 96.8
Female 94.2
Person 91.8
Person 90.7
Person 88.6
Footwear 86.5
Shoe 86.5
Suit 83.3
Overcoat 83.3
Coat 83.3
Face 81.1
Woman 80.1
Person 75.5
People 75.2
Skirt 72.6
Child 69.9
Kid 69.9
Girl 67.6
Dessert 67.5
Cake 67.5
Icing 67.5
Food 67.5
Cream 67.5
Creme 67.5
Shoe 66
Portrait 64.5
Photo 64.5
Photography 64.5
Shorts 63.6
Fashion 63
Gown 60.5
Furniture 60.4
Evening Dress 59.1
Robe 59.1
Shoe 52.5
Person 43.8

Imagga
created on 2022-01-30

dancer 55.4
performer 53.4
person 45
teacher 38.8
entertainer 38.2
professional 37.6
people 34
man 32.9
couple 31.4
adult 30.2
groom 29.9
dress 28
male 27.7
educator 27.1
bride 27
wedding 23.9
happy 22.6
men 20.6
businessman 20.3
group 18.5
women 18.2
singer 17.9
two 17.8
together 17.5
love 17.4
business 17
bouquet 17
happiness 15.7
marriage 15.2
smile 15
smiling 14.5
married 14.4
musician 14.2
portrait 13.6
suit 13.5
attractive 13.3
job 13.3
meeting 13.2
teamwork 13
office 12.8
work 12.6
team 12.5
corporate 12
executive 12
holding 11.6
new 11.3
room 11.3
nurse 11.3
worker 11.1
handsome 10.7
family 10.7
fashion 10.6
boss 10.5
pretty 10.5
uniform 10.5
celebration 10.4
black 10.2
lifestyle 10.1
elegance 10.1
businesswoman 10
modern 9.8
gown 9.8
indoors 9.7
style 9.6
home 9.6
flowers 9.6
dance 9.6
hands 9.6
businesspeople 9.5
wife 9.5
career 9.5
success 8.8
bridal 8.8
husband 8.7
standing 8.7
youth 8.5
kin 8.3
human 8.2
successful 8.2
girls 8.2
pose 8.2
romance 8
romantic 8
looking 8
interior 8
working 8
employee 7.8
ceremony 7.8
flower 7.7
diversity 7.7
traditional 7.5
brass 7.5
manager 7.4
active 7.4
cheerful 7.3
indoor 7.3
day 7.1
student 7

Google
created on 2022-01-30

Sleeve 84
Art 81.4
Suit 76.1
Snapshot 74.3
Monochrome photography 71.6
Event 71.5
Vintage clothing 69.9
Monochrome 69.8
Room 69.6
Formal wear 65.3
Visual arts 64.7
Classic 63.8
Stock photography 62.5
History 60.9
Font 58.9
Pattern 55.6
Photographic paper 55.1
Rectangle 53.5

Microsoft
created on 2022-01-30

dress 98.5
clothing 96.5
person 95.7
text 94.6
footwear 91.6
woman 90
smile 71.2
player 70.6
sport 65.7
black and white 65.7
white 62.7
posing 55.8
old 49.6
female 29.6
clothes 18

Face analysis

Amazon

AWS Rekognition

Age 36-44
Gender Female, 86.7%
Surprised 64.7%
Calm 13.6%
Happy 8.1%
Disgusted 6.9%
Sad 2.5%
Confused 1.8%
Angry 1.5%
Fear 0.9%

AWS Rekognition

Age 30-40
Gender Male, 98%
Surprised 47.9%
Calm 44.8%
Happy 2.9%
Sad 1.6%
Confused 1.2%
Fear 0.9%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 37-45
Gender Male, 99.4%
Calm 34.2%
Disgusted 24.4%
Happy 15.6%
Sad 11.5%
Surprised 7.2%
Confused 4.2%
Fear 1.8%
Angry 1%

AWS Rekognition

Age 34-42
Gender Male, 97.9%
Happy 69.4%
Calm 28.2%
Surprised 1.2%
Confused 0.5%
Disgusted 0.3%
Sad 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 54-64
Gender Male, 100%
Calm 90.3%
Surprised 3.9%
Angry 2%
Happy 1.2%
Sad 1.1%
Disgusted 0.7%
Confused 0.7%
Fear 0.2%

AWS Rekognition

Age 16-24
Gender Male, 89%
Calm 100%
Sad 0%
Confused 0%
Disgusted 0%
Surprised 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 98.6%
Sad 0.8%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 41-49
Gender Female, 82.7%
Happy 70.1%
Sad 17.6%
Calm 9.7%
Disgusted 0.9%
Confused 0.7%
Surprised 0.5%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Sad 39.6%
Surprised 23.3%
Calm 10.1%
Happy 8.9%
Fear 5.4%
Disgusted 5%
Confused 5%
Angry 2.8%

AWS Rekognition

Age 24-34
Gender Male, 75.8%
Calm 98.5%
Surprised 0.8%
Confused 0.3%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%
Fear 0.1%

Feature analysis

Amazon

Person 99.2%
Shoe 86.5%

Captions

Microsoft

a group of people posing for a photo 88.8%
a group of people posing for the camera 88.7%
a group of people posing for a picture 88.6%

Text analysis

Amazon

I