Human Generated Data

Title

Untitled (boy with parents)
Date

c. 1950
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18936

Human Generated Data

Title

Untitled (boy with parents)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Chair 100
Furniture 100
Human 99.7
Person 99.7
Clothing 99.6
Apparel 99.6
Person 99.1
Person 99
Overcoat 98.9
Coat 98.9
Suit 98.9
Person 98.9
Person 97.6
Plant 97.5
Face 92
Flower 91.9
Blossom 91.9
Dress 90
Vase 89.9
Jar 89.9
Pottery 89.9
Tuxedo 88
Potted Plant 87.7
Flower Arrangement 86.4
Flower Bouquet 84.8
Bridegroom 82
Wedding 82
Female 81.8
Smile 79.5
Robe 78.7
Fashion 78.7
Gown 77.8
Indoors 77.3
Person 76.5
Table 75.6
Dining Table 75.6
Sitting 74.4
Portrait 72.7
Photography 72.7
Photo 72.7
Man 72.5
Tie 71.8
Accessories 71.8
Accessory 71.8
Food 65.6
Meal 65.6
Woman 65.5
People 65.4
Room 63.3
Wedding Gown 63
Ornament 61.9
Ikebana 61.9
Art 61.9
Girl 60.9
Crowd 56.9
Person 55.2
Person 51.5

Imagga
created on 2022-03-05

man 42.3
groom 34.7
couple 34
male 33.4
people 32.9
kin 30
senior 29
person 27.4
adult 24
home 23.9
happiness 21.9
happy 21.9
smiling 18.8
indoors 18.4
together 17.5
love 16.6
sitting 16.3
men 16.3
elderly 16.3
husband 16.2
patient 15.4
bride 15.3
wife 15.2
family 15.1
meeting 15.1
cheerful 14.6
two people 14.6
business 14.6
30s 14.4
businessman 14.1
mature 13.9
two 13.5
medical 13.2
lifestyle 13
day 12.5
portrait 12.3
looking 12
wedding 12
grandma 11.9
loving 11.4
grandfather 11.4
smile 11.4
marriage 11.4
table 11.2
drink 10.9
casual clothing 10.8
team 10.7
colleagues 10.7
to 10.6
mid adult 10.6
married 10.5
group 10.5
old 10.4
salon 10.3
teacher 10.3
women 10.3
camera 10.2
indoor 10
face 9.9
clothing 9.8
70s 9.8
nurse 9.8
40s 9.7
interior 9.7
office 9.7
older 9.7
retirement 9.6
talking 9.5
businesspeople 9.5
casual 9.3
room 9.3
case 9.1
holding 9.1
health 9
hospital 9
working 8.8
retired 8.7
brunette 8.7
drinking 8.6
mother 8.6
enjoying 8.5
rose 8.4
care 8.2
dress 8.1
restaurant 8
look 7.9
boy 7.8
color 7.8
discussion 7.8
thirties 7.8
professional 7.8
ceremony 7.8
affectionate 7.7
father 7.7
waist 7.7
worker 7.7
expression 7.7
clinic 7.6
adults 7.6
friends 7.5
relationship 7.5
lab coat 7.4
student 7.4
life 7.3
coat 7.3
food 7.3
businesswoman 7.3
celebration 7.2
kitchen 7.2
romance 7.1
sick person 7.1
child 7
bouquet 7

Google
created on 2022-03-05

Black 89.5
Black-and-white 85.9
Style 84
Window 76.7
Monochrome 75.7
Monochrome photography 75.2
Snapshot 74.3
Event 72.9
Smile 71
Vintage clothing 69.1
Hat 65.9
Room 65.2
Eyewear 64.4
Stock photography 63
Tie 61.7
History 61.7
Sitting 60.5
Formal wear 60.4
T-shirt 54.9
Team 51.8

Microsoft
created on 2022-03-05

text 97.4
person 95.5
man 91.8
clothing 90.8
smile 82.1
black and white 78.5
flower 61
human face 55.1
wedding dress 52.6

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 89.1%
Happy 98.4%
Confused 0.5%
Surprised 0.3%
Calm 0.3%
Disgusted 0.2%
Fear 0.1%
Sad 0.1%
Angry 0.1%

AWS Rekognition

Age 51-59
Gender Male, 100%
Happy 63.1%
Calm 23.6%
Confused 5.7%
Surprised 5.2%
Sad 1.2%
Disgusted 0.5%
Angry 0.5%
Fear 0.2%

AWS Rekognition

Age 43-51
Gender Male, 96%
Happy 92.7%
Surprised 3.3%
Fear 2.6%
Calm 0.5%
Confused 0.3%
Sad 0.3%
Disgusted 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 71.8%

Captions

Microsoft

a group of people sitting at a table 88.9%
a group of men sitting at a table 88.8%
a group of people sitting around a table 88.4%

Text analysis

Amazon

3
KO
2
3 3 2 8.
9/7
8.
M.M7--YT37A*2