Human Generated Data

Title

Untitled (portrait, two boys)
Date

c.1925
People

Artist: Harris & Ewing, American 1910s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22344

Human Generated Data

Title

Untitled (portrait, two boys)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

c.1925

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Human 99.7
Person 99.7
Person 99.5
Clothing 87.6
Apparel 87.6
Boy 85.9
Face 80.8
Furniture 75.5
Shorts 70.5
Child 69.8
Kid 69.8
Photography 67.1
Portrait 67.1
Photo 67.1
Finger 66
Crypt 65.4
Baby 64.7
Dish 62.8
Food 62.8
Meal 62.8
Head 58.2
Sleeve 58
Indoors 57.1
Chair 56.5
Bed 56.1

Imagga
created on 2022-03-11

child 52.3
male 42.9
man 38.4
sibling 37.4
people 37.4
happy 37
smiling 34.7
couple 34
family 32
home 30.3
person 30.1
mother 29.6
parent 28.4
together 28
adult 26.1
lifestyle 26
senior 25.3
father 24.8
happiness 24.3
indoors 23.7
love 23.7
portrait 23.3
kin 22.5
sitting 21.5
mature 20.5
cheerful 20.3
baby 20.2
dad 18.1
enjoying 18
fun 18
kid 17.7
leisure 17.4
togetherness 17
smile 16.4
husband 16.2
boy 15.6
children 15.5
casual 15.3
two 15.2
60s 14.7
women 13.4
elderly 13.4
horizontal 13.4
son 13.3
laughing 13.2
relaxed 13.1
cute 12.9
men 12.9
juvenile 12.8
two people 12.6
childhood 12.5
little 12.4
daughter 12
indoor 11.9
sixties 11.8
30s 11.5
wife 11.4
table 11.3
outdoors 11.2
looking 11.2
camera 11.1
joy 10.9
older 10.7
face 10.7
drinking 10.5
friendship 10.3
clothing 10.1
holding 9.9
old 9.8
retired 9.7
group 9.7
food 9.7
married 9.6
education 9.5
kids 9.4
room 9.3
20s 9.2
playing 9.1
relaxing 9.1
park 9.1
care 9.1
grandma 8.9
meal 8.9
seniors 8.8
middle aged 8.8
grandfather 8.7
couch 8.7
mid adult 8.7
retirement 8.6
loving 8.6
talking 8.6
friends 8.5
pretty 8.4
health 8.3
adorable 8.3
girls 8.2
active 8.1
handsome 8
to 8
granddaughter 7.9
50s 7.8
bonding 7.8
having 7.7
school 7.6
blond 7.4
dress 7.2
holiday 7.2
professional 7.2
kitchen 7.2
romantic 7.1
summer 7.1
day 7.1

Google
created on 2022-03-11

Smile 92
Black 89.7
Shorts 88.8
Flash photography 88.5
Sleeve 87.2
Black-and-white 86.7
Happy 85.3
Gesture 85.3
Style 84.1
Monochrome 78.6
Monochrome photography 78
People 77.9
Snapshot 74.3
T-shirt 74.2
Toddler 73.6
Sitting 71.8
Fun 67.4
Child 66.7
Stock photography 64.3
Comfort 63.6

Microsoft
created on 2022-03-11

toddler 99.2
person 98.4
baby 98.1
wall 97.4
boy 96.8
child 94.7
human face 94
text 93.1
young 92.5
clothing 90
black and white 88.7
little 86.2
black 79.4

Face analysis

Amazon

Google

AWS Rekognition

Age 4-10
Gender Female, 72.9%
Sad 74.9%
Calm 16.6%
Happy 2.8%
Surprised 2.8%
Angry 1%
Fear 1%
Disgusted 0.7%
Confused 0.2%

AWS Rekognition

Age 2-10
Gender Male, 99%
Surprised 82.7%
Calm 7.4%
Happy 3.9%
Fear 1.9%
Angry 1.7%
Sad 1.5%
Disgusted 0.7%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a little boy posing for a photo 72.3%
a little girl posing for a photo 72.2%
a little boy posing for a picture 72.1%