Human Generated Data

Title

Untitled (portrait of woman sitting in window seat with baby in fur hat)
Date

c. 1920-1940
People

Artist: O. B. Porter Studio, American active 1930s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11168

Human Generated Data

Title

Untitled (portrait of woman sitting in window seat with baby in fur hat)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1920-1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 100
Clothing 100
Bonnet 99.9
Human 98.3
Person 98.3
Person 96.3
Hat 93.1
Painting 66.6
Art 66.6
Teen 63.4
Photo 61.3
Portrait 61.3
Photography 61.3
Face 61.3
Girl 60.9
Female 60.9
Sun Hat 60.6

Imagga
created on 2022-01-23

grandfather 90.7
family 48.9
child 41.1
parent 38.5
mother 38.4
happy 34.5
father 34.4
love 31.6
man 29.6
people 29.6
home 29.5
male 29.5
kid 26.6
happiness 25.9
together 25.4
kin 23.4
baby 23.2
children 22.8
boy 22.6
dad 22.3
daughter 22.1
casual 22
couple 21.8
portrait 21.4
smiling 21
cute 20.8
childhood 20.6
adult 20.1
husband 19.1
lifestyle 18.8
smile 18.5
togetherness 17.9
fun 17.2
little 16.8
grandma 16.5
person 16.5
face 16.3
senior 15.9
couch 15.5
old 15.3
joy 15
cheerful 14.6
son 14.4
loving 14.3
kids 14.1
sitting 13.7
playing 13.7
brother 13.3
wife 13.3
holding 13.2
adorable 12.9
two 12.7
life 12.5
mature 12.1
interior 11.5
elderly 11.5
laughing 11.3
clothing 11.2
relaxing 10.9
parents 10.8
looking 10.4
black 10.2
indoor 10
parenthood 9.8
human 9.7
retired 9.7
mom 9.7
affectionate 9.7
indoors 9.7
day 9.4
youth 9.4
house 9.2
leisure 9.1
room 9.1
girls 9.1
attractive 9.1
domestic 9
grandmother 8.8
newborn 8.8
boys 8.7
infant 8.7
play 8.6
enjoying 8.5
hand 8.4
joyful 8.3
care 8.2
outdoors 8.2
blond 8.1
women 7.9
generations 7.9
30s 7.7
expression 7.7
married 7.7
sofa 7.7
toddler 7.6
playful 7.6
relationship 7.5
lady 7.3
group 7.3
offspring 7.2
active 7.2
military uniform 7.2
handsome 7.1

Google
created on 2022-01-23

Hat 87.7
Picture frame 86.7
Art 79
Vintage clothing 75.6
Toddler 72
Sun hat 67.6
Baby 66.2
Room 66.1
Chair 66.1
Stock photography 66.1
Curtain 65.5
Sitting 64.5
Classic 64
Painting 61.8
Visual arts 61.2
Portrait 58.9
Fedora 58.2
Lap 55.6
Child 54.9
History 53.6

Microsoft
created on 2022-01-23

baby 99.1
toddler 98.6
person 98.2
sitting 98
human face 97.9
clothing 96.8
child 93.8
text 85.5
smile 81.4
boy 80.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Female, 100%
Calm 95.4%
Angry 1.8%
Happy 0.7%
Disgusted 0.6%
Confused 0.5%
Sad 0.5%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 0-3
Gender Female, 100%
Calm 98.8%
Sad 0.4%
Surprised 0.4%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%
Angry 0%

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Hat 93.1%
Painting 66.6%

Captions

Microsoft

a person sitting on a bus 68%
a man and a woman sitting on a bus 54.7%
a person sitting on a bus 54.6%

Text analysis

Amazon

30

Google

L E 9KUUVK 30
E
9KUUVK
L
30