Human Generated Data

Title

Untitled (girl sitting with dolls on bed)

Date

c. 1950, printed later

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.228

Human Generated Data

Title

Untitled (girl sitting with dolls on bed)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.228

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.6
Human 98.6
Apparel 97
Clothing 97
Animal 89.4
Bird 89.4
Person 81.9
Collage 71.9
Advertisement 71.9
Poster 71.9
Hat 62.9
Toy 59.3
Plant 59.3
Shorts 56.3
Photo 56.3
Photography 56.3
Hair 55.2

Clarifai
created on 2023-10-26

people 99.8
child 98.8
portrait 98.7
two 98.5
family 98
woman 97.9
son 97.5
monochrome 97.2
adult 96.9
girl 96.8
man 96.3
three 95.7
room 94.9
group 93.4
couple 93.1
retro 91.6
wear 90.2
sepia 89.3
art 88.8
nostalgia 88.7

Imagga
created on 2022-01-23

bow tie 32.1
adult 31.4
person 29
people 29
portrait 28.5
sexy 25.7
necktie 25.7
fashion 25.6
attractive 23.1
style 22.3
black 22
model 21.8
hair 21.4
pretty 19.6
face 19.2
makeup 18.5
man 18.1
brunette 17.4
make 17.3
lady 17
clothing 16.7
lifestyle 15.2
sensual 14.6
garment 14.4
women 14.2
elegant 13.7
indoors 13.2
happy 12.5
posing 12.4
vintage 12.4
cute 12.2
elegance 11.8
dress 11.7
male 11.7
interior 11.5
hairstyle 11.4
studio 11.4
cheerful 11.4
sitting 11.2
indoor 11
business 10.9
sensuality 10.9
device 10.6
couple 10.5
love 10.3
smiling 10.1
domestic 10.1
suit 10.1
professional 10
smile 10
retro 9.8
child 9.8
body 9.6
home 9.6
expression 9.4
skin 9.3
office 8.8
room 8.7
vogue 8.7
happiness 8.6
hat 8.5
casual 8.5
fun 8.2
looking 8
jacket 7.7
desire 7.7
youth 7.7
plaything 7.6
cosmetics 7.5
one 7.5
holding 7.4
doll 7.4
executive 7.4
businesswoman 7.3
salon 7.2
color 7.2
eye 7.2
romantic 7.1
businessman 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 98.6
wall 95.5
cartoon 93.8
drawing 89.5
person 89.4
clothing 88.5
gallery 82.1
human face 81.8
sketch 77.8
black and white 63.3
room 45.2
picture frame 29.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-18
Gender Male, 84.1%
Calm 88.9%
Sad 3.2%
Fear 2.8%
Confused 2.6%
Surprised 1.1%
Angry 0.6%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 89.3%
Surprised 3.6%
Disgusted 2.3%
Sad 1.5%
Fear 1.4%
Angry 1%
Confused 0.7%
Happy 0.2%

Microsoft Cognitive Services

Age 20
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Bird 89.4%

Categories

Captions

Microsoft
created on 2022-01-23

an old photo of a person 75.6%
an old photo of a person 73.6%
a person sitting in a room 73.5%