Human Generated Data

Title

Untitled (family of five posing for portrait with mother and father seated in front and son and two daughters standing behind them)

Date

c. 1945, printed later

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6705

Human Generated Data

Title

Untitled (family of five posing for portrait with mother and father seated in front and son and two daughters standing behind them)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 98.9
Human 98.9
Person 98.9
Person 98.6
Face 98
Person 97.4
Advertisement 91.9
Collage 91.9
Person 91.1
Smile 87.9
People 87.6
Sleeve 73.1
Clothing 73.1
Apparel 73.1
Female 73
Child 71.3
Kid 71.3
Photo 70.5
Portrait 70.5
Photography 70.5
Girl 67.4
Head 65.3
Performer 60.6
Family 59.2
Long Sleeve 58.8
Hair 56.2
Poster 55.2

Clarifai
created on 2019-11-16

people 100
child 99.9
group 99.9
portrait 99.1
music 98.6
television 98.5
offspring 98.1
actress 97.9
adult 97.7
facial expression 97.2
musician 97.2
movie 97.1
family 97
woman 96.8
son 96.5
baby 95.9
wear 95.5
singer 95.5
man 94.9
furniture 94.4

Imagga
created on 2019-11-16

black 27.7
creation 19.3
billboard 19.3
book jacket 17.2
art 16.3
signboard 15.6
symbol 14.8
grunge 14.5
jacket 14.4
vintage 14.1
phonograph record 13.2
one 12.7
product 12.6
man 12.1
sexy 12
style 11.9
person 11.8
silhouette 11.6
structure 11.3
party 11.2
people 11.2
adult 11
dress 10.8
male 10.6
wrapping 10.2
representation 10
frame 10
fashion 9.8
dance 9.7
stamp 9.7
mail 9.6
hair 9.5
culture 9.4
reflection 9.4
portrait 9.1
retro 9
envelope 8.9
postmark 8.9
printed 8.9
postage 8.8
paintings 8.8
design 8.6
painted 8.6
post 8.6
poster 8.5
elegance 8.4
letter 8.3
sewing machine 8.1
web site 8.1
office 8
water 8
night 8
masterpiece 7.9
fame 7.9
known 7.9
circa 7.9
postal 7.8
face 7.8
modern 7.7
artist 7.7
expression 7.7
old 7.7
picture 7.6
pattern 7.5
photograph 7.3
paint 7.2
body 7.2
pistol 7.1
icon 7.1
graphics 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

text 97.7
person 96.7
human face 95.1
clothing 91.6
window 91.1
cartoon 90.6
poster 84.8
black and white 75.4
smile 67
man 62.7
posing 55.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 83.9%
Calm 95.2%
Sad 1.3%
Happy 0.4%
Angry 0.7%
Surprised 1.1%
Confused 0.6%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 24-38
Gender Female, 97.3%
Fear 0.4%
Angry 1.3%
Happy 3.4%
Disgusted 7.9%
Confused 70.1%
Calm 14.5%
Sad 1.1%
Surprised 1.4%

AWS Rekognition

Age 21-33
Gender Female, 98.7%
Angry 3%
Surprised 6.8%
Sad 0.6%
Fear 2.7%
Calm 3.2%
Happy 4.7%
Confused 72.7%
Disgusted 6.3%

AWS Rekognition

Age 22-34
Gender Female, 99.1%
Fear 0.3%
Angry 0.5%
Calm 0.2%
Surprised 1.5%
Happy 96.7%
Confused 0.3%
Sad 0.1%
Disgusted 0.4%

AWS Rekognition

Age 22-34
Gender Male, 95.7%
Calm 0.1%
Fear 0.2%
Angry 0.1%
Disgusted 0%
Sad 0.1%
Happy 99.2%
Surprised 0.3%
Confused 0.1%

AWS Rekognition

Age 19-31
Gender Female, 91.8%
Happy 0.1%
Disgusted 0.2%
Calm 96.1%
Sad 1.1%
Surprised 0.5%
Confused 1.7%
Fear 0.1%
Angry 0.2%

AWS Rekognition

Age 39-57
Gender Male, 92%
Confused 0.2%
Calm 6.9%
Sad 0.4%
Surprised 0.5%
Happy 90.3%
Disgusted 0.7%
Fear 0.1%
Angry 0.9%

AWS Rekognition

Age 5-15
Gender Female, 97.9%
Surprised 0.2%
Angry 0.2%
Fear 0.1%
Calm 1.4%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Happy 97.9%

AWS Rekognition

Age 28-44
Gender Female, 98.8%
Happy 98.5%
Fear 0.1%
Sad 0%
Confused 0.1%
Disgusted 0.2%
Angry 0.5%
Calm 0.1%
Surprised 0.6%

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 31
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Poster 55.2%

Captions

Microsoft

a group of people posing for a photo in front of a window 76.1%
a group of people posing for a photo 76%
a group of people posing for the camera 75.9%