Human Generated Data

Title

Untitled (two photographs: portrait of older man with glasses holding small baby; double studio portrait of boy in hat and wool coat)
Date

1910-1940, printed later
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10260

Human Generated Data

Title

Untitled (two photographs: portrait of older man with glasses holding small baby; double studio portrait of boy in hat and wool coat)

People

Artist: Martin Schweig, American 20th century

Date

1910-1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Apparel 99.5
Clothing 99.5
Person 99.5
Human 99.5
Person 99.4
Hat 98.7
Hat 98.4
Person 95.5
Advertisement 92
Collage 92
Poster 92
Electronics 91.6
Screen 91.6
Display 91.6
Monitor 91.6
Overcoat 85.8
Coat 85.8
Suit 85.8
Face 72.3
Sun Hat 69.4
Cat 66.9
Mammal 66.9
Pet 66.9
Animal 66.9
Finger 63.3
Photography 60.1
Photo 60.1
Portrait 60.1

Clarifai
created on 2019-11-16

people 99.9
portrait 99.6
lid 99.5
adult 99.2
monochrome 98.6
wear 97.5
indoors 97.1
outfit 96.5
movie 95.5
woman 95.3
facial expression 94.9
man 94.7
veil 93.6
nostalgia 92.5
musician 90.9
child 90.2
vertical 89.1
music 89
fedora 88.7
actress 88

Imagga
created on 2019-11-16

black 30
bow tie 27.8
portrait 24.6
person 23.9
man 23.5
necktie 23.4
face 22
male 21.3
monitor 20.1
people 19
adult 18.7
expression 14.5
electronic equipment 14.2
hat 14.2
one 13.4
television 13.4
human 12.7
screen 12.4
office 12
world 11.5
business 11.5
garment 11.5
smile 11.4
fashion 11.3
model 10.9
dark 10.9
vintage 10.7
equipment 10.7
pretty 10.5
art 10.2
symbol 10.1
head 10.1
background 10
attractive 9.8
lady 9.7
brunette 9.6
painted 9.5
hair 9.5
love 9.5
eyes 9.5
performer 9.2
clothing 9.2
jacket 9.1
sexy 8.8
suit 8.7
elegance 8.4
studio 8.4
emotion 8.3
flag 8.3
makeup 8.2
make 8.2
paint 8.1
happy 8.1
religion 8.1
looking 8
posing 8
smiling 8
ball 7.9
elegant 7.7
culture 7.7
patriotic 7.7
tie 7.6
display 7.5
silhouette 7.4
style 7.4
lips 7.4
event 7.4
training 7.4
competition 7.3
covering 7.3
global 7.3
stylish 7.2
cute 7.2
eye 7.1
icon 7.1
window 7.1
happiness 7
design 7

Google
created on 2019-11-16

Photograph 95.9
Photographic paper 74.4
Black-and-white 68.3
Photography 67.8
Room 65.7
Art 58.1

Microsoft
created on 2019-11-16

hat 99.1
human face 97.1
text 96.7
fashion accessory 95.9
person 91.2
fedora 90.7
clothing 89.9
man 81
black and white 78.4
cowboy hat 75
white 67.7
old 62.7
older 21.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-21
Gender Female, 54.4%
Angry 1.5%
Happy 0.2%
Disgusted 0.2%
Calm 97.2%
Fear 0%
Surprised 0.1%
Sad 0.4%
Confused 0.4%

AWS Rekognition

Age 13-25
Gender Female, 52.6%
Confused 0.6%
Angry 0.6%
Surprised 0.3%
Calm 96.9%
Disgusted 0.1%
Fear 0.2%
Sad 1.2%
Happy 0.2%

AWS Rekognition

Age 0-3
Gender Female, 68.8%
Calm 4.9%
Sad 0.9%
Happy 93.6%
Angry 0.2%
Fear 0.1%
Surprised 0.2%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 50-68
Gender Male, 83.8%
Calm 26.9%
Angry 5%
Surprised 2.6%
Confused 3.6%
Disgusted 6.1%
Happy 49.7%
Sad 4%
Fear 2.1%

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Hat 98.7%
Monitor 91.6%
Cat 66.9%

Captions

Microsoft

a vintage photo of a man 89.9%
a black and white photo of a man 85.5%
a vintage photo of a man in a suit and tie 85.4%

Text analysis

Amazon

35138
vL
nilbvie
7CEV
7CEV nilbvie kirw
kirw
MILBVLE
MILBVLE LIRW vL
LIRW
21SS

Google

3
3 SI3
SI3