Human Generated Data

Title

Untitled (retouched portrait of couple, man in military hat)
Date

1940s
People

Artist: Robert Burian, American active 1940s-1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13323

Human Generated Data

Title

Untitled (retouched portrait of couple, man in military hat)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1940s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 100
Apparel 100
Person 98.3
Human 98.3
Hat 96.1
Person 95.6
Face 79.3
Coat 75.1
Overcoat 66.4
Portrait 60.9
Photography 60.9
Photo 60.9
Scarf 59.2

Imagga
created on 2022-01-22

hat 38.4
portrait 38.2
bow tie 36.4
adult 35.6
mother 32.3
attractive 30.1
face 29.8
people 29.6
necktie 29.2
happy 28.8
clothing 27.8
person 27.3
child 27.3
fashion 27.1
couple 25.3
smile 24.2
model 24.1
smiling 23.9
pretty 23.1
cute 23
happiness 22.7
women 22.2
love 22.1
parent 22
sexy 20.9
hair 19.8
family 19.6
bonnet 19.2
expression 17.9
male 17.8
man 17.5
brunette 17.4
two 16.9
together 16.7
garment 16.7
lady 16.2
style 15.6
headdress 15.5
daughter 15.4
human 15
sensuality 14.5
dress 14.5
looking 14.4
elegance 14.3
posing 14.2
cheerful 13.8
blond 13.7
home 13.6
bride 13.4
kid 13.3
lifestyle 13
wedding 12.9
nice 12.8
makeup 12.8
make 12.7
gorgeous 12.7
boy 12.2
black 12
fun 12
youth 11.9
joy 11.7
relationship 11.2
long 11
girls 10.9
studio 10.6
loving 10.5
marriage 10.4
husband 10.2
skin 10.2
lovely 9.8
hugging 9.8
close 9.7
eyes 9.5
men 9.4
casual 9.3
sensual 9.1
handsome 8.9
romantic 8.9
veil 8.8
affection 8.7
sitting 8.6
wife 8.5
clothes 8.4
leisure 8.3
indoor 8.2
teenager 8.2
day 7.8
life 7.8
groom 7.8
engagement 7.7
old 7.7
hairstyle 7.6
enjoying 7.6
head 7.6
togetherness 7.6
friends 7.5
son 7.5
one 7.5
joyful 7.4
20s 7.3
children 7.3
stylish 7.2
father 7.2
romance 7.1
indoors 7
modern 7

Google
created on 2022-01-22

Face 98.5
Coat 85.5
Gesture 85.3
Headgear 81.9
Military person 75.6
Art 75.5
Side cap 74.7
Vintage clothing 73
Classic 71
Jewellery 68.7
Formal wear 68.6
Event 67.8
History 66.6
Uniform 66.6
Monochrome 65.6
Illustration 64.9
Monochrome photography 64.4
Fashion accessory 64.2
Stock photography 63.4
Headpiece 61.4

Microsoft
created on 2022-01-22

wall 99.6
fashion accessory 99.1
human face 99
person 98.2
indoor 93.9
portrait 93.3
clothing 92.4
hat 91.2
text 90.7
sketch 86.3
woman 77.7
smile 76.9
people 71.6
retro style 59.6
drawing 57.4
headgear 55.5
posing 54.7
vintage clothing 53.2
old 51.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Female, 100%
Calm 88.8%
Happy 6.4%
Surprised 1.4%
Angry 1.2%
Confused 0.9%
Sad 0.6%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 96.4%
Surprised 1.5%
Sad 1%
Angry 0.3%
Happy 0.2%
Fear 0.2%
Confused 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Hat 96.1%
Scarf 59.2%

Captions

Microsoft

Alfredo Kraus et al. posing for a photo 97.6%
Alfredo Kraus et al. posing for the camera 97.5%
Alfredo Kraus et al. posing for a photo 95.5%